Nov 02 01:25:00 user nova-compute[74996]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74996) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 02 01:25:00 user nova-compute[74996]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74996) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 02 01:25:00 user nova-compute[74996]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74996) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 02 01:25:00 user nova-compute[74996]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:25:01 user nova-compute[74996]: INFO nova.virt.driver [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 02 01:25:01 user nova-compute[74996]: INFO nova.compute.provider_config [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] Acquiring lock "singleton_lock" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] Acquired lock "singleton_lock" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] Releasing lock "singleton_lock" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] Full set of CONF: {{(pid=74996) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ******************************************************************************** {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] Configuration options gathered from: {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ================================================================================ {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] allow_resize_to_same_host      = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] arq_binding_timeout            = 300 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] backdoor_port                  = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] backdoor_socket                = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] block_device_allocate_retries  = 300 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] block_device_allocate_retries_interval = 5 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cert                           = self.pem {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] compute_monitors               = [] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] config_dir                     = [] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] config_drive_format            = iso9660 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] config_source                  = [] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] console_host                   = user {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] control_exchange               = nova {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cpu_allocation_ratio           = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] daemon                         = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] debug                          = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] default_access_ip_network_name = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] default_availability_zone      = nova {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] default_ephemeral_format       = ext4 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] default_green_pool_size        = 1000 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] default_schedule_zone          = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] disk_allocation_ratio          = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] enable_new_services            = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] enabled_apis                   = ['osapi_compute'] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] enabled_ssl_apis               = [] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] flat_injected                  = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] force_config_drive             = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] force_raw_images               = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] graceful_shutdown_timeout      = 5 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] heal_instance_info_cache_interval = 60 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] host                           = user {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] instance_build_timeout         = 0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] instance_delete_interval       = 300 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] instance_format                = [instance: %(uuid)s]  {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] instance_name_template         = instance-%08x {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] instance_usage_audit           = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] instance_usage_audit_period    = month {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] internal_service_availability_zone = internal {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] key                            = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] live_migration_retry_count     = 30 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] log_config_append              = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] log_dir                        = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] log_file                       = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] log_options                    = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] log_rotate_interval            = 1 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] log_rotate_interval_type       = days {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] log_rotation_type              = none {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] long_rpc_timeout               = 1800 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] max_concurrent_builds          = 10 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] max_concurrent_live_migrations = 1 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] max_concurrent_snapshots       = 5 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] max_local_block_devices        = 3 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] max_logfile_count              = 30 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] max_logfile_size_mb            = 200 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] maximum_instance_delete_attempts = 5 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] metadata_listen                = 0.0.0.0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] metadata_listen_port           = 8775 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] metadata_workers               = 3 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] migrate_max_retries            = -1 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] mkisofs_cmd                    = genisoimage {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] my_ip                          = 10.0.0.210 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] network_allocate_retries       = 0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] osapi_compute_listen_port      = 8774 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] osapi_compute_unique_server_name_scope =  {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] osapi_compute_workers          = 3 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] password_length                = 12 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] periodic_enable                = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] periodic_fuzzy_delay           = 60 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] pointer_model                  = ps2mouse {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] preallocate_images             = none {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] publish_errors                 = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] pybasedir                      = /opt/stack/nova {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ram_allocation_ratio           = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] rate_limit_burst               = 0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] rate_limit_except_level        = CRITICAL {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] rate_limit_interval            = 0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] reboot_timeout                 = 0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] reclaim_instance_interval      = 0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] record                         = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] reimage_timeout_per_gb         = 60 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] report_interval                = 120 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] rescue_timeout                 = 0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] reserved_host_cpus             = 0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] reserved_host_disk_mb          = 0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] reserved_host_memory_mb        = 512 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] reserved_huge_pages            = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] resize_confirm_window          = 0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] resize_fs_using_block_device   = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] resume_guests_state_on_host_boot = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] rpc_response_timeout           = 60 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] run_external_periodic_tasks    = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] running_deleted_instance_action = reap {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] running_deleted_instance_poll_interval = 1800 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] running_deleted_instance_timeout = 0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] scheduler_instance_sync_interval = 120 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] service_down_time              = 720 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] servicegroup_driver            = db {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] shelved_offload_time           = 0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] shelved_poll_interval          = 3600 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] shutdown_timeout               = 0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] source_is_ipv6                 = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ssl_only                       = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] state_path                     = /opt/stack/data/nova {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] sync_power_state_interval      = 600 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] sync_power_state_pool_size     = 1000 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] syslog_log_facility            = LOG_USER {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] tempdir                        = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] timeout_nbd                    = 10 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] transport_url                  = **** {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] update_resources_interval      = 0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] use_cow_images                 = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] use_eventlog                   = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] use_journal                    = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] use_json                       = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] use_rootwrap_daemon            = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] use_stderr                     = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] use_syslog                     = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vcpu_pin_set                   = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vif_plugging_is_fatal          = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vif_plugging_timeout           = 0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] virt_mkfs                      = [] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] volume_usage_poll_interval     = 0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] watch_log_file                 = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] web                            = /usr/share/spice-html5 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_concurrency.disable_process_locking = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api.auth_strategy              = keystone {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api.compute_link_prefix        = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api.dhcp_domain                = novalocal {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api.enable_instance_password   = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api.glance_link_prefix         = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api.instance_list_per_project_cells = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api.list_records_by_skipping_down_cells = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api.local_metadata_per_cell    = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api.max_limit                  = 1000 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api.metadata_cache_expiration  = 15 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api.neutron_default_tenant_id  = default {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api.use_forwarded_for          = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api.use_neutron_default_nets   = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api.vendordata_dynamic_targets = [] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api.vendordata_jsonfile_path   = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.backend                  = dogpile.cache.memcached {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.backend_argument         = **** {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.config_prefix            = cache.oslo {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.dead_timeout             = 60.0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.debug_cache_backend      = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.enable_retry_client      = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.enable_socket_keepalive  = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.enabled                  = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.expiration_time          = 600 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.hashclient_retry_attempts = 2 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.memcache_dead_retry      = 300 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.memcache_password        =  {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.memcache_pool_maxsize    = 10 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.memcache_sasl_enabled    = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.memcache_username        =  {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.proxies                  = [] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.retry_attempts           = 2 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.retry_delay              = 0.0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.socket_keepalive_count   = 1 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.socket_keepalive_idle    = 1 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.socket_keepalive_interval = 1 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.tls_allowed_ciphers      = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.tls_cafile               = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.tls_certfile             = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.tls_enabled              = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cache.tls_keyfile              = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cinder.auth_section            = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cinder.auth_type               = password {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cinder.cafile                  = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cinder.certfile                = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cinder.collect_timing          = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cinder.cross_az_attach         = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cinder.debug                   = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cinder.endpoint_template       = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cinder.http_retries            = 3 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cinder.insecure                = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cinder.keyfile                 = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cinder.os_region_name          = RegionOne {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cinder.split_loggers           = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cinder.timeout                 = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] compute.cpu_dedicated_set      = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] compute.cpu_shared_set         = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] compute.image_type_exclude_list = [] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] compute.max_concurrent_disk_ops = 0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] compute.max_disk_devices_to_attach = -1 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] compute.resource_provider_association_refresh = 300 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] compute.shutdown_retry_interval = 10 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] conductor.workers              = 3 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] console.allowed_origins        = [] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] console.ssl_ciphers            = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] console.ssl_minimum_version    = default {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] consoleauth.token_ttl          = 600 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cyborg.cafile                  = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cyborg.certfile                = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cyborg.collect_timing          = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cyborg.connect_retries         = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cyborg.connect_retry_delay     = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cyborg.endpoint_override       = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cyborg.insecure                = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cyborg.keyfile                 = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cyborg.max_version             = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cyborg.min_version             = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cyborg.region_name             = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cyborg.service_name            = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cyborg.service_type            = accelerator {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cyborg.split_loggers           = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cyborg.status_code_retries     = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cyborg.status_code_retry_delay = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cyborg.timeout                 = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] cyborg.version                 = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] database.backend               = sqlalchemy {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] database.connection            = **** {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] database.connection_debug      = 0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] database.connection_parameters =  {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] database.connection_recycle_time = 3600 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] database.connection_trace      = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] database.db_inc_retry_interval = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] database.db_max_retries        = 20 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] database.db_max_retry_interval = 10 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] database.db_retry_interval     = 1 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] database.max_overflow          = 50 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] database.max_pool_size         = 5 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] database.max_retries           = 10 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] database.mysql_wsrep_sync_wait = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] database.pool_timeout          = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] database.retry_interval        = 10 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] database.slave_connection      = **** {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] database.sqlite_synchronous    = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api_database.backend           = sqlalchemy {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api_database.connection        = **** {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api_database.connection_debug  = 0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api_database.connection_parameters =  {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api_database.connection_recycle_time = 3600 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api_database.connection_trace  = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api_database.db_inc_retry_interval = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api_database.db_max_retries    = 20 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api_database.db_max_retry_interval = 10 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api_database.db_retry_interval = 1 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api_database.max_overflow      = 50 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api_database.max_pool_size     = 5 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api_database.max_retries       = 10 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api_database.pool_timeout      = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api_database.retry_interval    = 10 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api_database.slave_connection  = **** {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] api_database.sqlite_synchronous = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] devices.enabled_mdev_types     = [] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ephemeral_storage_encryption.enabled = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.api_servers             = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.cafile                  = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.certfile                = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.collect_timing          = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.connect_retries         = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.connect_retry_delay     = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.debug                   = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.default_trusted_certificate_ids = [] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.enable_certificate_validation = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.enable_rbd_download     = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.endpoint_override       = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.insecure                = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.keyfile                 = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.max_version             = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.min_version             = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.num_retries             = 3 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.rbd_ceph_conf           =  {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.rbd_connect_timeout     = 5 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.rbd_pool                =  {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.rbd_user                =  {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.region_name             = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.service_name            = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.service_type            = image {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.split_loggers           = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.status_code_retries     = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.status_code_retry_delay = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.timeout                 = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.verify_glance_signatures = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] glance.version                 = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] guestfs.debug                  = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] hyperv.config_drive_cdrom      = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] hyperv.config_drive_inject_password = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] hyperv.enable_instance_metrics_collection = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] hyperv.enable_remotefx         = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] hyperv.instances_path_share    =  {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] hyperv.iscsi_initiator_list    = [] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] hyperv.limit_cpu_features      = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] hyperv.power_state_check_timeframe = 60 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] hyperv.use_multipath_io        = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] hyperv.volume_attach_retry_count = 10 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] hyperv.vswitch_name            = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] mks.enabled                    = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] image_cache.manager_interval   = 2400 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] image_cache.precache_concurrency = 1 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] image_cache.remove_unused_base_images = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] image_cache.subdirectory_name  = _base {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ironic.api_max_retries         = 60 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ironic.api_retry_interval      = 2 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ironic.auth_section            = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ironic.auth_type               = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ironic.cafile                  = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ironic.certfile                = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ironic.collect_timing          = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ironic.conductor_group         = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ironic.connect_retries         = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ironic.connect_retry_delay     = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ironic.endpoint_override       = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ironic.insecure                = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ironic.keyfile                 = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ironic.max_version             = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ironic.min_version             = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ironic.peer_list               = [] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ironic.region_name             = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ironic.serial_console_state_timeout = 10 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ironic.service_name            = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ironic.service_type            = baremetal {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ironic.split_loggers           = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ironic.status_code_retries     = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ironic.status_code_retry_delay = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ironic.timeout                 = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ironic.version                 = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] key_manager.fixed_key          = **** {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] barbican.barbican_api_version  = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] barbican.barbican_endpoint     = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] barbican.barbican_endpoint_type = public {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] barbican.barbican_region_name  = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] barbican.cafile                = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] barbican.certfile              = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] barbican.collect_timing        = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] barbican.insecure              = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] barbican.keyfile               = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] barbican.number_of_retries     = 60 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] barbican.retry_delay           = 1 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] barbican.send_service_user_token = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] barbican.split_loggers         = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] barbican.timeout               = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] barbican.verify_ssl            = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] barbican.verify_ssl_path       = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] barbican_service_user.auth_section = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] barbican_service_user.auth_type = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] barbican_service_user.cafile   = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] barbican_service_user.certfile = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] barbican_service_user.collect_timing = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] barbican_service_user.insecure = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] barbican_service_user.keyfile  = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] barbican_service_user.split_loggers = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] barbican_service_user.timeout  = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vault.approle_role_id          = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vault.approle_secret_id        = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vault.cafile                   = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vault.certfile                 = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vault.collect_timing           = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vault.insecure                 = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vault.keyfile                  = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vault.kv_mountpoint            = secret {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vault.kv_path                  = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vault.kv_version               = 2 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vault.namespace                = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vault.root_token_id            = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vault.split_loggers            = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vault.ssl_ca_crt_file          = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vault.timeout                  = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vault.use_ssl                  = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] keystone.auth_section          = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] keystone.auth_type             = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] keystone.cafile                = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] keystone.certfile              = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] keystone.collect_timing        = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] keystone.connect_retries       = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] keystone.connect_retry_delay   = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] keystone.endpoint_override     = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] keystone.insecure              = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] keystone.keyfile               = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] keystone.max_version           = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] keystone.min_version           = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] keystone.region_name           = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] keystone.service_name          = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] keystone.service_type          = identity {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] keystone.split_loggers         = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] keystone.status_code_retries   = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] keystone.status_code_retry_delay = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] keystone.timeout               = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] keystone.version               = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.connection_uri         =  {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.cpu_mode               = custom {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: WARNING oslo_config.cfg [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.cpu_power_governor_high = performance {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.cpu_power_governor_low = powersave {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.cpu_power_management   = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.device_detach_attempts = 8 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.device_detach_timeout  = 20 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.disk_cachemodes        = [] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.disk_prefix            = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.enabled_perf_events    = [] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.file_backed_memory     = 0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.gid_maps               = [] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.hw_disk_discard        = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.hw_machine_type        = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.images_rbd_glance_store_name =  {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.images_rbd_pool        = rbd {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.images_type            = default {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.images_volume_group    = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.inject_key             = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.inject_partition       = -2 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.inject_password        = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.iscsi_iface            = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.iser_use_multipath     = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.live_migration_bandwidth = 0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.live_migration_downtime = 500 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.live_migration_inbound_addr = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.live_migration_permit_post_copy = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.live_migration_scheme  = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.live_migration_timeout_action = abort {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.live_migration_tunnelled = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: WARNING oslo_config.cfg [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 02 01:25:01 user nova-compute[74996]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 02 01:25:01 user nova-compute[74996]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 02 01:25:01 user nova-compute[74996]: and ``live_migration_inbound_addr`` respectively.
Nov 02 01:25:01 user nova-compute[74996]: ).  Its value may be silently ignored in the future.
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.live_migration_with_native_tls = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.max_queues             = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.nfs_mount_options      = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.num_memory_encrypted_guests = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.num_pcie_ports         = 0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.pmem_namespaces        = [] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.quobyte_client_cfg     = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.rbd_secret_uuid        = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.rbd_user               = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.remote_filesystem_transport = ssh {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.rescue_image_id        = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.rescue_kernel_id       = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.rescue_ramdisk_id      = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.rx_queue_size          = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.smbfs_mount_options    =  {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.snapshot_compression   = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.snapshot_image_format  = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.sparse_logical_volumes = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.swtpm_enabled          = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.swtpm_group            = tss {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.swtpm_user             = tss {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.sysinfo_serial         = unique {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.tb_cache_size          = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.tx_queue_size          = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.uid_maps               = [] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.use_virtio_for_bridges = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.virt_type              = kvm {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.volume_clear           = zero {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.volume_clear_size      = 0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.volume_use_multipath   = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.vzstorage_cache_path   = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.vzstorage_mount_user   = stack {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] neutron.auth_section           = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] neutron.auth_type              = password {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] neutron.cafile                 = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] neutron.certfile               = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] neutron.collect_timing         = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] neutron.connect_retries        = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] neutron.connect_retry_delay    = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] neutron.default_floating_pool  = public {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] neutron.endpoint_override      = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] neutron.extension_sync_interval = 600 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] neutron.http_retries           = 3 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] neutron.insecure               = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] neutron.keyfile                = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] neutron.max_version            = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] neutron.min_version            = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] neutron.ovs_bridge             = br-int {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] neutron.physnets               = [] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] neutron.region_name            = RegionOne {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] neutron.service_metadata_proxy = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] neutron.service_name           = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] neutron.service_type           = network {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] neutron.split_loggers          = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] neutron.status_code_retries    = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] neutron.status_code_retry_delay = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] neutron.timeout                = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] neutron.version                = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] notifications.bdms_in_notifications = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] notifications.default_level    = INFO {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] notifications.notification_format = unversioned {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] notifications.notify_on_state_change = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] pci.alias                      = [] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] pci.device_spec                = [] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] pci.report_in_placement        = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.auth_section         = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.auth_type            = password {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.cafile               = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.certfile             = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.collect_timing       = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.connect_retries      = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.connect_retry_delay  = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.default_domain_id    = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.default_domain_name  = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.domain_id            = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.domain_name          = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.endpoint_override    = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.insecure             = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.keyfile              = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.max_version          = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.min_version          = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.password             = **** {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.project_domain_id    = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.project_domain_name  = Default {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.project_id           = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.project_name         = service {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.region_name          = RegionOne {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.service_name         = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.service_type         = placement {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.split_loggers        = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.status_code_retries  = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.status_code_retry_delay = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.system_scope         = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.timeout              = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.trust_id             = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.user_domain_id       = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.user_domain_name     = Default {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.user_id              = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.username             = placement {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] placement.version              = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] quota.cores                    = 20 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] quota.count_usage_from_placement = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] quota.injected_file_content_bytes = 10240 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] quota.injected_file_path_length = 255 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] quota.injected_files           = 5 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] quota.instances                = 10 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] quota.key_pairs                = 100 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] quota.metadata_items           = 128 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] quota.ram                      = 51200 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] quota.recheck_quota            = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] quota.server_group_members     = 10 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] quota.server_groups            = 10 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] rdp.enabled                    = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] scheduler.image_metadata_prefilter = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] scheduler.max_attempts         = 3 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] scheduler.max_placement_results = 1000 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] scheduler.query_placement_for_image_type_support = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] scheduler.workers              = 3 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] filter_scheduler.host_subset_size = 1 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] filter_scheduler.isolated_hosts = [] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] filter_scheduler.isolated_images = [] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] filter_scheduler.pci_in_placement = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] filter_scheduler.track_instance_changes = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] metrics.required               = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] metrics.weight_multiplier      = 1.0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] metrics.weight_setting         = [] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] serial_console.enabled         = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] serial_console.port_range      = 10000:20000 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] serial_console.serialproxy_port = 6083 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] service_user.auth_section      = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] service_user.auth_type         = password {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] service_user.cafile            = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] service_user.certfile          = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] service_user.collect_timing    = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] service_user.insecure          = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] service_user.keyfile           = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] service_user.send_service_user_token = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] service_user.split_loggers     = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] service_user.timeout           = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] spice.agent_enabled            = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] spice.enabled                  = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] spice.html5proxy_port          = 6082 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] spice.image_compression        = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] spice.jpeg_compression         = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] spice.playback_compression     = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] spice.server_listen            = 127.0.0.1 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] spice.streaming_mode           = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] spice.zlib_compression         = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] upgrade_levels.baseapi         = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] upgrade_levels.cert            = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] upgrade_levels.compute         = auto {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] upgrade_levels.conductor       = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] upgrade_levels.scheduler       = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vendordata_dynamic_auth.auth_section = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vendordata_dynamic_auth.auth_type = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vendordata_dynamic_auth.cafile = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vendordata_dynamic_auth.certfile = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vendordata_dynamic_auth.insecure = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vendordata_dynamic_auth.keyfile = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vendordata_dynamic_auth.timeout = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vmware.api_retry_count         = 10 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vmware.ca_file                 = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vmware.cache_prefix            = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vmware.cluster_name            = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vmware.connection_pool_size    = 10 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vmware.console_delay_seconds   = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vmware.datastore_regex         = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vmware.host_ip                 = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vmware.host_password           = **** {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vmware.host_port               = 443 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vmware.host_username           = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vmware.insecure                = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vmware.integration_bridge      = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vmware.maximum_objects         = 100 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vmware.pbm_default_policy      = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vmware.pbm_enabled             = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vmware.pbm_wsdl_location       = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vmware.serial_port_proxy_uri   = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vmware.serial_port_service_uri = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vmware.task_poll_interval      = 0.5 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vmware.use_linked_clone        = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vmware.vnc_keymap              = en-us {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vmware.vnc_port                = 5900 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vmware.vnc_port_total          = 10000 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vnc.auth_schemes               = ['none'] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vnc.enabled                    = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vnc.novncproxy_port            = 6080 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vnc.server_listen              = 0.0.0.0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vnc.vencrypt_ca_certs          = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vnc.vencrypt_client_cert       = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vnc.vencrypt_client_key        = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] workarounds.disable_rootwrap   = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] workarounds.enable_numa_live_migration = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] workarounds.libvirt_disable_apic = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] wsgi.client_socket_timeout     = 900 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] wsgi.default_pool_size         = 1000 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] wsgi.keep_alive                = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] wsgi.max_header_line           = 16384 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] wsgi.ssl_ca_file               = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] wsgi.ssl_cert_file             = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] wsgi.ssl_key_file              = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] wsgi.tcp_keepidle              = 600 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] zvm.ca_file                    = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] zvm.cloud_connector_url        = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] zvm.reachable_timeout          = 300 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_policy.enforce_new_defaults = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_policy.enforce_scope      = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_policy.policy_default_rule = default {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_policy.policy_file        = policy.yaml {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] profiler.connection_string     = messaging:// {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] profiler.enabled               = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] profiler.es_doc_type           = notification {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] profiler.es_scroll_size        = 10000 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] profiler.es_scroll_time        = 2m {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] profiler.filter_error_trace    = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] profiler.hmac_keys             = **** {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] profiler.sentinel_service_name = mymaster {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] profiler.socket_timeout        = 0.1 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] profiler.trace_requests        = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] profiler.trace_sqlalchemy      = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] profiler_jaeger.process_tags   = {} {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] profiler_jaeger.service_name_prefix = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] profiler_otlp.service_name_prefix = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] remote_debug.host              = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] remote_debug.port              = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.ssl      = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_notifications.retry = -1 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_messaging_notifications.transport_url = **** {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_limit.auth_section        = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_limit.auth_type           = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_limit.cafile              = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_limit.certfile            = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_limit.collect_timing      = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_limit.connect_retries     = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_limit.connect_retry_delay = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_limit.endpoint_id         = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_limit.endpoint_override   = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_limit.insecure            = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_limit.keyfile             = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_limit.max_version         = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_limit.min_version         = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_limit.region_name         = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_limit.service_name        = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_limit.service_type        = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_limit.split_loggers       = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_limit.status_code_retries = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_limit.status_code_retry_delay = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_limit.timeout             = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_limit.valid_interfaces    = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_limit.version             = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_reports.file_event_handler = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] oslo_reports.log_dir           = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vif_plug_ovs_privileged.group  = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] vif_plug_ovs_privileged.user   = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] os_vif_linux_bridge.flat_interface = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] os_vif_ovs.isolate_vif         = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] os_vif_ovs.per_port_bridge     = False {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] os_brick.lock_path             = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] privsep_osbrick.capabilities   = [21] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] privsep_osbrick.group          = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] privsep_osbrick.helper_command = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] privsep_osbrick.user           = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] nova_sys_admin.group           = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] nova_sys_admin.helper_command  = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] nova_sys_admin.user            = None {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG oslo_service.service [None req-8cc4fe61-0f30-4097-afe0-a04b9e4134ec None None] ******************************************************************************** {{(pid=74996) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 02 01:25:01 user nova-compute[74996]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 02 01:25:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Connecting to libvirt: qemu:///system {{(pid=74996) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f8315483070> {{(pid=74996) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 02 01:25:01 user nova-compute[74996]: libvirt:  error : internal error: could not initialize domain event timer
Nov 02 01:25:01 user nova-compute[74996]: WARNING nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 02 01:25:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f8315483070> {{(pid=74996) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Starting native event thread {{(pid=74996) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Starting green dispatch thread {{(pid=74996) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 02 01:25:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Starting connection event dispatch thread {{(pid=74996) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 02 01:25:01 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Connection event '1' reason 'None'
Nov 02 01:25:01 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 02 01:25:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.mount [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Initialising _HostMountState generation 0 {{(pid=74996) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 02 01:25:09 user nova-compute[74996]: INFO nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Libvirt host capabilities <capabilities>
Nov 02 01:25:09 user nova-compute[74996]:   <host>
Nov 02 01:25:09 user nova-compute[74996]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 02 01:25:09 user nova-compute[74996]:     <cpu>
Nov 02 01:25:09 user nova-compute[74996]:       <arch>x86_64</arch>
Nov 02 01:25:09 user nova-compute[74996]:       <model>IvyBridge-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <vendor>Intel</vendor>
Nov 02 01:25:09 user nova-compute[74996]:       <microcode version='1070'/>
Nov 02 01:25:09 user nova-compute[74996]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 02 01:25:09 user nova-compute[74996]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature name='ss'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature name='vmx'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature name='pcid'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature name='osxsave'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature name='hypervisor'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature name='arat'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature name='tsc_adjust'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature name='md-clear'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature name='stibp'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature name='arch-capabilities'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature name='ssbd'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature name='invtsc'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature name='rsba'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature name='skip-l1dfl-vmentry'/>
Nov 02 01:25:09 user nova-compute[74996]:       <pages unit='KiB' size='4'/>
Nov 02 01:25:09 user nova-compute[74996]:       <pages unit='KiB' size='2048'/>
Nov 02 01:25:09 user nova-compute[74996]:     </cpu>
Nov 02 01:25:09 user nova-compute[74996]:     <power_management>
Nov 02 01:25:09 user nova-compute[74996]:       <suspend_mem/>
Nov 02 01:25:09 user nova-compute[74996]:       <suspend_disk/>
Nov 02 01:25:09 user nova-compute[74996]:       <suspend_hybrid/>
Nov 02 01:25:09 user nova-compute[74996]:     </power_management>
Nov 02 01:25:09 user nova-compute[74996]:     <iommu support='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     <migration_features>
Nov 02 01:25:09 user nova-compute[74996]:       <live/>
Nov 02 01:25:09 user nova-compute[74996]:       <uri_transports>
Nov 02 01:25:09 user nova-compute[74996]:         <uri_transport>tcp</uri_transport>
Nov 02 01:25:09 user nova-compute[74996]:         <uri_transport>rdma</uri_transport>
Nov 02 01:25:09 user nova-compute[74996]:       </uri_transports>
Nov 02 01:25:09 user nova-compute[74996]:     </migration_features>
Nov 02 01:25:09 user nova-compute[74996]:     <topology>
Nov 02 01:25:09 user nova-compute[74996]:       <cells num='2'>
Nov 02 01:25:09 user nova-compute[74996]:         <cell id='0'>
Nov 02 01:25:09 user nova-compute[74996]:           <memory unit='KiB'>8140616</memory>
Nov 02 01:25:09 user nova-compute[74996]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 02 01:25:09 user nova-compute[74996]:           <pages unit='KiB' size='2048'>0</pages>
Nov 02 01:25:09 user nova-compute[74996]:           <distances>
Nov 02 01:25:09 user nova-compute[74996]:             <sibling id='0' value='10'/>
Nov 02 01:25:09 user nova-compute[74996]:             <sibling id='1' value='20'/>
Nov 02 01:25:09 user nova-compute[74996]:           </distances>
Nov 02 01:25:09 user nova-compute[74996]:           <cpus num='6'>
Nov 02 01:25:09 user nova-compute[74996]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 02 01:25:09 user nova-compute[74996]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 02 01:25:09 user nova-compute[74996]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 02 01:25:09 user nova-compute[74996]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 02 01:25:09 user nova-compute[74996]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 02 01:25:09 user nova-compute[74996]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 02 01:25:09 user nova-compute[74996]:           </cpus>
Nov 02 01:25:09 user nova-compute[74996]:         </cell>
Nov 02 01:25:09 user nova-compute[74996]:         <cell id='1'>
Nov 02 01:25:09 user nova-compute[74996]:           <memory unit='KiB'>8255100</memory>
Nov 02 01:25:09 user nova-compute[74996]:           <pages unit='KiB' size='4'>2063775</pages>
Nov 02 01:25:09 user nova-compute[74996]:           <pages unit='KiB' size='2048'>0</pages>
Nov 02 01:25:09 user nova-compute[74996]:           <distances>
Nov 02 01:25:09 user nova-compute[74996]:             <sibling id='0' value='20'/>
Nov 02 01:25:09 user nova-compute[74996]:             <sibling id='1' value='10'/>
Nov 02 01:25:09 user nova-compute[74996]:           </distances>
Nov 02 01:25:09 user nova-compute[74996]:           <cpus num='6'>
Nov 02 01:25:09 user nova-compute[74996]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 02 01:25:09 user nova-compute[74996]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 02 01:25:09 user nova-compute[74996]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 02 01:25:09 user nova-compute[74996]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 02 01:25:09 user nova-compute[74996]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 02 01:25:09 user nova-compute[74996]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 02 01:25:09 user nova-compute[74996]:           </cpus>
Nov 02 01:25:09 user nova-compute[74996]:         </cell>
Nov 02 01:25:09 user nova-compute[74996]:       </cells>
Nov 02 01:25:09 user nova-compute[74996]:     </topology>
Nov 02 01:25:09 user nova-compute[74996]:     <cache>
Nov 02 01:25:09 user nova-compute[74996]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 02 01:25:09 user nova-compute[74996]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 02 01:25:09 user nova-compute[74996]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 02 01:25:09 user nova-compute[74996]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 02 01:25:09 user nova-compute[74996]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 02 01:25:09 user nova-compute[74996]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 02 01:25:09 user nova-compute[74996]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 02 01:25:09 user nova-compute[74996]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 02 01:25:09 user nova-compute[74996]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 02 01:25:09 user nova-compute[74996]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 02 01:25:09 user nova-compute[74996]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 02 01:25:09 user nova-compute[74996]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 02 01:25:09 user nova-compute[74996]:     </cache>
Nov 02 01:25:09 user nova-compute[74996]:     <secmodel>
Nov 02 01:25:09 user nova-compute[74996]:       <model>apparmor</model>
Nov 02 01:25:09 user nova-compute[74996]:       <doi>0</doi>
Nov 02 01:25:09 user nova-compute[74996]:     </secmodel>
Nov 02 01:25:09 user nova-compute[74996]:     <secmodel>
Nov 02 01:25:09 user nova-compute[74996]:       <model>dac</model>
Nov 02 01:25:09 user nova-compute[74996]:       <doi>0</doi>
Nov 02 01:25:09 user nova-compute[74996]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 02 01:25:09 user nova-compute[74996]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 02 01:25:09 user nova-compute[74996]:     </secmodel>
Nov 02 01:25:09 user nova-compute[74996]:   </host>
Nov 02 01:25:09 user nova-compute[74996]:   <guest>
Nov 02 01:25:09 user nova-compute[74996]:     <os_type>hvm</os_type>
Nov 02 01:25:09 user nova-compute[74996]:     <arch name='alpha'>
Nov 02 01:25:09 user nova-compute[74996]:       <wordsize>64</wordsize>
Nov 02 01:25:09 user nova-compute[74996]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>clipper</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <domain type='qemu'/>
Nov 02 01:25:09 user nova-compute[74996]:     </arch>
Nov 02 01:25:09 user nova-compute[74996]:     <features>
Nov 02 01:25:09 user nova-compute[74996]:       <cpuselection/>
Nov 02 01:25:09 user nova-compute[74996]:       <deviceboot/>
Nov 02 01:25:09 user nova-compute[74996]:       <disksnapshot default='on' toggle='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     </features>
Nov 02 01:25:09 user nova-compute[74996]:   </guest>
Nov 02 01:25:09 user nova-compute[74996]:   <guest>
Nov 02 01:25:09 user nova-compute[74996]:     <os_type>hvm</os_type>
Nov 02 01:25:09 user nova-compute[74996]:     <arch name='armv6l'>
Nov 02 01:25:09 user nova-compute[74996]:       <wordsize>32</wordsize>
Nov 02 01:25:09 user nova-compute[74996]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>integratorcp</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>borzoi</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>spitz</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>nuri</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>musca-b1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>versatileab</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>kzm</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>musca-a</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>smdkc210</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>sx1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>z2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>tosa</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>sabrelite</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>realview-eb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>n810</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>n800</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>versatilepb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>terrier</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mainstone</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>midway</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>musicpal</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>microbit</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>cubieboard</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>verdex</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>netduino2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>raspi2b</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>cheetah</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>highbank</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>akita</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>connex</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>collie</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>raspi0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <domain type='qemu'/>
Nov 02 01:25:09 user nova-compute[74996]:     </arch>
Nov 02 01:25:09 user nova-compute[74996]:     <features>
Nov 02 01:25:09 user nova-compute[74996]:       <cpuselection/>
Nov 02 01:25:09 user nova-compute[74996]:       <deviceboot/>
Nov 02 01:25:09 user nova-compute[74996]:       <disksnapshot default='on' toggle='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     </features>
Nov 02 01:25:09 user nova-compute[74996]:   </guest>
Nov 02 01:25:09 user nova-compute[74996]:   <guest>
Nov 02 01:25:09 user nova-compute[74996]:     <os_type>hvm</os_type>
Nov 02 01:25:09 user nova-compute[74996]:     <arch name='armv7l'>
Nov 02 01:25:09 user nova-compute[74996]:       <wordsize>32</wordsize>
Nov 02 01:25:09 user nova-compute[74996]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>integratorcp</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>borzoi</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>spitz</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>nuri</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>musca-b1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>versatileab</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>kzm</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>musca-a</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>smdkc210</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>sx1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>z2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>tosa</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>sabrelite</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>realview-eb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>n810</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>n800</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>versatilepb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>terrier</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mainstone</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>midway</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>musicpal</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>microbit</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>cubieboard</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>verdex</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>netduino2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>raspi2b</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>cheetah</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>highbank</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>akita</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>connex</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>collie</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>raspi0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <domain type='qemu'/>
Nov 02 01:25:09 user nova-compute[74996]:     </arch>
Nov 02 01:25:09 user nova-compute[74996]:     <features>
Nov 02 01:25:09 user nova-compute[74996]:       <cpuselection/>
Nov 02 01:25:09 user nova-compute[74996]:       <deviceboot/>
Nov 02 01:25:09 user nova-compute[74996]:       <disksnapshot default='on' toggle='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     </features>
Nov 02 01:25:09 user nova-compute[74996]:   </guest>
Nov 02 01:25:09 user nova-compute[74996]:   <guest>
Nov 02 01:25:09 user nova-compute[74996]:     <os_type>hvm</os_type>
Nov 02 01:25:09 user nova-compute[74996]:     <arch name='aarch64'>
Nov 02 01:25:09 user nova-compute[74996]:       <wordsize>64</wordsize>
Nov 02 01:25:09 user nova-compute[74996]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>integratorcp</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>borzoi</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>spitz</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>nuri</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>musca-b1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>versatileab</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>kzm</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>musca-a</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>smdkc210</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>sx1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>z2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>tosa</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>sabrelite</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>realview-eb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>n810</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>n800</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>versatilepb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>terrier</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mainstone</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>midway</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>musicpal</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>microbit</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>cubieboard</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>verdex</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>netduino2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>raspi3b</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>raspi2b</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>cheetah</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>highbank</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>akita</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>connex</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>collie</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>raspi0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <domain type='qemu'/>
Nov 02 01:25:09 user nova-compute[74996]:     </arch>
Nov 02 01:25:09 user nova-compute[74996]:     <features>
Nov 02 01:25:09 user nova-compute[74996]:       <acpi default='on' toggle='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:       <cpuselection/>
Nov 02 01:25:09 user nova-compute[74996]:       <deviceboot/>
Nov 02 01:25:09 user nova-compute[74996]:       <disksnapshot default='on' toggle='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     </features>
Nov 02 01:25:09 user nova-compute[74996]:   </guest>
Nov 02 01:25:09 user nova-compute[74996]:   <guest>
Nov 02 01:25:09 user nova-compute[74996]:     <os_type>hvm</os_type>
Nov 02 01:25:09 user nova-compute[74996]:     <arch name='cris'>
Nov 02 01:25:09 user nova-compute[74996]:       <wordsize>32</wordsize>
Nov 02 01:25:09 user nova-compute[74996]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <domain type='qemu'/>
Nov 02 01:25:09 user nova-compute[74996]:     </arch>
Nov 02 01:25:09 user nova-compute[74996]:     <features>
Nov 02 01:25:09 user nova-compute[74996]:       <cpuselection/>
Nov 02 01:25:09 user nova-compute[74996]:       <deviceboot/>
Nov 02 01:25:09 user nova-compute[74996]:       <disksnapshot default='on' toggle='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     </features>
Nov 02 01:25:09 user nova-compute[74996]:   </guest>
Nov 02 01:25:09 user nova-compute[74996]:   <guest>
Nov 02 01:25:09 user nova-compute[74996]:     <os_type>hvm</os_type>
Nov 02 01:25:09 user nova-compute[74996]:     <arch name='i686'>
Nov 02 01:25:09 user nova-compute[74996]:       <wordsize>32</wordsize>
Nov 02 01:25:09 user nova-compute[74996]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>x-remote</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>isapc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>microvm</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <domain type='qemu'/>
Nov 02 01:25:09 user nova-compute[74996]:       <domain type='kvm'/>
Nov 02 01:25:09 user nova-compute[74996]:     </arch>
Nov 02 01:25:09 user nova-compute[74996]:     <features>
Nov 02 01:25:09 user nova-compute[74996]:       <pae/>
Nov 02 01:25:09 user nova-compute[74996]:       <nonpae/>
Nov 02 01:25:09 user nova-compute[74996]:       <acpi default='on' toggle='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:       <apic default='on' toggle='no'/>
Nov 02 01:25:09 user nova-compute[74996]:       <cpuselection/>
Nov 02 01:25:09 user nova-compute[74996]:       <deviceboot/>
Nov 02 01:25:09 user nova-compute[74996]:       <disksnapshot default='on' toggle='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     </features>
Nov 02 01:25:09 user nova-compute[74996]:   </guest>
Nov 02 01:25:09 user nova-compute[74996]:   <guest>
Nov 02 01:25:09 user nova-compute[74996]:     <os_type>hvm</os_type>
Nov 02 01:25:09 user nova-compute[74996]:     <arch name='m68k'>
Nov 02 01:25:09 user nova-compute[74996]:       <wordsize>32</wordsize>
Nov 02 01:25:09 user nova-compute[74996]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>an5206</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>q800</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>next-cube</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <domain type='qemu'/>
Nov 02 01:25:09 user nova-compute[74996]:     </arch>
Nov 02 01:25:09 user nova-compute[74996]:     <features>
Nov 02 01:25:09 user nova-compute[74996]:       <cpuselection/>
Nov 02 01:25:09 user nova-compute[74996]:       <deviceboot/>
Nov 02 01:25:09 user nova-compute[74996]:       <disksnapshot default='on' toggle='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     </features>
Nov 02 01:25:09 user nova-compute[74996]:   </guest>
Nov 02 01:25:09 user nova-compute[74996]:   <guest>
Nov 02 01:25:09 user nova-compute[74996]:     <os_type>hvm</os_type>
Nov 02 01:25:09 user nova-compute[74996]:     <arch name='microblaze'>
Nov 02 01:25:09 user nova-compute[74996]:       <wordsize>32</wordsize>
Nov 02 01:25:09 user nova-compute[74996]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <domain type='qemu'/>
Nov 02 01:25:09 user nova-compute[74996]:     </arch>
Nov 02 01:25:09 user nova-compute[74996]:     <features>
Nov 02 01:25:09 user nova-compute[74996]:       <cpuselection/>
Nov 02 01:25:09 user nova-compute[74996]:       <deviceboot/>
Nov 02 01:25:09 user nova-compute[74996]:       <disksnapshot default='on' toggle='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     </features>
Nov 02 01:25:09 user nova-compute[74996]:   </guest>
Nov 02 01:25:09 user nova-compute[74996]:   <guest>
Nov 02 01:25:09 user nova-compute[74996]:     <os_type>hvm</os_type>
Nov 02 01:25:09 user nova-compute[74996]:     <arch name='microblazeel'>
Nov 02 01:25:09 user nova-compute[74996]:       <wordsize>32</wordsize>
Nov 02 01:25:09 user nova-compute[74996]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <domain type='qemu'/>
Nov 02 01:25:09 user nova-compute[74996]:     </arch>
Nov 02 01:25:09 user nova-compute[74996]:     <features>
Nov 02 01:25:09 user nova-compute[74996]:       <cpuselection/>
Nov 02 01:25:09 user nova-compute[74996]:       <deviceboot/>
Nov 02 01:25:09 user nova-compute[74996]:       <disksnapshot default='on' toggle='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     </features>
Nov 02 01:25:09 user nova-compute[74996]:   </guest>
Nov 02 01:25:09 user nova-compute[74996]:   <guest>
Nov 02 01:25:09 user nova-compute[74996]:     <os_type>hvm</os_type>
Nov 02 01:25:09 user nova-compute[74996]:     <arch name='mips'>
Nov 02 01:25:09 user nova-compute[74996]:       <wordsize>32</wordsize>
Nov 02 01:25:09 user nova-compute[74996]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='16'>malta</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mipssim</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <domain type='qemu'/>
Nov 02 01:25:09 user nova-compute[74996]:     </arch>
Nov 02 01:25:09 user nova-compute[74996]:     <features>
Nov 02 01:25:09 user nova-compute[74996]:       <cpuselection/>
Nov 02 01:25:09 user nova-compute[74996]:       <deviceboot/>
Nov 02 01:25:09 user nova-compute[74996]:       <disksnapshot default='on' toggle='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     </features>
Nov 02 01:25:09 user nova-compute[74996]:   </guest>
Nov 02 01:25:09 user nova-compute[74996]:   <guest>
Nov 02 01:25:09 user nova-compute[74996]:     <os_type>hvm</os_type>
Nov 02 01:25:09 user nova-compute[74996]:     <arch name='mipsel'>
Nov 02 01:25:09 user nova-compute[74996]:       <wordsize>32</wordsize>
Nov 02 01:25:09 user nova-compute[74996]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='16'>malta</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mipssim</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <domain type='qemu'/>
Nov 02 01:25:09 user nova-compute[74996]:     </arch>
Nov 02 01:25:09 user nova-compute[74996]:     <features>
Nov 02 01:25:09 user nova-compute[74996]:       <cpuselection/>
Nov 02 01:25:09 user nova-compute[74996]:       <deviceboot/>
Nov 02 01:25:09 user nova-compute[74996]:       <disksnapshot default='on' toggle='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     </features>
Nov 02 01:25:09 user nova-compute[74996]:   </guest>
Nov 02 01:25:09 user nova-compute[74996]:   <guest>
Nov 02 01:25:09 user nova-compute[74996]:     <os_type>hvm</os_type>
Nov 02 01:25:09 user nova-compute[74996]:     <arch name='mips64'>
Nov 02 01:25:09 user nova-compute[74996]:       <wordsize>64</wordsize>
Nov 02 01:25:09 user nova-compute[74996]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='16'>malta</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mipssim</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>pica61</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>magnum</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <domain type='qemu'/>
Nov 02 01:25:09 user nova-compute[74996]:     </arch>
Nov 02 01:25:09 user nova-compute[74996]:     <features>
Nov 02 01:25:09 user nova-compute[74996]:       <cpuselection/>
Nov 02 01:25:09 user nova-compute[74996]:       <deviceboot/>
Nov 02 01:25:09 user nova-compute[74996]:       <disksnapshot default='on' toggle='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     </features>
Nov 02 01:25:09 user nova-compute[74996]:   </guest>
Nov 02 01:25:09 user nova-compute[74996]:   <guest>
Nov 02 01:25:09 user nova-compute[74996]:     <os_type>hvm</os_type>
Nov 02 01:25:09 user nova-compute[74996]:     <arch name='mips64el'>
Nov 02 01:25:09 user nova-compute[74996]:       <wordsize>64</wordsize>
Nov 02 01:25:09 user nova-compute[74996]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='16'>malta</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mipssim</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>pica61</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>magnum</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='16'>boston</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <domain type='qemu'/>
Nov 02 01:25:09 user nova-compute[74996]:     </arch>
Nov 02 01:25:09 user nova-compute[74996]:     <features>
Nov 02 01:25:09 user nova-compute[74996]:       <cpuselection/>
Nov 02 01:25:09 user nova-compute[74996]:       <deviceboot/>
Nov 02 01:25:09 user nova-compute[74996]:       <disksnapshot default='on' toggle='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     </features>
Nov 02 01:25:09 user nova-compute[74996]:   </guest>
Nov 02 01:25:09 user nova-compute[74996]:   <guest>
Nov 02 01:25:09 user nova-compute[74996]:     <os_type>hvm</os_type>
Nov 02 01:25:09 user nova-compute[74996]:     <arch name='ppc'>
Nov 02 01:25:09 user nova-compute[74996]:       <wordsize>32</wordsize>
Nov 02 01:25:09 user nova-compute[74996]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>g3beige</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mac99</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='32'>ppce500</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>pegasos2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>sam460ex</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>bamboo</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>40p</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>ref405ep</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>taihu</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <domain type='qemu'/>
Nov 02 01:25:09 user nova-compute[74996]:     </arch>
Nov 02 01:25:09 user nova-compute[74996]:     <features>
Nov 02 01:25:09 user nova-compute[74996]:       <cpuselection/>
Nov 02 01:25:09 user nova-compute[74996]:       <deviceboot/>
Nov 02 01:25:09 user nova-compute[74996]:       <disksnapshot default='on' toggle='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     </features>
Nov 02 01:25:09 user nova-compute[74996]:   </guest>
Nov 02 01:25:09 user nova-compute[74996]:   <guest>
Nov 02 01:25:09 user nova-compute[74996]:     <os_type>hvm</os_type>
Nov 02 01:25:09 user nova-compute[74996]:     <arch name='ppc64'>
Nov 02 01:25:09 user nova-compute[74996]:       <wordsize>64</wordsize>
Nov 02 01:25:09 user nova-compute[74996]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2048'>powernv9</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>taihu</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2048'>powernv10</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='32'>ppce500</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>40p</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>pegasos2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>bamboo</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>g3beige</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mac99</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>sam460ex</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>ref405ep</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2048'>powernv8</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <domain type='qemu'/>
Nov 02 01:25:09 user nova-compute[74996]:     </arch>
Nov 02 01:25:09 user nova-compute[74996]:     <features>
Nov 02 01:25:09 user nova-compute[74996]:       <cpuselection/>
Nov 02 01:25:09 user nova-compute[74996]:       <deviceboot/>
Nov 02 01:25:09 user nova-compute[74996]:       <disksnapshot default='on' toggle='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     </features>
Nov 02 01:25:09 user nova-compute[74996]:   </guest>
Nov 02 01:25:09 user nova-compute[74996]:   <guest>
Nov 02 01:25:09 user nova-compute[74996]:     <os_type>hvm</os_type>
Nov 02 01:25:09 user nova-compute[74996]:     <arch name='ppc64le'>
Nov 02 01:25:09 user nova-compute[74996]:       <wordsize>64</wordsize>
Nov 02 01:25:09 user nova-compute[74996]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2048'>powernv9</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>taihu</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2048'>powernv10</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='32'>ppce500</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>40p</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>pegasos2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>bamboo</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>g3beige</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>mac99</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>sam460ex</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>ref405ep</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2048'>powernv8</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <domain type='qemu'/>
Nov 02 01:25:09 user nova-compute[74996]:     </arch>
Nov 02 01:25:09 user nova-compute[74996]:     <features>
Nov 02 01:25:09 user nova-compute[74996]:       <cpuselection/>
Nov 02 01:25:09 user nova-compute[74996]:       <deviceboot/>
Nov 02 01:25:09 user nova-compute[74996]:       <disksnapshot default='on' toggle='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     </features>
Nov 02 01:25:09 user nova-compute[74996]:   </guest>
Nov 02 01:25:09 user nova-compute[74996]:   <guest>
Nov 02 01:25:09 user nova-compute[74996]:     <os_type>hvm</os_type>
Nov 02 01:25:09 user nova-compute[74996]:     <arch name='riscv32'>
Nov 02 01:25:09 user nova-compute[74996]:       <wordsize>32</wordsize>
Nov 02 01:25:09 user nova-compute[74996]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='8'>spike</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>opentitan</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='5'>sifive_u</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>sifive_e</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='8'>virt</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <domain type='qemu'/>
Nov 02 01:25:09 user nova-compute[74996]:     </arch>
Nov 02 01:25:09 user nova-compute[74996]:     <features>
Nov 02 01:25:09 user nova-compute[74996]:       <cpuselection/>
Nov 02 01:25:09 user nova-compute[74996]:       <deviceboot/>
Nov 02 01:25:09 user nova-compute[74996]:       <disksnapshot default='on' toggle='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     </features>
Nov 02 01:25:09 user nova-compute[74996]:   </guest>
Nov 02 01:25:09 user nova-compute[74996]:   <guest>
Nov 02 01:25:09 user nova-compute[74996]:     <os_type>hvm</os_type>
Nov 02 01:25:09 user nova-compute[74996]:     <arch name='riscv64'>
Nov 02 01:25:09 user nova-compute[74996]:       <wordsize>64</wordsize>
Nov 02 01:25:09 user nova-compute[74996]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='8'>spike</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='5'>sifive_u</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>shakti_c</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>sifive_e</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='8'>virt</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <domain type='qemu'/>
Nov 02 01:25:09 user nova-compute[74996]:     </arch>
Nov 02 01:25:09 user nova-compute[74996]:     <features>
Nov 02 01:25:09 user nova-compute[74996]:       <cpuselection/>
Nov 02 01:25:09 user nova-compute[74996]:       <deviceboot/>
Nov 02 01:25:09 user nova-compute[74996]:       <disksnapshot default='on' toggle='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     </features>
Nov 02 01:25:09 user nova-compute[74996]:   </guest>
Nov 02 01:25:09 user nova-compute[74996]:   <guest>
Nov 02 01:25:09 user nova-compute[74996]:     <os_type>hvm</os_type>
Nov 02 01:25:09 user nova-compute[74996]:     <arch name='s390x'>
Nov 02 01:25:09 user nova-compute[74996]:       <wordsize>64</wordsize>
Nov 02 01:25:09 user nova-compute[74996]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <domain type='qemu'/>
Nov 02 01:25:09 user nova-compute[74996]:     </arch>
Nov 02 01:25:09 user nova-compute[74996]:     <features>
Nov 02 01:25:09 user nova-compute[74996]:       <cpuselection/>
Nov 02 01:25:09 user nova-compute[74996]:       <deviceboot/>
Nov 02 01:25:09 user nova-compute[74996]:       <disksnapshot default='on' toggle='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     </features>
Nov 02 01:25:09 user nova-compute[74996]:   </guest>
Nov 02 01:25:09 user nova-compute[74996]:   <guest>
Nov 02 01:25:09 user nova-compute[74996]:     <os_type>hvm</os_type>
Nov 02 01:25:09 user nova-compute[74996]:     <arch name='sh4'>
Nov 02 01:25:09 user nova-compute[74996]:       <wordsize>32</wordsize>
Nov 02 01:25:09 user nova-compute[74996]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>shix</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>r2d</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <domain type='qemu'/>
Nov 02 01:25:09 user nova-compute[74996]:     </arch>
Nov 02 01:25:09 user nova-compute[74996]:     <features>
Nov 02 01:25:09 user nova-compute[74996]:       <cpuselection/>
Nov 02 01:25:09 user nova-compute[74996]:       <deviceboot/>
Nov 02 01:25:09 user nova-compute[74996]:       <disksnapshot default='on' toggle='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     </features>
Nov 02 01:25:09 user nova-compute[74996]:   </guest>
Nov 02 01:25:09 user nova-compute[74996]:   <guest>
Nov 02 01:25:09 user nova-compute[74996]:     <os_type>hvm</os_type>
Nov 02 01:25:09 user nova-compute[74996]:     <arch name='sh4eb'>
Nov 02 01:25:09 user nova-compute[74996]:       <wordsize>64</wordsize>
Nov 02 01:25:09 user nova-compute[74996]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>shix</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>r2d</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <domain type='qemu'/>
Nov 02 01:25:09 user nova-compute[74996]:     </arch>
Nov 02 01:25:09 user nova-compute[74996]:     <features>
Nov 02 01:25:09 user nova-compute[74996]:       <cpuselection/>
Nov 02 01:25:09 user nova-compute[74996]:       <deviceboot/>
Nov 02 01:25:09 user nova-compute[74996]:       <disksnapshot default='on' toggle='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     </features>
Nov 02 01:25:09 user nova-compute[74996]:   </guest>
Nov 02 01:25:09 user nova-compute[74996]:   <guest>
Nov 02 01:25:09 user nova-compute[74996]:     <os_type>hvm</os_type>
Nov 02 01:25:09 user nova-compute[74996]:     <arch name='sparc'>
Nov 02 01:25:09 user nova-compute[74996]:       <wordsize>32</wordsize>
Nov 02 01:25:09 user nova-compute[74996]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>SS-5</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>SS-20</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>LX</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>SS-4</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>SS-10</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>Voyager</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <domain type='qemu'/>
Nov 02 01:25:09 user nova-compute[74996]:     </arch>
Nov 02 01:25:09 user nova-compute[74996]:     <features>
Nov 02 01:25:09 user nova-compute[74996]:       <cpuselection/>
Nov 02 01:25:09 user nova-compute[74996]:       <deviceboot/>
Nov 02 01:25:09 user nova-compute[74996]:       <disksnapshot default='on' toggle='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     </features>
Nov 02 01:25:09 user nova-compute[74996]:   </guest>
Nov 02 01:25:09 user nova-compute[74996]:   <guest>
Nov 02 01:25:09 user nova-compute[74996]:     <os_type>hvm</os_type>
Nov 02 01:25:09 user nova-compute[74996]:     <arch name='sparc64'>
Nov 02 01:25:09 user nova-compute[74996]:       <wordsize>64</wordsize>
Nov 02 01:25:09 user nova-compute[74996]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>sun4u</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>niagara</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>sun4v</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <domain type='qemu'/>
Nov 02 01:25:09 user nova-compute[74996]:     </arch>
Nov 02 01:25:09 user nova-compute[74996]:     <features>
Nov 02 01:25:09 user nova-compute[74996]:       <cpuselection/>
Nov 02 01:25:09 user nova-compute[74996]:       <deviceboot/>
Nov 02 01:25:09 user nova-compute[74996]:       <disksnapshot default='on' toggle='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     </features>
Nov 02 01:25:09 user nova-compute[74996]:   </guest>
Nov 02 01:25:09 user nova-compute[74996]:   <guest>
Nov 02 01:25:09 user nova-compute[74996]:     <os_type>hvm</os_type>
Nov 02 01:25:09 user nova-compute[74996]:     <arch name='x86_64'>
Nov 02 01:25:09 user nova-compute[74996]:       <wordsize>64</wordsize>
Nov 02 01:25:09 user nova-compute[74996]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>x-remote</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='1'>isapc</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>microvm</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <domain type='qemu'/>
Nov 02 01:25:09 user nova-compute[74996]:       <domain type='kvm'/>
Nov 02 01:25:09 user nova-compute[74996]:     </arch>
Nov 02 01:25:09 user nova-compute[74996]:     <features>
Nov 02 01:25:09 user nova-compute[74996]:       <acpi default='on' toggle='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:       <apic default='on' toggle='no'/>
Nov 02 01:25:09 user nova-compute[74996]:       <cpuselection/>
Nov 02 01:25:09 user nova-compute[74996]:       <deviceboot/>
Nov 02 01:25:09 user nova-compute[74996]:       <disksnapshot default='on' toggle='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     </features>
Nov 02 01:25:09 user nova-compute[74996]:   </guest>
Nov 02 01:25:09 user nova-compute[74996]:   <guest>
Nov 02 01:25:09 user nova-compute[74996]:     <os_type>hvm</os_type>
Nov 02 01:25:09 user nova-compute[74996]:     <arch name='xtensa'>
Nov 02 01:25:09 user nova-compute[74996]:       <wordsize>32</wordsize>
Nov 02 01:25:09 user nova-compute[74996]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>sim</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='32'>kc705</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='32'>ml605</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='32'>virt</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='32'>lx200</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='32'>lx60</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <domain type='qemu'/>
Nov 02 01:25:09 user nova-compute[74996]:     </arch>
Nov 02 01:25:09 user nova-compute[74996]:     <features>
Nov 02 01:25:09 user nova-compute[74996]:       <cpuselection/>
Nov 02 01:25:09 user nova-compute[74996]:       <deviceboot/>
Nov 02 01:25:09 user nova-compute[74996]:       <disksnapshot default='on' toggle='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     </features>
Nov 02 01:25:09 user nova-compute[74996]:   </guest>
Nov 02 01:25:09 user nova-compute[74996]:   <guest>
Nov 02 01:25:09 user nova-compute[74996]:     <os_type>hvm</os_type>
Nov 02 01:25:09 user nova-compute[74996]:     <arch name='xtensaeb'>
Nov 02 01:25:09 user nova-compute[74996]:       <wordsize>32</wordsize>
Nov 02 01:25:09 user nova-compute[74996]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='4'>sim</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='32'>kc705</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='32'>ml605</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='32'>virt</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='32'>lx200</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='32'>lx60</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 02 01:25:09 user nova-compute[74996]:       <domain type='qemu'/>
Nov 02 01:25:09 user nova-compute[74996]:     </arch>
Nov 02 01:25:09 user nova-compute[74996]:     <features>
Nov 02 01:25:09 user nova-compute[74996]:       <cpuselection/>
Nov 02 01:25:09 user nova-compute[74996]:       <deviceboot/>
Nov 02 01:25:09 user nova-compute[74996]:       <disksnapshot default='on' toggle='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     </features>
Nov 02 01:25:09 user nova-compute[74996]:   </guest>
Nov 02 01:25:09 user nova-compute[74996]: </capabilities>
Nov 02 01:25:09 user nova-compute[74996]: 
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74996) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74996) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74996) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74996) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74996) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74996) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74996) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74996) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74996) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74996) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74996) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=74996) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 02 01:25:09 user nova-compute[74996]: <domainCapabilities>
Nov 02 01:25:09 user nova-compute[74996]:   <path>/usr/bin/qemu-system-i386</path>
Nov 02 01:25:09 user nova-compute[74996]:   <domain>kvm</domain>
Nov 02 01:25:09 user nova-compute[74996]:   <machine>pc-i440fx-6.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:   <arch>i686</arch>
Nov 02 01:25:09 user nova-compute[74996]:   <vcpu max='255'/>
Nov 02 01:25:09 user nova-compute[74996]:   <iothreads supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:   <os supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:     <enum name='firmware'/>
Nov 02 01:25:09 user nova-compute[74996]:     <loader supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='type'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>rom</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>pflash</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='readonly'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>yes</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>no</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='secure'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>no</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </loader>
Nov 02 01:25:09 user nova-compute[74996]:   </os>
Nov 02 01:25:09 user nova-compute[74996]:   <cpu>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='host-passthrough' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='hostPassthroughMigratable'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>off</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='maximum' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='maximumMigratable'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>on</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>off</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='host-model' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <vendor>Intel</vendor>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ss'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='vmx'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='pcid'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='hypervisor'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='arat'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='umip'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='md-clear'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='stibp'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ssbd'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ibpb'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ibrs'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='amd-stibp'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='disable' name='erms'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='disable' name='lm'/>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='custom' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>qemu64</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>qemu32</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>phenom</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>pentium3</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>pentium2</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>pentium</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>n270</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>kvm64</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>kvm32</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>coreduo</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>core2duo</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>athlon</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Westmere-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Westmere</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Snowridge</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Server</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Client</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>SandyBridge</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Penryn</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G5</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G4</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G3</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G2</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G1</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Nehalem-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Nehalem</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>IvyBridge</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Icelake-Server</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC-Rome</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC-Milan</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Dhyana</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Cooperlake</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Conroe</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>486</model>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:   </cpu>
Nov 02 01:25:09 user nova-compute[74996]:   <memoryBacking supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:     <enum name='sourceType'>
Nov 02 01:25:09 user nova-compute[74996]:       <value>file</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>anonymous</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>memfd</value>
Nov 02 01:25:09 user nova-compute[74996]:     </enum>
Nov 02 01:25:09 user nova-compute[74996]:   </memoryBacking>
Nov 02 01:25:09 user nova-compute[74996]:   <devices>
Nov 02 01:25:09 user nova-compute[74996]:     <disk supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='diskDevice'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>disk</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>cdrom</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>floppy</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>lun</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='bus'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>ide</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>fdc</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>scsi</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>usb</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>sata</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='model'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-non-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </disk>
Nov 02 01:25:09 user nova-compute[74996]:     <graphics supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='type'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>sdl</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>vnc</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>spice</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>egl-headless</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </graphics>
Nov 02 01:25:09 user nova-compute[74996]:     <video supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='modelType'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>vga</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>cirrus</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>vmvga</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>qxl</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>none</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>bochs</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>ramfb</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </video>
Nov 02 01:25:09 user nova-compute[74996]:     <hostdev supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='mode'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>subsystem</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='startupPolicy'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>default</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>mandatory</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>requisite</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>optional</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='subsysType'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>usb</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>pci</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>scsi</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='capsType'/>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='pciBackend'/>
Nov 02 01:25:09 user nova-compute[74996]:     </hostdev>
Nov 02 01:25:09 user nova-compute[74996]:     <rng supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='model'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-non-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='backendModel'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>random</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>egd</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>builtin</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </rng>
Nov 02 01:25:09 user nova-compute[74996]:     <filesystem supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='driverType'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>path</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>handle</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtiofs</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </filesystem>
Nov 02 01:25:09 user nova-compute[74996]:     <tpm supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='model'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>tpm-tis</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>tpm-crb</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='backendModel'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>passthrough</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>emulator</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </tpm>
Nov 02 01:25:09 user nova-compute[74996]:   </devices>
Nov 02 01:25:09 user nova-compute[74996]:   <features>
Nov 02 01:25:09 user nova-compute[74996]:     <gic supported='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     <vmcoreinfo supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <genid supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <backingStoreInput supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <backup supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <sev supported='no'/>
Nov 02 01:25:09 user nova-compute[74996]:   </features>
Nov 02 01:25:09 user nova-compute[74996]: </domainCapabilities>
Nov 02 01:25:09 user nova-compute[74996]:  {{(pid=74996) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 02 01:25:09 user nova-compute[74996]: <domainCapabilities>
Nov 02 01:25:09 user nova-compute[74996]:   <path>/usr/bin/qemu-system-i386</path>
Nov 02 01:25:09 user nova-compute[74996]:   <domain>kvm</domain>
Nov 02 01:25:09 user nova-compute[74996]:   <machine>pc-i440fx-jammy</machine>
Nov 02 01:25:09 user nova-compute[74996]:   <arch>i686</arch>
Nov 02 01:25:09 user nova-compute[74996]:   <vcpu max='255'/>
Nov 02 01:25:09 user nova-compute[74996]:   <iothreads supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:   <os supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:     <enum name='firmware'/>
Nov 02 01:25:09 user nova-compute[74996]:     <loader supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='type'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>rom</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>pflash</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='readonly'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>yes</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>no</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='secure'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>no</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </loader>
Nov 02 01:25:09 user nova-compute[74996]:   </os>
Nov 02 01:25:09 user nova-compute[74996]:   <cpu>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='host-passthrough' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='hostPassthroughMigratable'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>off</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='maximum' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='maximumMigratable'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>on</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>off</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='host-model' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <vendor>Intel</vendor>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ss'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='vmx'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='pcid'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='hypervisor'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='arat'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='umip'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='md-clear'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='stibp'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ssbd'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ibpb'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ibrs'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='amd-stibp'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='disable' name='erms'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='disable' name='lm'/>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='custom' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>qemu64</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>qemu32</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>phenom</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>pentium3</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>pentium2</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>pentium</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>n270</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>kvm64</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>kvm32</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>coreduo</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>core2duo</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>athlon</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Westmere-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Westmere</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Snowridge</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Server</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Client</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>SandyBridge</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Penryn</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G5</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G4</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G3</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G2</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G1</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Nehalem-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Nehalem</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>IvyBridge</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Icelake-Server</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC-Rome</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC-Milan</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Dhyana</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Cooperlake</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Conroe</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>486</model>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:   </cpu>
Nov 02 01:25:09 user nova-compute[74996]:   <memoryBacking supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:     <enum name='sourceType'>
Nov 02 01:25:09 user nova-compute[74996]:       <value>file</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>anonymous</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>memfd</value>
Nov 02 01:25:09 user nova-compute[74996]:     </enum>
Nov 02 01:25:09 user nova-compute[74996]:   </memoryBacking>
Nov 02 01:25:09 user nova-compute[74996]:   <devices>
Nov 02 01:25:09 user nova-compute[74996]:     <disk supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='diskDevice'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>disk</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>cdrom</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>floppy</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>lun</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='bus'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>ide</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>fdc</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>scsi</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>usb</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>sata</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='model'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-non-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </disk>
Nov 02 01:25:09 user nova-compute[74996]:     <graphics supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='type'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>sdl</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>vnc</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>spice</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>egl-headless</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </graphics>
Nov 02 01:25:09 user nova-compute[74996]:     <video supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='modelType'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>vga</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>cirrus</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>vmvga</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>qxl</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>none</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>bochs</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>ramfb</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </video>
Nov 02 01:25:09 user nova-compute[74996]:     <hostdev supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='mode'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>subsystem</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='startupPolicy'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>default</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>mandatory</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>requisite</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>optional</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='subsysType'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>usb</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>pci</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>scsi</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='capsType'/>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='pciBackend'/>
Nov 02 01:25:09 user nova-compute[74996]:     </hostdev>
Nov 02 01:25:09 user nova-compute[74996]:     <rng supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='model'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-non-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='backendModel'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>random</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>egd</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>builtin</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </rng>
Nov 02 01:25:09 user nova-compute[74996]:     <filesystem supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='driverType'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>path</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>handle</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtiofs</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </filesystem>
Nov 02 01:25:09 user nova-compute[74996]:     <tpm supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='model'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>tpm-tis</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>tpm-crb</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='backendModel'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>passthrough</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>emulator</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </tpm>
Nov 02 01:25:09 user nova-compute[74996]:   </devices>
Nov 02 01:25:09 user nova-compute[74996]:   <features>
Nov 02 01:25:09 user nova-compute[74996]:     <gic supported='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     <vmcoreinfo supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <genid supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <backingStoreInput supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <backup supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <sev supported='no'/>
Nov 02 01:25:09 user nova-compute[74996]:   </features>
Nov 02 01:25:09 user nova-compute[74996]: </domainCapabilities>
Nov 02 01:25:09 user nova-compute[74996]:  {{(pid=74996) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 02 01:25:09 user nova-compute[74996]: <domainCapabilities>
Nov 02 01:25:09 user nova-compute[74996]:   <path>/usr/bin/qemu-system-i386</path>
Nov 02 01:25:09 user nova-compute[74996]:   <domain>kvm</domain>
Nov 02 01:25:09 user nova-compute[74996]:   <machine>pc-q35-6.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:   <arch>i686</arch>
Nov 02 01:25:09 user nova-compute[74996]:   <vcpu max='288'/>
Nov 02 01:25:09 user nova-compute[74996]:   <iothreads supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:   <os supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:     <enum name='firmware'/>
Nov 02 01:25:09 user nova-compute[74996]:     <loader supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='type'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>rom</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>pflash</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='readonly'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>yes</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>no</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='secure'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>no</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </loader>
Nov 02 01:25:09 user nova-compute[74996]:   </os>
Nov 02 01:25:09 user nova-compute[74996]:   <cpu>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='host-passthrough' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='hostPassthroughMigratable'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>off</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='maximum' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='maximumMigratable'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>on</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>off</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='host-model' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <vendor>Intel</vendor>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ss'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='vmx'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='pcid'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='hypervisor'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='arat'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='umip'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='md-clear'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='stibp'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ssbd'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ibpb'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ibrs'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='amd-stibp'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='disable' name='erms'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='disable' name='lm'/>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='custom' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>qemu64</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>qemu32</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>phenom</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>pentium3</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>pentium2</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>pentium</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>n270</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>kvm64</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>kvm32</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>coreduo</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>core2duo</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>athlon</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Westmere-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Westmere</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Snowridge</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Server</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Client</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>SandyBridge</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Penryn</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G5</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G4</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G3</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G2</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G1</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Nehalem-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Nehalem</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>IvyBridge</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Icelake-Server</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC-Rome</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC-Milan</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Dhyana</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Cooperlake</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Conroe</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>486</model>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:   </cpu>
Nov 02 01:25:09 user nova-compute[74996]:   <memoryBacking supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:     <enum name='sourceType'>
Nov 02 01:25:09 user nova-compute[74996]:       <value>file</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>anonymous</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>memfd</value>
Nov 02 01:25:09 user nova-compute[74996]:     </enum>
Nov 02 01:25:09 user nova-compute[74996]:   </memoryBacking>
Nov 02 01:25:09 user nova-compute[74996]:   <devices>
Nov 02 01:25:09 user nova-compute[74996]:     <disk supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='diskDevice'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>disk</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>cdrom</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>floppy</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>lun</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='bus'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>fdc</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>scsi</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>usb</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>sata</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='model'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-non-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </disk>
Nov 02 01:25:09 user nova-compute[74996]:     <graphics supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='type'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>sdl</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>vnc</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>spice</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>egl-headless</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </graphics>
Nov 02 01:25:09 user nova-compute[74996]:     <video supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='modelType'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>vga</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>cirrus</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>vmvga</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>qxl</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>none</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>bochs</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>ramfb</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </video>
Nov 02 01:25:09 user nova-compute[74996]:     <hostdev supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='mode'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>subsystem</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='startupPolicy'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>default</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>mandatory</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>requisite</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>optional</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='subsysType'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>usb</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>pci</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>scsi</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='capsType'/>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='pciBackend'/>
Nov 02 01:25:09 user nova-compute[74996]:     </hostdev>
Nov 02 01:25:09 user nova-compute[74996]:     <rng supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='model'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-non-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='backendModel'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>random</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>egd</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>builtin</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </rng>
Nov 02 01:25:09 user nova-compute[74996]:     <filesystem supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='driverType'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>path</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>handle</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtiofs</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </filesystem>
Nov 02 01:25:09 user nova-compute[74996]:     <tpm supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='model'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>tpm-tis</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>tpm-crb</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='backendModel'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>passthrough</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>emulator</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </tpm>
Nov 02 01:25:09 user nova-compute[74996]:   </devices>
Nov 02 01:25:09 user nova-compute[74996]:   <features>
Nov 02 01:25:09 user nova-compute[74996]:     <gic supported='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     <vmcoreinfo supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <genid supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <backingStoreInput supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <backup supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <sev supported='no'/>
Nov 02 01:25:09 user nova-compute[74996]:   </features>
Nov 02 01:25:09 user nova-compute[74996]: </domainCapabilities>
Nov 02 01:25:09 user nova-compute[74996]:  {{(pid=74996) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 02 01:25:09 user nova-compute[74996]: <domainCapabilities>
Nov 02 01:25:09 user nova-compute[74996]:   <path>/usr/bin/qemu-system-i386</path>
Nov 02 01:25:09 user nova-compute[74996]:   <domain>kvm</domain>
Nov 02 01:25:09 user nova-compute[74996]:   <machine>pc-q35-jammy</machine>
Nov 02 01:25:09 user nova-compute[74996]:   <arch>i686</arch>
Nov 02 01:25:09 user nova-compute[74996]:   <vcpu max='288'/>
Nov 02 01:25:09 user nova-compute[74996]:   <iothreads supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:   <os supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:     <enum name='firmware'/>
Nov 02 01:25:09 user nova-compute[74996]:     <loader supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='type'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>rom</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>pflash</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='readonly'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>yes</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>no</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='secure'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>no</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </loader>
Nov 02 01:25:09 user nova-compute[74996]:   </os>
Nov 02 01:25:09 user nova-compute[74996]:   <cpu>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='host-passthrough' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='hostPassthroughMigratable'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>off</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='maximum' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='maximumMigratable'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>on</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>off</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='host-model' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <vendor>Intel</vendor>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ss'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='vmx'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='pcid'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='hypervisor'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='arat'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='umip'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='md-clear'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='stibp'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ssbd'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ibpb'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ibrs'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='amd-stibp'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='disable' name='erms'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='disable' name='lm'/>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='custom' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>qemu64</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>qemu32</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>phenom</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>pentium3</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>pentium2</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>pentium</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>n270</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>kvm64</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>kvm32</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>coreduo</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>core2duo</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>athlon</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Westmere-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Westmere</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Snowridge</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Server</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Client</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>SandyBridge</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Penryn</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G5</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G4</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G3</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G2</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G1</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Nehalem-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Nehalem</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>IvyBridge</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Icelake-Server</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC-Rome</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC-Milan</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Dhyana</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Cooperlake</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Conroe</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>486</model>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:   </cpu>
Nov 02 01:25:09 user nova-compute[74996]:   <memoryBacking supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:     <enum name='sourceType'>
Nov 02 01:25:09 user nova-compute[74996]:       <value>file</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>anonymous</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>memfd</value>
Nov 02 01:25:09 user nova-compute[74996]:     </enum>
Nov 02 01:25:09 user nova-compute[74996]:   </memoryBacking>
Nov 02 01:25:09 user nova-compute[74996]:   <devices>
Nov 02 01:25:09 user nova-compute[74996]:     <disk supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='diskDevice'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>disk</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>cdrom</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>floppy</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>lun</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='bus'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>fdc</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>scsi</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>usb</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>sata</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='model'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-non-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </disk>
Nov 02 01:25:09 user nova-compute[74996]:     <graphics supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='type'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>sdl</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>vnc</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>spice</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>egl-headless</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </graphics>
Nov 02 01:25:09 user nova-compute[74996]:     <video supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='modelType'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>vga</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>cirrus</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>vmvga</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>qxl</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>none</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>bochs</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>ramfb</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </video>
Nov 02 01:25:09 user nova-compute[74996]:     <hostdev supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='mode'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>subsystem</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='startupPolicy'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>default</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>mandatory</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>requisite</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>optional</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='subsysType'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>usb</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>pci</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>scsi</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='capsType'/>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='pciBackend'/>
Nov 02 01:25:09 user nova-compute[74996]:     </hostdev>
Nov 02 01:25:09 user nova-compute[74996]:     <rng supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='model'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-non-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='backendModel'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>random</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>egd</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>builtin</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </rng>
Nov 02 01:25:09 user nova-compute[74996]:     <filesystem supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='driverType'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>path</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>handle</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtiofs</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </filesystem>
Nov 02 01:25:09 user nova-compute[74996]:     <tpm supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='model'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>tpm-tis</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>tpm-crb</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='backendModel'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>passthrough</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>emulator</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </tpm>
Nov 02 01:25:09 user nova-compute[74996]:   </devices>
Nov 02 01:25:09 user nova-compute[74996]:   <features>
Nov 02 01:25:09 user nova-compute[74996]:     <gic supported='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     <vmcoreinfo supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <genid supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <backingStoreInput supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <backup supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <sev supported='no'/>
Nov 02 01:25:09 user nova-compute[74996]:   </features>
Nov 02 01:25:09 user nova-compute[74996]: </domainCapabilities>
Nov 02 01:25:09 user nova-compute[74996]:  {{(pid=74996) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74996) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74996) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74996) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74996) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74996) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74996) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74996) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74996) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74996) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74996) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74996) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74996) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74996) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74996) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74996) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74996) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74996) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=74996) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74996) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74996) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74996) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74996) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74996) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74996) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74996) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74996) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74996) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74996) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74996) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74996) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74996) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74996) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74996) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74996) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74996) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74996) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74996) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74996) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=74996) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 02 01:25:09 user nova-compute[74996]: <domainCapabilities>
Nov 02 01:25:09 user nova-compute[74996]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 02 01:25:09 user nova-compute[74996]:   <domain>kvm</domain>
Nov 02 01:25:09 user nova-compute[74996]:   <machine>pc-i440fx-6.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:   <arch>x86_64</arch>
Nov 02 01:25:09 user nova-compute[74996]:   <vcpu max='255'/>
Nov 02 01:25:09 user nova-compute[74996]:   <iothreads supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:   <os supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:     <enum name='firmware'>
Nov 02 01:25:09 user nova-compute[74996]:       <value>efi</value>
Nov 02 01:25:09 user nova-compute[74996]:     </enum>
Nov 02 01:25:09 user nova-compute[74996]:     <loader supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='type'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>rom</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>pflash</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='readonly'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>yes</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>no</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='secure'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>no</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </loader>
Nov 02 01:25:09 user nova-compute[74996]:   </os>
Nov 02 01:25:09 user nova-compute[74996]:   <cpu>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='host-passthrough' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='hostPassthroughMigratable'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>on</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>off</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='maximum' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='maximumMigratable'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>on</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>off</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='host-model' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <vendor>Intel</vendor>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ss'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='vmx'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='pcid'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='hypervisor'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='arat'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='umip'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='md-clear'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='stibp'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ssbd'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='invtsc'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ibpb'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ibrs'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='amd-stibp'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='rsba'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='pschange-mc-no'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='disable' name='erms'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='custom' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>qemu64</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>qemu32</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>phenom</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>pentium3</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>pentium2</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>pentium</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>n270</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>kvm64</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>kvm32</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>coreduo</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>core2duo</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>athlon</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>Westmere-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>Westmere</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Snowridge</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Server</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Client</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>SandyBridge</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>Penryn</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G5</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G4</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G3</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G2</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>Opteron_G1</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>Nehalem</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>IvyBridge</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Icelake-Server</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC-Rome</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC-Milan</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Dhyana</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Cooperlake</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>Conroe</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>486</model>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:   </cpu>
Nov 02 01:25:09 user nova-compute[74996]:   <memoryBacking supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:     <enum name='sourceType'>
Nov 02 01:25:09 user nova-compute[74996]:       <value>file</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>anonymous</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>memfd</value>
Nov 02 01:25:09 user nova-compute[74996]:     </enum>
Nov 02 01:25:09 user nova-compute[74996]:   </memoryBacking>
Nov 02 01:25:09 user nova-compute[74996]:   <devices>
Nov 02 01:25:09 user nova-compute[74996]:     <disk supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='diskDevice'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>disk</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>cdrom</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>floppy</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>lun</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='bus'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>ide</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>fdc</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>scsi</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>usb</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>sata</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='model'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-non-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </disk>
Nov 02 01:25:09 user nova-compute[74996]:     <graphics supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='type'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>sdl</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>vnc</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>spice</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>egl-headless</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </graphics>
Nov 02 01:25:09 user nova-compute[74996]:     <video supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='modelType'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>vga</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>cirrus</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>vmvga</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>qxl</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>none</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>bochs</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>ramfb</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </video>
Nov 02 01:25:09 user nova-compute[74996]:     <hostdev supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='mode'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>subsystem</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='startupPolicy'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>default</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>mandatory</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>requisite</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>optional</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='subsysType'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>usb</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>pci</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>scsi</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='capsType'/>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='pciBackend'/>
Nov 02 01:25:09 user nova-compute[74996]:     </hostdev>
Nov 02 01:25:09 user nova-compute[74996]:     <rng supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='model'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-non-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='backendModel'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>random</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>egd</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>builtin</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </rng>
Nov 02 01:25:09 user nova-compute[74996]:     <filesystem supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='driverType'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>path</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>handle</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtiofs</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </filesystem>
Nov 02 01:25:09 user nova-compute[74996]:     <tpm supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='model'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>tpm-tis</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>tpm-crb</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='backendModel'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>passthrough</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>emulator</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </tpm>
Nov 02 01:25:09 user nova-compute[74996]:   </devices>
Nov 02 01:25:09 user nova-compute[74996]:   <features>
Nov 02 01:25:09 user nova-compute[74996]:     <gic supported='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     <vmcoreinfo supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <genid supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <backingStoreInput supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <backup supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <sev supported='no'/>
Nov 02 01:25:09 user nova-compute[74996]:   </features>
Nov 02 01:25:09 user nova-compute[74996]: </domainCapabilities>
Nov 02 01:25:09 user nova-compute[74996]:  {{(pid=74996) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 02 01:25:09 user nova-compute[74996]: <domainCapabilities>
Nov 02 01:25:09 user nova-compute[74996]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 02 01:25:09 user nova-compute[74996]:   <domain>kvm</domain>
Nov 02 01:25:09 user nova-compute[74996]:   <machine>pc-i440fx-jammy</machine>
Nov 02 01:25:09 user nova-compute[74996]:   <arch>x86_64</arch>
Nov 02 01:25:09 user nova-compute[74996]:   <vcpu max='255'/>
Nov 02 01:25:09 user nova-compute[74996]:   <iothreads supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:   <os supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:     <enum name='firmware'>
Nov 02 01:25:09 user nova-compute[74996]:       <value>efi</value>
Nov 02 01:25:09 user nova-compute[74996]:     </enum>
Nov 02 01:25:09 user nova-compute[74996]:     <loader supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='type'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>rom</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>pflash</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='readonly'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>yes</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>no</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='secure'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>no</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </loader>
Nov 02 01:25:09 user nova-compute[74996]:   </os>
Nov 02 01:25:09 user nova-compute[74996]:   <cpu>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='host-passthrough' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='hostPassthroughMigratable'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>on</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>off</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='maximum' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='maximumMigratable'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>on</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>off</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='host-model' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <vendor>Intel</vendor>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ss'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='vmx'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='pcid'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='hypervisor'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='arat'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='umip'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='md-clear'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='stibp'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ssbd'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='invtsc'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ibpb'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ibrs'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='amd-stibp'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='rsba'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='pschange-mc-no'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='disable' name='erms'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='custom' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>qemu64</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>qemu32</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>phenom</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>pentium3</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>pentium2</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>pentium</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>n270</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>kvm64</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>kvm32</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>coreduo</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>core2duo</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>athlon</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>Westmere-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>Westmere</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Snowridge</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Server</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Client</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>SandyBridge</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>Penryn</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G5</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G4</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G3</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G2</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>Opteron_G1</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>Nehalem</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>IvyBridge</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Icelake-Server</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC-Rome</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC-Milan</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Dhyana</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Cooperlake</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>Conroe</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>486</model>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:   </cpu>
Nov 02 01:25:09 user nova-compute[74996]:   <memoryBacking supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:     <enum name='sourceType'>
Nov 02 01:25:09 user nova-compute[74996]:       <value>file</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>anonymous</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>memfd</value>
Nov 02 01:25:09 user nova-compute[74996]:     </enum>
Nov 02 01:25:09 user nova-compute[74996]:   </memoryBacking>
Nov 02 01:25:09 user nova-compute[74996]:   <devices>
Nov 02 01:25:09 user nova-compute[74996]:     <disk supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='diskDevice'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>disk</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>cdrom</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>floppy</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>lun</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='bus'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>ide</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>fdc</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>scsi</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>usb</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>sata</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='model'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-non-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </disk>
Nov 02 01:25:09 user nova-compute[74996]:     <graphics supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='type'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>sdl</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>vnc</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>spice</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>egl-headless</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </graphics>
Nov 02 01:25:09 user nova-compute[74996]:     <video supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='modelType'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>vga</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>cirrus</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>vmvga</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>qxl</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>none</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>bochs</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>ramfb</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </video>
Nov 02 01:25:09 user nova-compute[74996]:     <hostdev supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='mode'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>subsystem</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='startupPolicy'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>default</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>mandatory</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>requisite</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>optional</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='subsysType'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>usb</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>pci</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>scsi</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='capsType'/>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='pciBackend'/>
Nov 02 01:25:09 user nova-compute[74996]:     </hostdev>
Nov 02 01:25:09 user nova-compute[74996]:     <rng supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='model'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-non-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='backendModel'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>random</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>egd</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>builtin</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </rng>
Nov 02 01:25:09 user nova-compute[74996]:     <filesystem supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='driverType'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>path</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>handle</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtiofs</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </filesystem>
Nov 02 01:25:09 user nova-compute[74996]:     <tpm supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='model'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>tpm-tis</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>tpm-crb</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='backendModel'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>passthrough</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>emulator</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </tpm>
Nov 02 01:25:09 user nova-compute[74996]:   </devices>
Nov 02 01:25:09 user nova-compute[74996]:   <features>
Nov 02 01:25:09 user nova-compute[74996]:     <gic supported='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     <vmcoreinfo supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <genid supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <backingStoreInput supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <backup supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <sev supported='no'/>
Nov 02 01:25:09 user nova-compute[74996]:   </features>
Nov 02 01:25:09 user nova-compute[74996]: </domainCapabilities>
Nov 02 01:25:09 user nova-compute[74996]:  {{(pid=74996) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 02 01:25:09 user nova-compute[74996]: <domainCapabilities>
Nov 02 01:25:09 user nova-compute[74996]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 02 01:25:09 user nova-compute[74996]:   <domain>kvm</domain>
Nov 02 01:25:09 user nova-compute[74996]:   <machine>pc-q35-6.2</machine>
Nov 02 01:25:09 user nova-compute[74996]:   <arch>x86_64</arch>
Nov 02 01:25:09 user nova-compute[74996]:   <vcpu max='288'/>
Nov 02 01:25:09 user nova-compute[74996]:   <iothreads supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:   <os supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:     <enum name='firmware'>
Nov 02 01:25:09 user nova-compute[74996]:       <value>efi</value>
Nov 02 01:25:09 user nova-compute[74996]:     </enum>
Nov 02 01:25:09 user nova-compute[74996]:     <loader supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='type'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>rom</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>pflash</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='readonly'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>yes</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>no</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='secure'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>yes</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>no</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </loader>
Nov 02 01:25:09 user nova-compute[74996]:   </os>
Nov 02 01:25:09 user nova-compute[74996]:   <cpu>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='host-passthrough' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='hostPassthroughMigratable'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>on</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>off</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='maximum' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='maximumMigratable'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>on</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>off</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='host-model' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <vendor>Intel</vendor>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ss'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='vmx'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='pcid'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='hypervisor'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='arat'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='umip'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='md-clear'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='stibp'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ssbd'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='invtsc'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ibpb'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ibrs'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='amd-stibp'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='rsba'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='pschange-mc-no'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='disable' name='erms'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='custom' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>qemu64</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>qemu32</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>phenom</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>pentium3</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>pentium2</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>pentium</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>n270</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>kvm64</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>kvm32</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>coreduo</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>core2duo</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>athlon</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>Westmere-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>Westmere</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Snowridge</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Server</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Client</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>SandyBridge</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>Penryn</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G5</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G4</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G3</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G2</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>Opteron_G1</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>Nehalem</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>IvyBridge</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Icelake-Server</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC-Rome</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC-Milan</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Dhyana</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Cooperlake</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>Conroe</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>486</model>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:   </cpu>
Nov 02 01:25:09 user nova-compute[74996]:   <memoryBacking supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:     <enum name='sourceType'>
Nov 02 01:25:09 user nova-compute[74996]:       <value>file</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>anonymous</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>memfd</value>
Nov 02 01:25:09 user nova-compute[74996]:     </enum>
Nov 02 01:25:09 user nova-compute[74996]:   </memoryBacking>
Nov 02 01:25:09 user nova-compute[74996]:   <devices>
Nov 02 01:25:09 user nova-compute[74996]:     <disk supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='diskDevice'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>disk</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>cdrom</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>floppy</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>lun</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='bus'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>fdc</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>scsi</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>usb</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>sata</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='model'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-non-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </disk>
Nov 02 01:25:09 user nova-compute[74996]:     <graphics supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='type'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>sdl</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>vnc</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>spice</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>egl-headless</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </graphics>
Nov 02 01:25:09 user nova-compute[74996]:     <video supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='modelType'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>vga</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>cirrus</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>vmvga</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>qxl</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>none</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>bochs</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>ramfb</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </video>
Nov 02 01:25:09 user nova-compute[74996]:     <hostdev supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='mode'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>subsystem</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='startupPolicy'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>default</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>mandatory</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>requisite</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>optional</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='subsysType'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>usb</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>pci</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>scsi</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='capsType'/>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='pciBackend'/>
Nov 02 01:25:09 user nova-compute[74996]:     </hostdev>
Nov 02 01:25:09 user nova-compute[74996]:     <rng supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='model'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-non-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='backendModel'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>random</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>egd</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>builtin</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </rng>
Nov 02 01:25:09 user nova-compute[74996]:     <filesystem supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='driverType'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>path</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>handle</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtiofs</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </filesystem>
Nov 02 01:25:09 user nova-compute[74996]:     <tpm supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='model'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>tpm-tis</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>tpm-crb</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='backendModel'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>passthrough</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>emulator</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </tpm>
Nov 02 01:25:09 user nova-compute[74996]:   </devices>
Nov 02 01:25:09 user nova-compute[74996]:   <features>
Nov 02 01:25:09 user nova-compute[74996]:     <gic supported='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     <vmcoreinfo supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <genid supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <backingStoreInput supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <backup supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <sev supported='no'/>
Nov 02 01:25:09 user nova-compute[74996]:   </features>
Nov 02 01:25:09 user nova-compute[74996]: </domainCapabilities>
Nov 02 01:25:09 user nova-compute[74996]:  {{(pid=74996) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 02 01:25:09 user nova-compute[74996]: <domainCapabilities>
Nov 02 01:25:09 user nova-compute[74996]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 02 01:25:09 user nova-compute[74996]:   <domain>kvm</domain>
Nov 02 01:25:09 user nova-compute[74996]:   <machine>pc-q35-jammy</machine>
Nov 02 01:25:09 user nova-compute[74996]:   <arch>x86_64</arch>
Nov 02 01:25:09 user nova-compute[74996]:   <vcpu max='288'/>
Nov 02 01:25:09 user nova-compute[74996]:   <iothreads supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:   <os supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:     <enum name='firmware'>
Nov 02 01:25:09 user nova-compute[74996]:       <value>efi</value>
Nov 02 01:25:09 user nova-compute[74996]:     </enum>
Nov 02 01:25:09 user nova-compute[74996]:     <loader supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='type'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>rom</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>pflash</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='readonly'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>yes</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>no</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='secure'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>yes</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>no</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </loader>
Nov 02 01:25:09 user nova-compute[74996]:   </os>
Nov 02 01:25:09 user nova-compute[74996]:   <cpu>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='host-passthrough' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='hostPassthroughMigratable'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>on</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>off</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='maximum' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='maximumMigratable'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>on</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>off</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='host-model' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <vendor>Intel</vendor>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ss'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='vmx'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='pcid'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='hypervisor'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='arat'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='tsc_adjust'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='umip'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='md-clear'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='stibp'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='arch-capabilities'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ssbd'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='invtsc'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ibpb'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='ibrs'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='amd-stibp'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='amd-ssbd'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='rsba'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='require' name='pschange-mc-no'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='disable' name='erms'/>
Nov 02 01:25:09 user nova-compute[74996]:       <feature policy='disable' name='xsaveopt'/>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:     <mode name='custom' supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>qemu64</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>qemu32</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>phenom</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>pentium3</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>pentium2</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>pentium</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>n270</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>kvm64</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>kvm32</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>coreduo</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>core2duo</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>athlon</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>Westmere-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>Westmere</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Snowridge</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Server</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Skylake-Client</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>SandyBridge</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>Penryn</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G5</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G4</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G3</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Opteron_G2</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>Opteron_G1</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>Nehalem</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>IvyBridge</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Icelake-Server</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Haswell</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC-Rome</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC-Milan</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC-IBPB</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>EPYC</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Dhyana</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Cooperlake</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>Conroe</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Cascadelake-Server</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell-noTSX</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell-IBRS</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='no'>Broadwell</model>
Nov 02 01:25:09 user nova-compute[74996]:       <model usable='yes'>486</model>
Nov 02 01:25:09 user nova-compute[74996]:     </mode>
Nov 02 01:25:09 user nova-compute[74996]:   </cpu>
Nov 02 01:25:09 user nova-compute[74996]:   <memoryBacking supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:     <enum name='sourceType'>
Nov 02 01:25:09 user nova-compute[74996]:       <value>file</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>anonymous</value>
Nov 02 01:25:09 user nova-compute[74996]:       <value>memfd</value>
Nov 02 01:25:09 user nova-compute[74996]:     </enum>
Nov 02 01:25:09 user nova-compute[74996]:   </memoryBacking>
Nov 02 01:25:09 user nova-compute[74996]:   <devices>
Nov 02 01:25:09 user nova-compute[74996]:     <disk supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='diskDevice'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>disk</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>cdrom</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>floppy</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>lun</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='bus'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>fdc</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>scsi</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>usb</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>sata</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='model'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-non-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </disk>
Nov 02 01:25:09 user nova-compute[74996]:     <graphics supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='type'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>sdl</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>vnc</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>spice</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>egl-headless</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </graphics>
Nov 02 01:25:09 user nova-compute[74996]:     <video supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='modelType'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>vga</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>cirrus</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>vmvga</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>qxl</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>none</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>bochs</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>ramfb</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </video>
Nov 02 01:25:09 user nova-compute[74996]:     <hostdev supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='mode'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>subsystem</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='startupPolicy'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>default</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>mandatory</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>requisite</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>optional</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='subsysType'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>usb</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>pci</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>scsi</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='capsType'/>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='pciBackend'/>
Nov 02 01:25:09 user nova-compute[74996]:     </hostdev>
Nov 02 01:25:09 user nova-compute[74996]:     <rng supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='model'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtio-non-transitional</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='backendModel'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>random</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>egd</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>builtin</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </rng>
Nov 02 01:25:09 user nova-compute[74996]:     <filesystem supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='driverType'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>path</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>handle</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>virtiofs</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </filesystem>
Nov 02 01:25:09 user nova-compute[74996]:     <tpm supported='yes'>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='model'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>tpm-tis</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>tpm-crb</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:       <enum name='backendModel'>
Nov 02 01:25:09 user nova-compute[74996]:         <value>passthrough</value>
Nov 02 01:25:09 user nova-compute[74996]:         <value>emulator</value>
Nov 02 01:25:09 user nova-compute[74996]:       </enum>
Nov 02 01:25:09 user nova-compute[74996]:     </tpm>
Nov 02 01:25:09 user nova-compute[74996]:   </devices>
Nov 02 01:25:09 user nova-compute[74996]:   <features>
Nov 02 01:25:09 user nova-compute[74996]:     <gic supported='no'/>
Nov 02 01:25:09 user nova-compute[74996]:     <vmcoreinfo supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <genid supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <backingStoreInput supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <backup supported='yes'/>
Nov 02 01:25:09 user nova-compute[74996]:     <sev supported='no'/>
Nov 02 01:25:09 user nova-compute[74996]:   </features>
Nov 02 01:25:09 user nova-compute[74996]: </domainCapabilities>
Nov 02 01:25:09 user nova-compute[74996]:  {{(pid=74996) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74996) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74996) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74996) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74996) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Checking secure boot support for host arch (x86_64) {{(pid=74996) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Checking secure boot support for host arch (x86_64) {{(pid=74996) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Checking secure boot support for host arch (x86_64) {{(pid=74996) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Checking secure boot support for host arch (x86_64) {{(pid=74996) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Checking secure boot support for host arch (x86_64) {{(pid=74996) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 02 01:25:09 user nova-compute[74996]: INFO nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Secure Boot support detected
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] cpu compare xml: <cpu match="exact">
Nov 02 01:25:09 user nova-compute[74996]:   <model>Nehalem</model>
Nov 02 01:25:09 user nova-compute[74996]: </cpu>
Nov 02 01:25:09 user nova-compute[74996]:  {{(pid=74996) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 02 01:25:09 user nova-compute[74996]: INFO nova.virt.node [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Generated node identity f50a6eca-4874-4b8c-8df6-3d5aa5ebb259
Nov 02 01:25:09 user nova-compute[74996]: INFO nova.virt.node [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Wrote node identity f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 to /opt/stack/data/nova/compute_id
Nov 02 01:25:09 user nova-compute[74996]: WARNING nova.compute.manager [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Compute nodes ['f50a6eca-4874-4b8c-8df6-3d5aa5ebb259'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 02 01:25:09 user nova-compute[74996]: INFO nova.compute.manager [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 02 01:25:09 user nova-compute[74996]: WARNING nova.compute.manager [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 02 01:25:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:25:09 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:25:09 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Hypervisor/Node resource view: name=user free_ram=10951MB free_disk=26.0283203125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:25:09 user nova-compute[74996]: WARNING nova.compute.resource_tracker [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] No compute node record for user:f50a6eca-4874-4b8c-8df6-3d5aa5ebb259: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 could not be found.
Nov 02 01:25:09 user nova-compute[74996]: INFO nova.compute.resource_tracker [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Compute node record created for user:user with uuid: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:25:09 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:25:10 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] [req-f8668cee-b003-4649-bf88-a4499b5b3178] Created resource provider record via placement API for resource provider with UUID f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 and name user.
Nov 02 01:25:10 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74996) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 02 01:25:10 user nova-compute[74996]: INFO nova.virt.libvirt.host [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] kernel doesn't support AMD SEV
Nov 02 01:25:10 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Updating inventory in ProviderTree for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 01:25:10 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:25:10 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Libvirt baseline CPU <cpu>
Nov 02 01:25:10 user nova-compute[74996]:   <arch>x86_64</arch>
Nov 02 01:25:10 user nova-compute[74996]:   <model>Nehalem</model>
Nov 02 01:25:10 user nova-compute[74996]:   <vendor>Intel</vendor>
Nov 02 01:25:10 user nova-compute[74996]:   <topology sockets="6" cores="1" threads="1"/>
Nov 02 01:25:10 user nova-compute[74996]: </cpu>
Nov 02 01:25:10 user nova-compute[74996]:  {{(pid=74996) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 02 01:25:10 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Updated inventory for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 02 01:25:10 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Updating resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 generation from 0 to 1 during operation: update_inventory {{(pid=74996) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 02 01:25:10 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Updating inventory in ProviderTree for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 01:25:10 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Updating resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 generation from 1 to 2 during operation: update_traits {{(pid=74996) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 02 01:25:10 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:25:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.676s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:25:10 user nova-compute[74996]: DEBUG nova.service [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Creating RPC server for service compute {{(pid=74996) start /opt/stack/nova/nova/service.py:182}}
Nov 02 01:25:10 user nova-compute[74996]: DEBUG nova.service [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] Join ServiceGroup membership for this service compute {{(pid=74996) start /opt/stack/nova/nova/service.py:199}}
Nov 02 01:25:10 user nova-compute[74996]: DEBUG nova.servicegroup.drivers.db [None req-e1a980bc-ca50-439c-b1b6-3693a7303dd9 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74996) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 02 01:25:12 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:25:12 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:26:01 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:26:01 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:26:01 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:26:01 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Rebuilding the list of instances to heal {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 01:26:01 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Didn't find any instances for network info cache update. {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 01:26:01 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:26:01 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:26:01 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:26:01 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:26:01 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:26:01 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:26:01 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:26:01 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:26:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:26:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:26:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:26:01 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:26:01 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:26:01 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:26:01 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=10327MB free_disk=25.932147979736328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:26:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:26:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:26:01 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:26:01 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:26:01 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:26:01 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:26:01 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:26:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:27:01 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:27:01 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:27:01 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:27:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:27:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:27:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:27:01 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:27:01 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:27:01 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:27:01 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=10272MB free_disk=25.9964599609375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:27:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:27:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:27:02 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:27:02 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:27:02 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:27:02 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:27:02 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:27:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:27:02 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:27:02 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:27:02 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:27:02 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:27:03 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:27:03 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:27:03 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:27:03 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Rebuilding the list of instances to heal {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 01:27:03 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Didn't find any instances for network info cache update. {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 01:27:03 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:27:03 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:28:02 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:28:03 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:28:03 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:28:03 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:28:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:28:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:28:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:28:03 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:28:03 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:28:03 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:28:03 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=10299MB free_disk=25.750186920166016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:28:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:28:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:28:03 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:28:03 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:28:03 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:28:03 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:28:03 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:28:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.112s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:28:04 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:28:04 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:28:04 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:28:04 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:28:04 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:28:05 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:28:05 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:28:05 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Rebuilding the list of instances to heal {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 01:28:05 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Didn't find any instances for network info cache update. {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 01:29:02 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:29:04 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:29:04 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:29:05 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:29:05 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:29:05 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:29:05 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:29:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:05 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:29:05 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:29:05 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:29:05 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=9549MB free_disk=25.777542114257812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:29:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:05 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:29:05 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:29:05 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:29:05 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:29:05 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:29:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:06 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:29:06 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:29:06 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:29:07 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:29:07 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:29:07 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Rebuilding the list of instances to heal {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 01:29:07 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Didn't find any instances for network info cache update. {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 01:29:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Acquiring lock "3983741f-270b-4758-a676-245b7adc8cc8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "3983741f-270b-4758-a676-245b7adc8cc8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:12 user nova-compute[74996]: DEBUG nova.compute.manager [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:29:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "c04b39dd-3961-4e23-ad43-34a218f4a472" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:12 user nova-compute[74996]: DEBUG nova.compute.manager [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:29:12 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:29:12 user nova-compute[74996]: INFO nova.compute.claims [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Claim successful on node user
Nov 02 01:29:13 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:29:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:13 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:29:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:13 user nova-compute[74996]: DEBUG nova.compute.manager [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:29:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.074s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:13 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:29:13 user nova-compute[74996]: INFO nova.compute.claims [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Claim successful on node user
Nov 02 01:29:13 user nova-compute[74996]: DEBUG nova.compute.manager [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:29:13 user nova-compute[74996]: DEBUG nova.network.neutron [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:29:13 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:29:13 user nova-compute[74996]: DEBUG nova.compute.manager [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:29:13 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:29:13 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:29:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:13 user nova-compute[74996]: DEBUG nova.compute.manager [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:29:13 user nova-compute[74996]: DEBUG nova.compute.manager [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:29:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:29:13 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Creating image(s)
Nov 02 01:29:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Acquiring lock "/opt/stack/data/nova/instances/3983741f-270b-4758-a676-245b7adc8cc8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "/opt/stack/data/nova/instances/3983741f-270b-4758-a676-245b7adc8cc8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "/opt/stack/data/nova/instances/3983741f-270b-4758-a676-245b7adc8cc8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:13 user nova-compute[74996]: DEBUG nova.compute.manager [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:29:13 user nova-compute[74996]: DEBUG nova.network.neutron [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:29:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "fea802b7-64d9-4c77-87a7-eaba1dce5c22" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "fea802b7-64d9-4c77-87a7-eaba1dce5c22" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:13 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:29:13 user nova-compute[74996]: DEBUG nova.compute.manager [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:29:13 user nova-compute[74996]: DEBUG nova.compute.manager [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:29:13 user nova-compute[74996]: DEBUG nova.policy [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a2eafbf71ee44c797c4497af8e5b22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eda3a1bcf0fa436c89c8047b8c410176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:29:13 user nova-compute[74996]: DEBUG nova.policy [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fbb633ea13724161916c7a7b0ca2c392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc6b23ac2b4c7e82fd2a473ddc69c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:29:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:14 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:29:14 user nova-compute[74996]: INFO nova.compute.claims [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Claim successful on node user
Nov 02 01:29:14 user nova-compute[74996]: DEBUG nova.compute.manager [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:29:14 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:29:14 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Creating image(s)
Nov 02 01:29:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "/opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "/opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "/opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.103s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8.part --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "7307f3a3-1ad1-43f7-be49-9cd03a626cd7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "7307f3a3-1ad1-43f7-be49-9cd03a626cd7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8.part --force-share --output=json" returned: 0 in 0.192s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:14 user nova-compute[74996]: DEBUG nova.virt.images [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] f544db05-269f-4ce2-a9db-e2f89ecf2dd8 was qcow2, converting to raw {{(pid=74996) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 01:29:14 user nova-compute[74996]: DEBUG nova.privsep.utils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74996) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 01:29:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8.part /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8.converted {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:14 user nova-compute[74996]: DEBUG nova.compute.manager [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:29:14 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:29:14 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:29:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.919s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:14 user nova-compute[74996]: DEBUG nova.compute.manager [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:29:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8.part /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8.converted" returned: 0 in 0.167s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8.converted --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:15 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:29:15 user nova-compute[74996]: INFO nova.compute.claims [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Claim successful on node user
Nov 02 01:29:15 user nova-compute[74996]: DEBUG nova.compute.manager [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:29:15 user nova-compute[74996]: DEBUG nova.network.neutron [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:29:15 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:29:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.388s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:15 user nova-compute[74996]: INFO oslo.privsep.daemon [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp7nguag2f/privsep.sock']
Nov 02 01:29:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 1.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:15 user sudo[84481]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp7nguag2f/privsep.sock
Nov 02 01:29:15 user sudo[84481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 02 01:29:15 user nova-compute[74996]: DEBUG nova.compute.manager [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:29:15 user nova-compute[74996]: DEBUG nova.compute.manager [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:29:15 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:29:15 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Creating image(s)
Nov 02 01:29:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "/opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "/opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "/opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:15 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:29:15 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:29:15 user nova-compute[74996]: DEBUG nova.policy [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15affb427e9b4fb8873accf286510e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142161c2fae44bdea848619580195795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:29:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:15 user nova-compute[74996]: DEBUG nova.compute.manager [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:29:15 user nova-compute[74996]: DEBUG nova.compute.manager [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:29:15 user nova-compute[74996]: DEBUG nova.network.neutron [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:29:15 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:29:15 user nova-compute[74996]: DEBUG nova.compute.manager [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:29:15 user nova-compute[74996]: DEBUG nova.policy [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f0ac87391a0140ba83743c0a2cd193fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f462793d4eb4433c9c27d92f80518db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:29:15 user nova-compute[74996]: DEBUG nova.compute.manager [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:29:15 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:29:15 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Creating image(s)
Nov 02 01:29:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "/opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "/opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "/opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:15 user nova-compute[74996]: DEBUG nova.network.neutron [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Successfully created port: 0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:29:16 user nova-compute[74996]: DEBUG nova.network.neutron [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Successfully created port: 975424fa-4f7a-4483-bf55-e66c9f95f2b5 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:29:16 user sudo[84481]: pam_unix(sudo:session): session closed for user root
Nov 02 01:29:16 user nova-compute[74996]: INFO oslo.privsep.daemon [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Spawned new privsep daemon via rootwrap
Nov 02 01:29:16 user nova-compute[74996]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 02 01:29:16 user nova-compute[74996]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 02 01:29:16 user nova-compute[74996]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 02 01:29:16 user nova-compute[74996]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84485
Nov 02 01:29:16 user nova-compute[74996]: WARNING oslo_privsep.priv_context [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] privsep daemon already running
Nov 02 01:29:16 user nova-compute[74996]: WARNING oslo_privsep.priv_context [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] privsep daemon already running
Nov 02 01:29:16 user nova-compute[74996]: WARNING oslo_privsep.priv_context [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] privsep daemon already running
Nov 02 01:29:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.169s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.178s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.217s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.214s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.192s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/3983741f-270b-4758-a676-245b7adc8cc8/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/3983741f-270b-4758-a676-245b7adc8cc8/disk 1073741824" returned: 0 in 0.055s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.221s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG nova.network.neutron [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Successfully created port: b645a26c-6fae-4cfc-97ee-951a1cf5aec9 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.171s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3983741f-270b-4758-a676-245b7adc8cc8/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3983741f-270b-4758-a676-245b7adc8cc8/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG nova.network.neutron [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Successfully created port: c458c481-1588-4776-a269-8f95b72195dd {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.183s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk 1073741824" returned: 0 in 0.042s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.480s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG nova.network.neutron [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Successfully updated port: 0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3983741f-270b-4758-a676-245b7adc8cc8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Cannot resize image /opt/stack/data/nova/instances/3983741f-270b-4758-a676-245b7adc8cc8/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Ensure instance console log exists: /opt/stack/data/nova/instances/3983741f-270b-4758-a676-245b7adc8cc8/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "refresh_cache-c04b39dd-3961-4e23-ad43-34a218f4a472" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquired lock "refresh_cache-c04b39dd-3961-4e23-ad43-34a218f4a472" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG nova.network.neutron [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.197s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.200s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG nova.network.neutron [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk 1073741824" returned: 0 in 0.054s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.709s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Cannot resize image /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Ensure instance console log exists: /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.178s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.185s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.network.neutron [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Successfully updated port: 975424fa-4f7a-4483-bf55-e66c9f95f2b5 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.compute.manager [req-0812bb51-9891-4113-a7e6-5c7760ddfc8b req-4e33d64c-4e75-4cb8-822a-e3b084163876 service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Received event network-changed-0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.compute.manager [req-0812bb51-9891-4113-a7e6-5c7760ddfc8b req-4e33d64c-4e75-4cb8-822a-e3b084163876 service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Refreshing instance network info cache due to event network-changed-0a0d9417-e8c0-4392-ba9b-f1e27712adad. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0812bb51-9891-4113-a7e6-5c7760ddfc8b req-4e33d64c-4e75-4cb8-822a-e3b084163876 service nova] Acquiring lock "refresh_cache-c04b39dd-3961-4e23-ad43-34a218f4a472" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk 1073741824" returned: 0 in 0.064s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Acquiring lock "refresh_cache-3983741f-270b-4758-a676-245b7adc8cc8" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Acquired lock "refresh_cache-3983741f-270b-4758-a676-245b7adc8cc8" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.network.neutron [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Cannot resize image /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Ensure instance console log exists: /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.169s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.network.neutron [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Updating instance_info_cache with network_info: [{"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.network.neutron [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Releasing lock "refresh_cache-c04b39dd-3961-4e23-ad43-34a218f4a472" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.compute.manager [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Instance network_info: |[{"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0812bb51-9891-4113-a7e6-5c7760ddfc8b req-4e33d64c-4e75-4cb8-822a-e3b084163876 service nova] Acquired lock "refresh_cache-c04b39dd-3961-4e23-ad43-34a218f4a472" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.network.neutron [req-0812bb51-9891-4113-a7e6-5c7760ddfc8b req-4e33d64c-4e75-4cb8-822a-e3b084163876 service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Refreshing network info cache for port 0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.compute.manager [req-aa6b98b0-e9ee-4cbb-9c32-696adcef7aa2 req-7e8f3784-2087-4c28-a5d0-53d261978bbc service nova] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Received event network-changed-975424fa-4f7a-4483-bf55-e66c9f95f2b5 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.compute.manager [req-aa6b98b0-e9ee-4cbb-9c32-696adcef7aa2 req-7e8f3784-2087-4c28-a5d0-53d261978bbc service nova] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Refreshing instance network info cache due to event network-changed-975424fa-4f7a-4483-bf55-e66c9f95f2b5. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-aa6b98b0-e9ee-4cbb-9c32-696adcef7aa2 req-7e8f3784-2087-4c28-a5d0-53d261978bbc service nova] Acquiring lock "refresh_cache-3983741f-270b-4758-a676-245b7adc8cc8" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Cannot resize image /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Ensure instance console log exists: /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Start _get_guest_xml network_info=[{"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:29:18 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:29:18 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.privsep.utils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74996) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-83700266',display_name='tempest-ServerActionsTestOtherB-server-83700266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-83700266',id=2,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+Qz/HK0D2SWfSjBSFTRJ1B5PKDz0As2T6IrqSYMkdjVvyXlNOPr+4jggbHQf8/h9wUb6gFXAyyFyjYzXEE9DdDVU1SAq0i/8zGeoZyzalitAxQC04YuAZwWq1fcoAvuw==',key_name='tempest-keypair-912688440',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28fc6b23ac2b4c7e82fd2a473ddc69c7',ramdisk_id='',reservation_id='r-8s5rn1jj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-539262669',owner_user_name='tempest-ServerActionsTestOtherB-539262669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:29:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbb633ea13724161916c7a7b0ca2c392',uuid=c04b39dd-3961-4e23-ad43-34a218f4a472,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Converting VIF {"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:a5:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a0d9417-e8c0-4392-ba9b-f1e27712adad,network=Network(fb067344-da99-4071-93f6-a4f844b74341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0d9417-e8') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.objects.instance [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lazy-loading 'pci_devices' on Instance uuid c04b39dd-3961-4e23-ad43-34a218f4a472 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:29:18 user nova-compute[74996]:   <uuid>c04b39dd-3961-4e23-ad43-34a218f4a472</uuid>
Nov 02 01:29:18 user nova-compute[74996]:   <name>instance-00000002</name>
Nov 02 01:29:18 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:29:18 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:29:18 user nova-compute[74996]:   <metadata>
Nov 02 01:29:18 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:29:18 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:29:18 user nova-compute[74996]:       <nova:name>tempest-ServerActionsTestOtherB-server-83700266</nova:name>
Nov 02 01:29:18 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:29:18</nova:creationTime>
Nov 02 01:29:18 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:29:18 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:29:18 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:29:18 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:29:18 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:29:18 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:29:18 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:29:18 user nova-compute[74996]:       <nova:owner>
Nov 02 01:29:18 user nova-compute[74996]:         <nova:user uuid="fbb633ea13724161916c7a7b0ca2c392">tempest-ServerActionsTestOtherB-539262669-project-member</nova:user>
Nov 02 01:29:18 user nova-compute[74996]:         <nova:project uuid="28fc6b23ac2b4c7e82fd2a473ddc69c7">tempest-ServerActionsTestOtherB-539262669</nova:project>
Nov 02 01:29:18 user nova-compute[74996]:       </nova:owner>
Nov 02 01:29:18 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:29:18 user nova-compute[74996]:       <nova:ports>
Nov 02 01:29:18 user nova-compute[74996]:         <nova:port uuid="0a0d9417-e8c0-4392-ba9b-f1e27712adad">
Nov 02 01:29:18 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 02 01:29:18 user nova-compute[74996]:         </nova:port>
Nov 02 01:29:18 user nova-compute[74996]:       </nova:ports>
Nov 02 01:29:18 user nova-compute[74996]:     </nova:instance>
Nov 02 01:29:18 user nova-compute[74996]:   </metadata>
Nov 02 01:29:18 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:29:18 user nova-compute[74996]:     <system>
Nov 02 01:29:18 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:29:18 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:29:18 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:29:18 user nova-compute[74996]:       <entry name="serial">c04b39dd-3961-4e23-ad43-34a218f4a472</entry>
Nov 02 01:29:18 user nova-compute[74996]:       <entry name="uuid">c04b39dd-3961-4e23-ad43-34a218f4a472</entry>
Nov 02 01:29:18 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:29:18 user nova-compute[74996]:     </system>
Nov 02 01:29:18 user nova-compute[74996]:   </sysinfo>
Nov 02 01:29:18 user nova-compute[74996]:   <os>
Nov 02 01:29:18 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:29:18 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:29:18 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:29:18 user nova-compute[74996]:   </os>
Nov 02 01:29:18 user nova-compute[74996]:   <features>
Nov 02 01:29:18 user nova-compute[74996]:     <acpi/>
Nov 02 01:29:18 user nova-compute[74996]:     <apic/>
Nov 02 01:29:18 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:29:18 user nova-compute[74996]:   </features>
Nov 02 01:29:18 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:29:18 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:29:18 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:29:18 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:29:18 user nova-compute[74996]:   </clock>
Nov 02 01:29:18 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:29:18 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:29:18 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:29:18 user nova-compute[74996]:   </cpu>
Nov 02 01:29:18 user nova-compute[74996]:   <devices>
Nov 02 01:29:18 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:29:18 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:29:18 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk"/>
Nov 02 01:29:18 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:29:18 user nova-compute[74996]:     </disk>
Nov 02 01:29:18 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:29:18 user nova-compute[74996]:       <mac address="fa:16:3e:75:a5:8a"/>
Nov 02 01:29:18 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:29:18 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:29:18 user nova-compute[74996]:       <target dev="tap0a0d9417-e8"/>
Nov 02 01:29:18 user nova-compute[74996]:     </interface>
Nov 02 01:29:18 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:29:18 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/console.log" append="off"/>
Nov 02 01:29:18 user nova-compute[74996]:     </serial>
Nov 02 01:29:18 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:29:18 user nova-compute[74996]:     <video>
Nov 02 01:29:18 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:29:18 user nova-compute[74996]:     </video>
Nov 02 01:29:18 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:29:18 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:29:18 user nova-compute[74996]:     </rng>
Nov 02 01:29:18 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:29:18 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:29:18 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:29:18 user nova-compute[74996]:     </memballoon>
Nov 02 01:29:18 user nova-compute[74996]:   </devices>
Nov 02 01:29:18 user nova-compute[74996]: </domain>
Nov 02 01:29:18 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-83700266',display_name='tempest-ServerActionsTestOtherB-server-83700266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-83700266',id=2,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+Qz/HK0D2SWfSjBSFTRJ1B5PKDz0As2T6IrqSYMkdjVvyXlNOPr+4jggbHQf8/h9wUb6gFXAyyFyjYzXEE9DdDVU1SAq0i/8zGeoZyzalitAxQC04YuAZwWq1fcoAvuw==',key_name='tempest-keypair-912688440',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28fc6b23ac2b4c7e82fd2a473ddc69c7',ramdisk_id='',reservation_id='r-8s5rn1jj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-539262669',owner_user_name='tempest-ServerActionsTestOtherB-539262669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:29:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbb633ea13724161916c7a7b0ca2c392',uuid=c04b39dd-3961-4e23-ad43-34a218f4a472,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Converting VIF {"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:a5:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a0d9417-e8c0-4392-ba9b-f1e27712adad,network=Network(fb067344-da99-4071-93f6-a4f844b74341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0d9417-e8') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG os_vif [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:a5:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a0d9417-e8c0-4392-ba9b-f1e27712adad,network=Network(fb067344-da99-4071-93f6-a4f844b74341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0d9417-e8') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Created schema index Interface.name {{(pid=74996) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Created schema index Port.name {{(pid=74996) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Created schema index Bridge.name {{(pid=74996) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [POLLOUT] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.network.neutron [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Successfully updated port: b645a26c-6fae-4cfc-97ee-951a1cf5aec9 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "refresh_cache-7307f3a3-1ad1-43f7-be49-9cd03a626cd7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquired lock "refresh_cache-7307f3a3-1ad1-43f7-be49-9cd03a626cd7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG nova.network.neutron [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '07e76245-23b1-5e9a-b4a7-4b3c9e8b4691', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:29:18 user nova-compute[74996]: INFO oslo.privsep.daemon [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpu90cptxi/privsep.sock']
Nov 02 01:29:18 user sudo[84551]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpu90cptxi/privsep.sock
Nov 02 01:29:18 user sudo[84551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.network.neutron [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.network.neutron [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Updating instance_info_cache with network_info: [{"id": "975424fa-4f7a-4483-bf55-e66c9f95f2b5", "address": "fa:16:3e:ad:63:3e", "network": {"id": "19b893a3-ff14-40bd-bc4a-d5594baee6b0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1986254622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eda3a1bcf0fa436c89c8047b8c410176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap975424fa-4f", "ovs_interfaceid": "975424fa-4f7a-4483-bf55-e66c9f95f2b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Releasing lock "refresh_cache-3983741f-270b-4758-a676-245b7adc8cc8" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.compute.manager [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Instance network_info: |[{"id": "975424fa-4f7a-4483-bf55-e66c9f95f2b5", "address": "fa:16:3e:ad:63:3e", "network": {"id": "19b893a3-ff14-40bd-bc4a-d5594baee6b0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1986254622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eda3a1bcf0fa436c89c8047b8c410176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap975424fa-4f", "ovs_interfaceid": "975424fa-4f7a-4483-bf55-e66c9f95f2b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-aa6b98b0-e9ee-4cbb-9c32-696adcef7aa2 req-7e8f3784-2087-4c28-a5d0-53d261978bbc service nova] Acquired lock "refresh_cache-3983741f-270b-4758-a676-245b7adc8cc8" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.network.neutron [req-aa6b98b0-e9ee-4cbb-9c32-696adcef7aa2 req-7e8f3784-2087-4c28-a5d0-53d261978bbc service nova] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Refreshing network info cache for port 975424fa-4f7a-4483-bf55-e66c9f95f2b5 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Start _get_guest_xml network_info=[{"id": "975424fa-4f7a-4483-bf55-e66c9f95f2b5", "address": "fa:16:3e:ad:63:3e", "network": {"id": "19b893a3-ff14-40bd-bc4a-d5594baee6b0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1986254622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eda3a1bcf0fa436c89c8047b8c410176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap975424fa-4f", "ovs_interfaceid": "975424fa-4f7a-4483-bf55-e66c9f95f2b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:19 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:29:19 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:29:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1794916877',display_name='tempest-DeleteServersTestJSON-server-1794916877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1794916877',id=1,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eda3a1bcf0fa436c89c8047b8c410176',ramdisk_id='',reservation_id='r-mli5h0ea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-940408768',owner_user_name='tempest-DeleteServersTestJSON-940408768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:29:14Z,user_data=None,user_id='9a2eafbf71ee44c797c4497af8e5b22a',uuid=3983741f-270b-4758-a676-245b7adc8cc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "975424fa-4f7a-4483-bf55-e66c9f95f2b5", "address": "fa:16:3e:ad:63:3e", "network": {"id": "19b893a3-ff14-40bd-bc4a-d5594baee6b0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1986254622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eda3a1bcf0fa436c89c8047b8c410176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap975424fa-4f", "ovs_interfaceid": "975424fa-4f7a-4483-bf55-e66c9f95f2b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Converting VIF {"id": "975424fa-4f7a-4483-bf55-e66c9f95f2b5", "address": "fa:16:3e:ad:63:3e", "network": {"id": "19b893a3-ff14-40bd-bc4a-d5594baee6b0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1986254622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eda3a1bcf0fa436c89c8047b8c410176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap975424fa-4f", "ovs_interfaceid": "975424fa-4f7a-4483-bf55-e66c9f95f2b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:63:3e,bridge_name='br-int',has_traffic_filtering=True,id=975424fa-4f7a-4483-bf55-e66c9f95f2b5,network=Network(19b893a3-ff14-40bd-bc4a-d5594baee6b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap975424fa-4f') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.objects.instance [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lazy-loading 'pci_devices' on Instance uuid 3983741f-270b-4758-a676-245b7adc8cc8 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:29:19 user nova-compute[74996]:   <uuid>3983741f-270b-4758-a676-245b7adc8cc8</uuid>
Nov 02 01:29:19 user nova-compute[74996]:   <name>instance-00000001</name>
Nov 02 01:29:19 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:29:19 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:29:19 user nova-compute[74996]:   <metadata>
Nov 02 01:29:19 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:29:19 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:29:19 user nova-compute[74996]:       <nova:name>tempest-DeleteServersTestJSON-server-1794916877</nova:name>
Nov 02 01:29:19 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:29:19</nova:creationTime>
Nov 02 01:29:19 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:29:19 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:29:19 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:29:19 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:29:19 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:29:19 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:29:19 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:29:19 user nova-compute[74996]:       <nova:owner>
Nov 02 01:29:19 user nova-compute[74996]:         <nova:user uuid="9a2eafbf71ee44c797c4497af8e5b22a">tempest-DeleteServersTestJSON-940408768-project-member</nova:user>
Nov 02 01:29:19 user nova-compute[74996]:         <nova:project uuid="eda3a1bcf0fa436c89c8047b8c410176">tempest-DeleteServersTestJSON-940408768</nova:project>
Nov 02 01:29:19 user nova-compute[74996]:       </nova:owner>
Nov 02 01:29:19 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:29:19 user nova-compute[74996]:       <nova:ports>
Nov 02 01:29:19 user nova-compute[74996]:         <nova:port uuid="975424fa-4f7a-4483-bf55-e66c9f95f2b5">
Nov 02 01:29:19 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 02 01:29:19 user nova-compute[74996]:         </nova:port>
Nov 02 01:29:19 user nova-compute[74996]:       </nova:ports>
Nov 02 01:29:19 user nova-compute[74996]:     </nova:instance>
Nov 02 01:29:19 user nova-compute[74996]:   </metadata>
Nov 02 01:29:19 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:29:19 user nova-compute[74996]:     <system>
Nov 02 01:29:19 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:29:19 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:29:19 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:29:19 user nova-compute[74996]:       <entry name="serial">3983741f-270b-4758-a676-245b7adc8cc8</entry>
Nov 02 01:29:19 user nova-compute[74996]:       <entry name="uuid">3983741f-270b-4758-a676-245b7adc8cc8</entry>
Nov 02 01:29:19 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:29:19 user nova-compute[74996]:     </system>
Nov 02 01:29:19 user nova-compute[74996]:   </sysinfo>
Nov 02 01:29:19 user nova-compute[74996]:   <os>
Nov 02 01:29:19 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:29:19 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:29:19 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:29:19 user nova-compute[74996]:   </os>
Nov 02 01:29:19 user nova-compute[74996]:   <features>
Nov 02 01:29:19 user nova-compute[74996]:     <acpi/>
Nov 02 01:29:19 user nova-compute[74996]:     <apic/>
Nov 02 01:29:19 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:29:19 user nova-compute[74996]:   </features>
Nov 02 01:29:19 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:29:19 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:29:19 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:29:19 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:29:19 user nova-compute[74996]:   </clock>
Nov 02 01:29:19 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:29:19 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:29:19 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:29:19 user nova-compute[74996]:   </cpu>
Nov 02 01:29:19 user nova-compute[74996]:   <devices>
Nov 02 01:29:19 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:29:19 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:29:19 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/3983741f-270b-4758-a676-245b7adc8cc8/disk"/>
Nov 02 01:29:19 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:29:19 user nova-compute[74996]:     </disk>
Nov 02 01:29:19 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:29:19 user nova-compute[74996]:       <mac address="fa:16:3e:ad:63:3e"/>
Nov 02 01:29:19 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:29:19 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:29:19 user nova-compute[74996]:       <target dev="tap975424fa-4f"/>
Nov 02 01:29:19 user nova-compute[74996]:     </interface>
Nov 02 01:29:19 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:29:19 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/3983741f-270b-4758-a676-245b7adc8cc8/console.log" append="off"/>
Nov 02 01:29:19 user nova-compute[74996]:     </serial>
Nov 02 01:29:19 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:29:19 user nova-compute[74996]:     <video>
Nov 02 01:29:19 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:29:19 user nova-compute[74996]:     </video>
Nov 02 01:29:19 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:29:19 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:29:19 user nova-compute[74996]:     </rng>
Nov 02 01:29:19 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:29:19 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:29:19 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:29:19 user nova-compute[74996]:     </memballoon>
Nov 02 01:29:19 user nova-compute[74996]:   </devices>
Nov 02 01:29:19 user nova-compute[74996]: </domain>
Nov 02 01:29:19 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:29:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1794916877',display_name='tempest-DeleteServersTestJSON-server-1794916877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1794916877',id=1,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eda3a1bcf0fa436c89c8047b8c410176',ramdisk_id='',reservation_id='r-mli5h0ea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-940408768',owner_user_name='tempest-DeleteServersTestJSON-940408768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:29:14Z,user_data=None,user_id='9a2eafbf71ee44c797c4497af8e5b22a',uuid=3983741f-270b-4758-a676-245b7adc8cc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "975424fa-4f7a-4483-bf55-e66c9f95f2b5", "address": "fa:16:3e:ad:63:3e", "network": {"id": "19b893a3-ff14-40bd-bc4a-d5594baee6b0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1986254622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eda3a1bcf0fa436c89c8047b8c410176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap975424fa-4f", "ovs_interfaceid": "975424fa-4f7a-4483-bf55-e66c9f95f2b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Converting VIF {"id": "975424fa-4f7a-4483-bf55-e66c9f95f2b5", "address": "fa:16:3e:ad:63:3e", "network": {"id": "19b893a3-ff14-40bd-bc4a-d5594baee6b0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1986254622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eda3a1bcf0fa436c89c8047b8c410176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap975424fa-4f", "ovs_interfaceid": "975424fa-4f7a-4483-bf55-e66c9f95f2b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:63:3e,bridge_name='br-int',has_traffic_filtering=True,id=975424fa-4f7a-4483-bf55-e66c9f95f2b5,network=Network(19b893a3-ff14-40bd-bc4a-d5594baee6b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap975424fa-4f') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG os_vif [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:63:3e,bridge_name='br-int',has_traffic_filtering=True,id=975424fa-4f7a-4483-bf55-e66c9f95f2b5,network=Network(19b893a3-ff14-40bd-bc4a-d5594baee6b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap975424fa-4f') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc627f27-55be-58b4-a09d-479b90c501dd', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.network.neutron [req-0812bb51-9891-4113-a7e6-5c7760ddfc8b req-4e33d64c-4e75-4cb8-822a-e3b084163876 service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Updated VIF entry in instance network info cache for port 0a0d9417-e8c0-4392-ba9b-f1e27712adad. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.network.neutron [req-0812bb51-9891-4113-a7e6-5c7760ddfc8b req-4e33d64c-4e75-4cb8-822a-e3b084163876 service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Updating instance_info_cache with network_info: [{"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.network.neutron [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Updating instance_info_cache with network_info: [{"id": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "address": "fa:16:3e:97:27:02", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb645a26c-6f", "ovs_interfaceid": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0812bb51-9891-4113-a7e6-5c7760ddfc8b req-4e33d64c-4e75-4cb8-822a-e3b084163876 service nova] Releasing lock "refresh_cache-c04b39dd-3961-4e23-ad43-34a218f4a472" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Releasing lock "refresh_cache-7307f3a3-1ad1-43f7-be49-9cd03a626cd7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.compute.manager [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Instance network_info: |[{"id": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "address": "fa:16:3e:97:27:02", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb645a26c-6f", "ovs_interfaceid": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Start _get_guest_xml network_info=[{"id": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "address": "fa:16:3e:97:27:02", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb645a26c-6f", "ovs_interfaceid": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:29:19 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:29:19 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:29:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1659521124',display_name='tempest-ServerActionsTestOtherA-server-1659521124',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1659521124',id=4,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuGPSdhZpoJV1Cta3eTfZjI1QRYRGe6Y8DzUdNt6ZIoysubzlLd36OVzphJd/MOKltwOpW5QoJYEARWlOQfh2pk3msvJuTgQKOLlFS0wLTIMWMdtr2LMQxjw6cacUWITQ==',key_name='tempest-keypair-1376755092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f462793d4eb4433c9c27d92f80518db1',ramdisk_id='',reservation_id='r-rkqoqdgr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-852070362',owner_user_name='tempest-ServerActionsTestOtherA-852070362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:29:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0ac87391a0140ba83743c0a2cd193fe',uuid=7307f3a3-1ad1-43f7-be49-9cd03a626cd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "address": "fa:16:3e:97:27:02", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb645a26c-6f", "ovs_interfaceid": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Converting VIF {"id": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "address": "fa:16:3e:97:27:02", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb645a26c-6f", "ovs_interfaceid": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:27:02,bridge_name='br-int',has_traffic_filtering=True,id=b645a26c-6fae-4cfc-97ee-951a1cf5aec9,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb645a26c-6f') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.objects.instance [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lazy-loading 'pci_devices' on Instance uuid 7307f3a3-1ad1-43f7-be49-9cd03a626cd7 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:29:19 user nova-compute[74996]:   <uuid>7307f3a3-1ad1-43f7-be49-9cd03a626cd7</uuid>
Nov 02 01:29:19 user nova-compute[74996]:   <name>instance-00000004</name>
Nov 02 01:29:19 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:29:19 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:29:19 user nova-compute[74996]:   <metadata>
Nov 02 01:29:19 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:29:19 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:29:19 user nova-compute[74996]:       <nova:name>tempest-ServerActionsTestOtherA-server-1659521124</nova:name>
Nov 02 01:29:19 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:29:19</nova:creationTime>
Nov 02 01:29:19 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:29:19 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:29:19 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:29:19 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:29:19 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:29:19 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:29:19 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:29:19 user nova-compute[74996]:       <nova:owner>
Nov 02 01:29:19 user nova-compute[74996]:         <nova:user uuid="f0ac87391a0140ba83743c0a2cd193fe">tempest-ServerActionsTestOtherA-852070362-project-member</nova:user>
Nov 02 01:29:19 user nova-compute[74996]:         <nova:project uuid="f462793d4eb4433c9c27d92f80518db1">tempest-ServerActionsTestOtherA-852070362</nova:project>
Nov 02 01:29:19 user nova-compute[74996]:       </nova:owner>
Nov 02 01:29:19 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:29:19 user nova-compute[74996]:       <nova:ports>
Nov 02 01:29:19 user nova-compute[74996]:         <nova:port uuid="b645a26c-6fae-4cfc-97ee-951a1cf5aec9">
Nov 02 01:29:19 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 02 01:29:19 user nova-compute[74996]:         </nova:port>
Nov 02 01:29:19 user nova-compute[74996]:       </nova:ports>
Nov 02 01:29:19 user nova-compute[74996]:     </nova:instance>
Nov 02 01:29:19 user nova-compute[74996]:   </metadata>
Nov 02 01:29:19 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:29:19 user nova-compute[74996]:     <system>
Nov 02 01:29:19 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:29:19 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:29:19 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:29:19 user nova-compute[74996]:       <entry name="serial">7307f3a3-1ad1-43f7-be49-9cd03a626cd7</entry>
Nov 02 01:29:19 user nova-compute[74996]:       <entry name="uuid">7307f3a3-1ad1-43f7-be49-9cd03a626cd7</entry>
Nov 02 01:29:19 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:29:19 user nova-compute[74996]:     </system>
Nov 02 01:29:19 user nova-compute[74996]:   </sysinfo>
Nov 02 01:29:19 user nova-compute[74996]:   <os>
Nov 02 01:29:19 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:29:19 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:29:19 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:29:19 user nova-compute[74996]:   </os>
Nov 02 01:29:19 user nova-compute[74996]:   <features>
Nov 02 01:29:19 user nova-compute[74996]:     <acpi/>
Nov 02 01:29:19 user nova-compute[74996]:     <apic/>
Nov 02 01:29:19 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:29:19 user nova-compute[74996]:   </features>
Nov 02 01:29:19 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:29:19 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:29:19 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:29:19 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:29:19 user nova-compute[74996]:   </clock>
Nov 02 01:29:19 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:29:19 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:29:19 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:29:19 user nova-compute[74996]:   </cpu>
Nov 02 01:29:19 user nova-compute[74996]:   <devices>
Nov 02 01:29:19 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:29:19 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:29:19 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk"/>
Nov 02 01:29:19 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:29:19 user nova-compute[74996]:     </disk>
Nov 02 01:29:19 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:29:19 user nova-compute[74996]:       <mac address="fa:16:3e:97:27:02"/>
Nov 02 01:29:19 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:29:19 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:29:19 user nova-compute[74996]:       <target dev="tapb645a26c-6f"/>
Nov 02 01:29:19 user nova-compute[74996]:     </interface>
Nov 02 01:29:19 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:29:19 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/console.log" append="off"/>
Nov 02 01:29:19 user nova-compute[74996]:     </serial>
Nov 02 01:29:19 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:29:19 user nova-compute[74996]:     <video>
Nov 02 01:29:19 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:29:19 user nova-compute[74996]:     </video>
Nov 02 01:29:19 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:29:19 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:29:19 user nova-compute[74996]:     </rng>
Nov 02 01:29:19 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:29:19 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:29:19 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:29:19 user nova-compute[74996]:     </memballoon>
Nov 02 01:29:19 user nova-compute[74996]:   </devices>
Nov 02 01:29:19 user nova-compute[74996]: </domain>
Nov 02 01:29:19 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:29:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1659521124',display_name='tempest-ServerActionsTestOtherA-server-1659521124',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1659521124',id=4,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuGPSdhZpoJV1Cta3eTfZjI1QRYRGe6Y8DzUdNt6ZIoysubzlLd36OVzphJd/MOKltwOpW5QoJYEARWlOQfh2pk3msvJuTgQKOLlFS0wLTIMWMdtr2LMQxjw6cacUWITQ==',key_name='tempest-keypair-1376755092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f462793d4eb4433c9c27d92f80518db1',ramdisk_id='',reservation_id='r-rkqoqdgr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-852070362',owner_user_name='tempest-ServerActionsTestOtherA-852070362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:29:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0ac87391a0140ba83743c0a2cd193fe',uuid=7307f3a3-1ad1-43f7-be49-9cd03a626cd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "address": "fa:16:3e:97:27:02", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb645a26c-6f", "ovs_interfaceid": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Converting VIF {"id": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "address": "fa:16:3e:97:27:02", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb645a26c-6f", "ovs_interfaceid": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:27:02,bridge_name='br-int',has_traffic_filtering=True,id=b645a26c-6fae-4cfc-97ee-951a1cf5aec9,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb645a26c-6f') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG os_vif [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:27:02,bridge_name='br-int',has_traffic_filtering=True,id=b645a26c-6fae-4cfc-97ee-951a1cf5aec9,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb645a26c-6f') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fac587be-c26b-5d6f-a071-aa1568c282c6', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:29:20 user nova-compute[74996]: DEBUG nova.network.neutron [req-aa6b98b0-e9ee-4cbb-9c32-696adcef7aa2 req-7e8f3784-2087-4c28-a5d0-53d261978bbc service nova] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Updated VIF entry in instance network info cache for port 975424fa-4f7a-4483-bf55-e66c9f95f2b5. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:29:20 user nova-compute[74996]: DEBUG nova.network.neutron [req-aa6b98b0-e9ee-4cbb-9c32-696adcef7aa2 req-7e8f3784-2087-4c28-a5d0-53d261978bbc service nova] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Updating instance_info_cache with network_info: [{"id": "975424fa-4f7a-4483-bf55-e66c9f95f2b5", "address": "fa:16:3e:ad:63:3e", "network": {"id": "19b893a3-ff14-40bd-bc4a-d5594baee6b0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1986254622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eda3a1bcf0fa436c89c8047b8c410176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap975424fa-4f", "ovs_interfaceid": "975424fa-4f7a-4483-bf55-e66c9f95f2b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:29:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-aa6b98b0-e9ee-4cbb-9c32-696adcef7aa2 req-7e8f3784-2087-4c28-a5d0-53d261978bbc service nova] Releasing lock "refresh_cache-3983741f-270b-4758-a676-245b7adc8cc8" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:29:20 user nova-compute[74996]: DEBUG nova.compute.manager [req-4207f53d-966c-4420-b628-100a7416a817 req-0f061263-b415-4607-ab05-72811726e226 service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Received event network-changed-b645a26c-6fae-4cfc-97ee-951a1cf5aec9 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:29:20 user nova-compute[74996]: DEBUG nova.compute.manager [req-4207f53d-966c-4420-b628-100a7416a817 req-0f061263-b415-4607-ab05-72811726e226 service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Refreshing instance network info cache due to event network-changed-b645a26c-6fae-4cfc-97ee-951a1cf5aec9. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:29:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4207f53d-966c-4420-b628-100a7416a817 req-0f061263-b415-4607-ab05-72811726e226 service nova] Acquiring lock "refresh_cache-7307f3a3-1ad1-43f7-be49-9cd03a626cd7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:29:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4207f53d-966c-4420-b628-100a7416a817 req-0f061263-b415-4607-ab05-72811726e226 service nova] Acquired lock "refresh_cache-7307f3a3-1ad1-43f7-be49-9cd03a626cd7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:29:20 user nova-compute[74996]: DEBUG nova.network.neutron [req-4207f53d-966c-4420-b628-100a7416a817 req-0f061263-b415-4607-ab05-72811726e226 service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Refreshing network info cache for port b645a26c-6fae-4cfc-97ee-951a1cf5aec9 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:29:20 user sudo[84551]: pam_unix(sudo:session): session closed for user root
Nov 02 01:29:20 user nova-compute[74996]: INFO oslo.privsep.daemon [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Spawned new privsep daemon via rootwrap
Nov 02 01:29:20 user nova-compute[74996]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 02 01:29:20 user nova-compute[74996]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 02 01:29:20 user nova-compute[74996]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 02 01:29:20 user nova-compute[74996]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84554
Nov 02 01:29:20 user nova-compute[74996]: WARNING oslo_privsep.priv_context [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] privsep daemon already running
Nov 02 01:29:20 user nova-compute[74996]: WARNING oslo_privsep.priv_context [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] privsep daemon already running
Nov 02 01:29:20 user nova-compute[74996]: DEBUG nova.network.neutron [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Successfully updated port: c458c481-1588-4776-a269-8f95b72195dd {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:29:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "refresh_cache-fea802b7-64d9-4c77-87a7-eaba1dce5c22" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:29:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquired lock "refresh_cache-fea802b7-64d9-4c77-87a7-eaba1dce5c22" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:29:20 user nova-compute[74996]: DEBUG nova.network.neutron [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:29:20 user nova-compute[74996]: DEBUG nova.network.neutron [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:29:20 user nova-compute[74996]: DEBUG nova.compute.manager [req-8cc9bd54-7551-4093-9b6f-9047b4bab9b4 req-7e33fbdb-d1c8-4354-b4a7-ca4d364c488f service nova] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Received event network-changed-c458c481-1588-4776-a269-8f95b72195dd {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:29:20 user nova-compute[74996]: DEBUG nova.compute.manager [req-8cc9bd54-7551-4093-9b6f-9047b4bab9b4 req-7e33fbdb-d1c8-4354-b4a7-ca4d364c488f service nova] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Refreshing instance network info cache due to event network-changed-c458c481-1588-4776-a269-8f95b72195dd. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:29:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8cc9bd54-7551-4093-9b6f-9047b4bab9b4 req-7e33fbdb-d1c8-4354-b4a7-ca4d364c488f service nova] Acquiring lock "refresh_cache-fea802b7-64d9-4c77-87a7-eaba1dce5c22" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.network.neutron [req-4207f53d-966c-4420-b628-100a7416a817 req-0f061263-b415-4607-ab05-72811726e226 service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Updated VIF entry in instance network info cache for port b645a26c-6fae-4cfc-97ee-951a1cf5aec9. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.network.neutron [req-4207f53d-966c-4420-b628-100a7416a817 req-0f061263-b415-4607-ab05-72811726e226 service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Updating instance_info_cache with network_info: [{"id": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "address": "fa:16:3e:97:27:02", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb645a26c-6f", "ovs_interfaceid": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap975424fa-4f, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap975424fa-4f, col_values=(('qos', UUID('c5895643-f5de-43f6-9ba7-877723d77589')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap975424fa-4f, col_values=(('external_ids', {'iface-id': '975424fa-4f7a-4483-bf55-e66c9f95f2b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:63:3e', 'vm-uuid': '3983741f-270b-4758-a676-245b7adc8cc8'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4207f53d-966c-4420-b628-100a7416a817 req-0f061263-b415-4607-ab05-72811726e226 service nova] Releasing lock "refresh_cache-7307f3a3-1ad1-43f7-be49-9cd03a626cd7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:21 user nova-compute[74996]: INFO os_vif [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:63:3e,bridge_name='br-int',has_traffic_filtering=True,id=975424fa-4f7a-4483-bf55-e66c9f95f2b5,network=Network(19b893a3-ff14-40bd-bc4a-d5594baee6b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap975424fa-4f')
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a0d9417-e8, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a0d9417-e8, col_values=(('qos', UUID('8ec074b7-83be-4855-be6d-97cefd65e76f')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a0d9417-e8, col_values=(('external_ids', {'iface-id': '0a0d9417-e8c0-4392-ba9b-f1e27712adad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:a5:8a', 'vm-uuid': 'c04b39dd-3961-4e23-ad43-34a218f4a472'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:21 user nova-compute[74996]: INFO os_vif [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:a5:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a0d9417-e8c0-4392-ba9b-f1e27712adad,network=Network(fb067344-da99-4071-93f6-a4f844b74341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0d9417-e8')
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb645a26c-6f, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb645a26c-6f, col_values=(('qos', UUID('0be50e7f-4352-4839-88f0-4218905f4c9a')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb645a26c-6f, col_values=(('external_ids', {'iface-id': 'b645a26c-6fae-4cfc-97ee-951a1cf5aec9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:27:02', 'vm-uuid': '7307f3a3-1ad1-43f7-be49-9cd03a626cd7'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:21 user nova-compute[74996]: INFO os_vif [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:27:02,bridge_name='br-int',has_traffic_filtering=True,id=b645a26c-6fae-4cfc-97ee-951a1cf5aec9,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb645a26c-6f')
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] No VIF found with MAC fa:16:3e:ad:63:3e, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] No VIF found with MAC fa:16:3e:75:a5:8a, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] No VIF found with MAC fa:16:3e:97:27:02, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.network.neutron [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Updating instance_info_cache with network_info: [{"id": "c458c481-1588-4776-a269-8f95b72195dd", "address": "fa:16:3e:7f:23:3e", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc458c481-15", "ovs_interfaceid": "c458c481-1588-4776-a269-8f95b72195dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Releasing lock "refresh_cache-fea802b7-64d9-4c77-87a7-eaba1dce5c22" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.compute.manager [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Instance network_info: |[{"id": "c458c481-1588-4776-a269-8f95b72195dd", "address": "fa:16:3e:7f:23:3e", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc458c481-15", "ovs_interfaceid": "c458c481-1588-4776-a269-8f95b72195dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8cc9bd54-7551-4093-9b6f-9047b4bab9b4 req-7e33fbdb-d1c8-4354-b4a7-ca4d364c488f service nova] Acquired lock "refresh_cache-fea802b7-64d9-4c77-87a7-eaba1dce5c22" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.network.neutron [req-8cc9bd54-7551-4093-9b6f-9047b4bab9b4 req-7e33fbdb-d1c8-4354-b4a7-ca4d364c488f service nova] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Refreshing network info cache for port c458c481-1588-4776-a269-8f95b72195dd {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Start _get_guest_xml network_info=[{"id": "c458c481-1588-4776-a269-8f95b72195dd", "address": "fa:16:3e:7f:23:3e", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc458c481-15", "ovs_interfaceid": "c458c481-1588-4776-a269-8f95b72195dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:29:21 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:29:21 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:29:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1604386891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1604386891',id=3,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='142161c2fae44bdea848619580195795',ramdisk_id='',reservation_id='r-b6qt65yz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1294190560',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:29:15Z,user_data=None,user_id='15affb427e9b4fb8873accf286510e14',uuid=fea802b7-64d9-4c77-87a7-eaba1dce5c22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c458c481-1588-4776-a269-8f95b72195dd", "address": "fa:16:3e:7f:23:3e", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc458c481-15", "ovs_interfaceid": "c458c481-1588-4776-a269-8f95b72195dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Converting VIF {"id": "c458c481-1588-4776-a269-8f95b72195dd", "address": "fa:16:3e:7f:23:3e", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc458c481-15", "ovs_interfaceid": "c458c481-1588-4776-a269-8f95b72195dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:23:3e,bridge_name='br-int',has_traffic_filtering=True,id=c458c481-1588-4776-a269-8f95b72195dd,network=Network(b5218514-0348-4dcc-8ecf-4595a87e204a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc458c481-15') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.objects.instance [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lazy-loading 'pci_devices' on Instance uuid fea802b7-64d9-4c77-87a7-eaba1dce5c22 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:29:21 user nova-compute[74996]:   <uuid>fea802b7-64d9-4c77-87a7-eaba1dce5c22</uuid>
Nov 02 01:29:21 user nova-compute[74996]:   <name>instance-00000003</name>
Nov 02 01:29:21 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:29:21 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:29:21 user nova-compute[74996]:   <metadata>
Nov 02 01:29:21 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:29:21 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:29:21 user nova-compute[74996]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1604386891</nova:name>
Nov 02 01:29:21 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:29:21</nova:creationTime>
Nov 02 01:29:21 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:29:21 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:29:21 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:29:21 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:29:21 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:29:21 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:29:21 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:29:21 user nova-compute[74996]:       <nova:owner>
Nov 02 01:29:21 user nova-compute[74996]:         <nova:user uuid="15affb427e9b4fb8873accf286510e14">tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member</nova:user>
Nov 02 01:29:21 user nova-compute[74996]:         <nova:project uuid="142161c2fae44bdea848619580195795">tempest-ServerBootFromVolumeStableRescueTest-1294190560</nova:project>
Nov 02 01:29:21 user nova-compute[74996]:       </nova:owner>
Nov 02 01:29:21 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:29:21 user nova-compute[74996]:       <nova:ports>
Nov 02 01:29:21 user nova-compute[74996]:         <nova:port uuid="c458c481-1588-4776-a269-8f95b72195dd">
Nov 02 01:29:21 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 02 01:29:21 user nova-compute[74996]:         </nova:port>
Nov 02 01:29:21 user nova-compute[74996]:       </nova:ports>
Nov 02 01:29:21 user nova-compute[74996]:     </nova:instance>
Nov 02 01:29:21 user nova-compute[74996]:   </metadata>
Nov 02 01:29:21 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:29:21 user nova-compute[74996]:     <system>
Nov 02 01:29:21 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:29:21 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:29:21 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:29:21 user nova-compute[74996]:       <entry name="serial">fea802b7-64d9-4c77-87a7-eaba1dce5c22</entry>
Nov 02 01:29:21 user nova-compute[74996]:       <entry name="uuid">fea802b7-64d9-4c77-87a7-eaba1dce5c22</entry>
Nov 02 01:29:21 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:29:21 user nova-compute[74996]:     </system>
Nov 02 01:29:21 user nova-compute[74996]:   </sysinfo>
Nov 02 01:29:21 user nova-compute[74996]:   <os>
Nov 02 01:29:21 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:29:21 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:29:21 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:29:21 user nova-compute[74996]:   </os>
Nov 02 01:29:21 user nova-compute[74996]:   <features>
Nov 02 01:29:21 user nova-compute[74996]:     <acpi/>
Nov 02 01:29:21 user nova-compute[74996]:     <apic/>
Nov 02 01:29:21 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:29:21 user nova-compute[74996]:   </features>
Nov 02 01:29:21 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:29:21 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:29:21 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:29:21 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:29:21 user nova-compute[74996]:   </clock>
Nov 02 01:29:21 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:29:21 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:29:21 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:29:21 user nova-compute[74996]:   </cpu>
Nov 02 01:29:21 user nova-compute[74996]:   <devices>
Nov 02 01:29:21 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:29:21 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:29:21 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk"/>
Nov 02 01:29:21 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:29:21 user nova-compute[74996]:     </disk>
Nov 02 01:29:21 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:29:21 user nova-compute[74996]:       <mac address="fa:16:3e:7f:23:3e"/>
Nov 02 01:29:21 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:29:21 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:29:21 user nova-compute[74996]:       <target dev="tapc458c481-15"/>
Nov 02 01:29:21 user nova-compute[74996]:     </interface>
Nov 02 01:29:21 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:29:21 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/console.log" append="off"/>
Nov 02 01:29:21 user nova-compute[74996]:     </serial>
Nov 02 01:29:21 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:29:21 user nova-compute[74996]:     <video>
Nov 02 01:29:21 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:29:21 user nova-compute[74996]:     </video>
Nov 02 01:29:21 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:29:21 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:29:21 user nova-compute[74996]:     </rng>
Nov 02 01:29:21 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:29:21 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:29:21 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:29:21 user nova-compute[74996]:     </memballoon>
Nov 02 01:29:21 user nova-compute[74996]:   </devices>
Nov 02 01:29:21 user nova-compute[74996]: </domain>
Nov 02 01:29:21 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:29:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1604386891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1604386891',id=3,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='142161c2fae44bdea848619580195795',ramdisk_id='',reservation_id='r-b6qt65yz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1294190560',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:29:15Z,user_data=None,user_id='15affb427e9b4fb8873accf286510e14',uuid=fea802b7-64d9-4c77-87a7-eaba1dce5c22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c458c481-1588-4776-a269-8f95b72195dd", "address": "fa:16:3e:7f:23:3e", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc458c481-15", "ovs_interfaceid": "c458c481-1588-4776-a269-8f95b72195dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Converting VIF {"id": "c458c481-1588-4776-a269-8f95b72195dd", "address": "fa:16:3e:7f:23:3e", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc458c481-15", "ovs_interfaceid": "c458c481-1588-4776-a269-8f95b72195dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:23:3e,bridge_name='br-int',has_traffic_filtering=True,id=c458c481-1588-4776-a269-8f95b72195dd,network=Network(b5218514-0348-4dcc-8ecf-4595a87e204a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc458c481-15') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG os_vif [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:23:3e,bridge_name='br-int',has_traffic_filtering=True,id=c458c481-1588-4776-a269-8f95b72195dd,network=Network(b5218514-0348-4dcc-8ecf-4595a87e204a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc458c481-15') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b23c15d-8be1-5ae8-8b28-e8bb65833561', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc458c481-15, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc458c481-15, col_values=(('qos', UUID('6c250c2a-80fa-460f-b82d-17e72e87a18a')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc458c481-15, col_values=(('external_ids', {'iface-id': 'c458c481-1588-4776-a269-8f95b72195dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:23:3e', 'vm-uuid': 'fea802b7-64d9-4c77-87a7-eaba1dce5c22'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:21 user nova-compute[74996]: INFO os_vif [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:23:3e,bridge_name='br-int',has_traffic_filtering=True,id=c458c481-1588-4776-a269-8f95b72195dd,network=Network(b5218514-0348-4dcc-8ecf-4595a87e204a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc458c481-15')
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:29:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] No VIF found with MAC fa:16:3e:7f:23:3e, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:29:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:23 user nova-compute[74996]: DEBUG nova.network.neutron [req-8cc9bd54-7551-4093-9b6f-9047b4bab9b4 req-7e33fbdb-d1c8-4354-b4a7-ca4d364c488f service nova] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Updated VIF entry in instance network info cache for port c458c481-1588-4776-a269-8f95b72195dd. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:29:23 user nova-compute[74996]: DEBUG nova.network.neutron [req-8cc9bd54-7551-4093-9b6f-9047b4bab9b4 req-7e33fbdb-d1c8-4354-b4a7-ca4d364c488f service nova] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Updating instance_info_cache with network_info: [{"id": "c458c481-1588-4776-a269-8f95b72195dd", "address": "fa:16:3e:7f:23:3e", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc458c481-15", "ovs_interfaceid": "c458c481-1588-4776-a269-8f95b72195dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:29:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8cc9bd54-7551-4093-9b6f-9047b4bab9b4 req-7e33fbdb-d1c8-4354-b4a7-ca4d364c488f service nova] Releasing lock "refresh_cache-fea802b7-64d9-4c77-87a7-eaba1dce5c22" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:29:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Acquiring lock "2621c5a2-acff-4055-9746-1b2f5829b39d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "2621c5a2-acff-4055-9746-1b2f5829b39d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:25 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:29:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:25 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:29:25 user nova-compute[74996]: INFO nova.compute.claims [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Claim successful on node user
Nov 02 01:29:25 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:29:25 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:29:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:25 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:29:25 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:29:25 user nova-compute[74996]: DEBUG nova.network.neutron [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:29:25 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:29:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:25 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:29:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:25 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:29:25 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:29:25 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Creating image(s)
Nov 02 01:29:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Acquiring lock "/opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "/opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "/opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:25 user nova-compute[74996]: DEBUG nova.policy [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '369a170aab0b4d3f9de0713b52798b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91486d1ff074f7599b5bc2e771e28d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:29:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.198s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.013s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.157s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk 1073741824" returned: 0 in 0.076s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.161s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:26 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:29:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:26 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Cannot resize image /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:29:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:29:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Ensure instance console log exists: /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:29:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:27 user nova-compute[74996]: DEBUG nova.network.neutron [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Successfully created port: c117844a-dde1-4486-940f-56b671a79d69 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:29:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.network.neutron [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Successfully updated port: c117844a-dde1-4486-940f-56b671a79d69 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Acquiring lock "refresh_cache-2621c5a2-acff-4055-9746-1b2f5829b39d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Acquired lock "refresh_cache-2621c5a2-acff-4055-9746-1b2f5829b39d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.network.neutron [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.compute.manager [req-b8d917ba-7f09-43d5-b5b9-54b7d710cb5f req-a7f612bc-563b-41e4-a667-6c57458bd934 service nova] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Received event network-vif-plugged-c458c481-1588-4776-a269-8f95b72195dd {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b8d917ba-7f09-43d5-b5b9-54b7d710cb5f req-a7f612bc-563b-41e4-a667-6c57458bd934 service nova] Acquiring lock "fea802b7-64d9-4c77-87a7-eaba1dce5c22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b8d917ba-7f09-43d5-b5b9-54b7d710cb5f req-a7f612bc-563b-41e4-a667-6c57458bd934 service nova] Lock "fea802b7-64d9-4c77-87a7-eaba1dce5c22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b8d917ba-7f09-43d5-b5b9-54b7d710cb5f req-a7f612bc-563b-41e4-a667-6c57458bd934 service nova] Lock "fea802b7-64d9-4c77-87a7-eaba1dce5c22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.compute.manager [req-b8d917ba-7f09-43d5-b5b9-54b7d710cb5f req-a7f612bc-563b-41e4-a667-6c57458bd934 service nova] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] No waiting events found dispatching network-vif-plugged-c458c481-1588-4776-a269-8f95b72195dd {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:29:29 user nova-compute[74996]: WARNING nova.compute.manager [req-b8d917ba-7f09-43d5-b5b9-54b7d710cb5f req-a7f612bc-563b-41e4-a667-6c57458bd934 service nova] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Received unexpected event network-vif-plugged-c458c481-1588-4776-a269-8f95b72195dd for instance with vm_state building and task_state spawning.
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.compute.manager [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:29:29 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Instance spawned successfully.
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.compute.manager [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.network.neutron [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.compute.manager [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.compute.manager [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:29:29 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Instance spawned successfully.
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:29:29 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Instance spawned successfully.
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:29 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Instance spawned successfully.
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:29 user nova-compute[74996]: INFO nova.compute.manager [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Took 15.54 seconds to spawn the instance on the hypervisor.
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.compute.manager [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:29:29 user nova-compute[74996]: INFO nova.compute.manager [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Took 15.91 seconds to spawn the instance on the hypervisor.
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.compute.manager [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:29:29 user nova-compute[74996]: INFO nova.compute.manager [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Took 13.90 seconds to spawn the instance on the hypervisor.
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.compute.manager [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:29:29 user nova-compute[74996]: INFO nova.compute.manager [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Took 14.38 seconds to spawn the instance on the hypervisor.
Nov 02 01:29:29 user nova-compute[74996]: DEBUG nova.compute.manager [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:29:29 user nova-compute[74996]: INFO nova.compute.manager [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Took 17.20 seconds to build instance.
Nov 02 01:29:29 user nova-compute[74996]: INFO nova.compute.manager [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Took 16.82 seconds to build instance.
Nov 02 01:29:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-555df718-2fae-4e98-aa33-39478b6d81e9 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "3983741f-270b-4758-a676-245b7adc8cc8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.594s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:29 user nova-compute[74996]: INFO nova.compute.manager [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Took 14.99 seconds to build instance.
Nov 02 01:29:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b9852b8b-1022-4851-bbcd-a86c4ad876c2 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.315s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:29 user nova-compute[74996]: INFO nova.compute.manager [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Took 15.94 seconds to build instance.
Nov 02 01:29:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9317a0ee-1194-4aac-b593-f3a28172f813 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "fea802b7-64d9-4c77-87a7-eaba1dce5c22" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.150s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-51a75222-f8de-41d4-ba43-7149992826af tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "7307f3a3-1ad1-43f7-be49-9cd03a626cd7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.335s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG nova.network.neutron [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Updating instance_info_cache with network_info: [{"id": "c117844a-dde1-4486-940f-56b671a79d69", "address": "fa:16:3e:90:c7:2d", "network": {"id": "8bca3600-c671-4a05-9913-14a9531365d1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2106930518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91486d1ff074f7599b5bc2e771e28d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc117844a-dd", "ovs_interfaceid": "c117844a-dde1-4486-940f-56b671a79d69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Releasing lock "refresh_cache-2621c5a2-acff-4055-9746-1b2f5829b39d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Instance network_info: |[{"id": "c117844a-dde1-4486-940f-56b671a79d69", "address": "fa:16:3e:90:c7:2d", "network": {"id": "8bca3600-c671-4a05-9913-14a9531365d1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2106930518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91486d1ff074f7599b5bc2e771e28d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc117844a-dd", "ovs_interfaceid": "c117844a-dde1-4486-940f-56b671a79d69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Start _get_guest_xml network_info=[{"id": "c117844a-dde1-4486-940f-56b671a79d69", "address": "fa:16:3e:90:c7:2d", "network": {"id": "8bca3600-c671-4a05-9913-14a9531365d1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2106930518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91486d1ff074f7599b5bc2e771e28d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc117844a-dd", "ovs_interfaceid": "c117844a-dde1-4486-940f-56b671a79d69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:29:30 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:29:30 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:29:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-603939195',display_name='tempest-VolumesAdminNegativeTest-server-603939195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-603939195',id=5,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAW0F9f6TDQcqJlm3J0zPG2j0UBnv2SWztmZTCCnSg9z3fYJ/TWFNOEtd49EX8JMMRemWCsC8Cm08rGumO7UZ/MhsM0MpHE0UuN7rQA8Ra9BV1xMDCq61t9QIuzJthGqjQ==',key_name='tempest-keypair-414965189',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f91486d1ff074f7599b5bc2e771e28d9',ramdisk_id='',reservation_id='r-2jfhtvei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1150311361',owner_user_name='tempest-VolumesAdminNegativeTest-1150311361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:29:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='369a170aab0b4d3f9de0713b52798b72',uuid=2621c5a2-acff-4055-9746-1b2f5829b39d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c117844a-dde1-4486-940f-56b671a79d69", "address": "fa:16:3e:90:c7:2d", "network": {"id": "8bca3600-c671-4a05-9913-14a9531365d1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2106930518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91486d1ff074f7599b5bc2e771e28d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc117844a-dd", "ovs_interfaceid": "c117844a-dde1-4486-940f-56b671a79d69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Converting VIF {"id": "c117844a-dde1-4486-940f-56b671a79d69", "address": "fa:16:3e:90:c7:2d", "network": {"id": "8bca3600-c671-4a05-9913-14a9531365d1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2106930518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91486d1ff074f7599b5bc2e771e28d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc117844a-dd", "ovs_interfaceid": "c117844a-dde1-4486-940f-56b671a79d69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:c7:2d,bridge_name='br-int',has_traffic_filtering=True,id=c117844a-dde1-4486-940f-56b671a79d69,network=Network(8bca3600-c671-4a05-9913-14a9531365d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc117844a-dd') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG nova.objects.instance [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lazy-loading 'pci_devices' on Instance uuid 2621c5a2-acff-4055-9746-1b2f5829b39d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:29:30 user nova-compute[74996]:   <uuid>2621c5a2-acff-4055-9746-1b2f5829b39d</uuid>
Nov 02 01:29:30 user nova-compute[74996]:   <name>instance-00000005</name>
Nov 02 01:29:30 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:29:30 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:29:30 user nova-compute[74996]:   <metadata>
Nov 02 01:29:30 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:29:30 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:29:30 user nova-compute[74996]:       <nova:name>tempest-VolumesAdminNegativeTest-server-603939195</nova:name>
Nov 02 01:29:30 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:29:30</nova:creationTime>
Nov 02 01:29:30 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:29:30 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:29:30 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:29:30 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:29:30 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:29:30 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:29:30 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:29:30 user nova-compute[74996]:       <nova:owner>
Nov 02 01:29:30 user nova-compute[74996]:         <nova:user uuid="369a170aab0b4d3f9de0713b52798b72">tempest-VolumesAdminNegativeTest-1150311361-project-member</nova:user>
Nov 02 01:29:30 user nova-compute[74996]:         <nova:project uuid="f91486d1ff074f7599b5bc2e771e28d9">tempest-VolumesAdminNegativeTest-1150311361</nova:project>
Nov 02 01:29:30 user nova-compute[74996]:       </nova:owner>
Nov 02 01:29:30 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:29:30 user nova-compute[74996]:       <nova:ports>
Nov 02 01:29:30 user nova-compute[74996]:         <nova:port uuid="c117844a-dde1-4486-940f-56b671a79d69">
Nov 02 01:29:30 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 01:29:30 user nova-compute[74996]:         </nova:port>
Nov 02 01:29:30 user nova-compute[74996]:       </nova:ports>
Nov 02 01:29:30 user nova-compute[74996]:     </nova:instance>
Nov 02 01:29:30 user nova-compute[74996]:   </metadata>
Nov 02 01:29:30 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:29:30 user nova-compute[74996]:     <system>
Nov 02 01:29:30 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:29:30 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:29:30 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:29:30 user nova-compute[74996]:       <entry name="serial">2621c5a2-acff-4055-9746-1b2f5829b39d</entry>
Nov 02 01:29:30 user nova-compute[74996]:       <entry name="uuid">2621c5a2-acff-4055-9746-1b2f5829b39d</entry>
Nov 02 01:29:30 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:29:30 user nova-compute[74996]:     </system>
Nov 02 01:29:30 user nova-compute[74996]:   </sysinfo>
Nov 02 01:29:30 user nova-compute[74996]:   <os>
Nov 02 01:29:30 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:29:30 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:29:30 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:29:30 user nova-compute[74996]:   </os>
Nov 02 01:29:30 user nova-compute[74996]:   <features>
Nov 02 01:29:30 user nova-compute[74996]:     <acpi/>
Nov 02 01:29:30 user nova-compute[74996]:     <apic/>
Nov 02 01:29:30 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:29:30 user nova-compute[74996]:   </features>
Nov 02 01:29:30 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:29:30 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:29:30 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:29:30 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:29:30 user nova-compute[74996]:   </clock>
Nov 02 01:29:30 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:29:30 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:29:30 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:29:30 user nova-compute[74996]:   </cpu>
Nov 02 01:29:30 user nova-compute[74996]:   <devices>
Nov 02 01:29:30 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:29:30 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:29:30 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk"/>
Nov 02 01:29:30 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:29:30 user nova-compute[74996]:     </disk>
Nov 02 01:29:30 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:29:30 user nova-compute[74996]:       <mac address="fa:16:3e:90:c7:2d"/>
Nov 02 01:29:30 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:29:30 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:29:30 user nova-compute[74996]:       <target dev="tapc117844a-dd"/>
Nov 02 01:29:30 user nova-compute[74996]:     </interface>
Nov 02 01:29:30 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:29:30 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/console.log" append="off"/>
Nov 02 01:29:30 user nova-compute[74996]:     </serial>
Nov 02 01:29:30 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:29:30 user nova-compute[74996]:     <video>
Nov 02 01:29:30 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:29:30 user nova-compute[74996]:     </video>
Nov 02 01:29:30 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:29:30 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:29:30 user nova-compute[74996]:     </rng>
Nov 02 01:29:30 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:29:30 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:29:30 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:29:30 user nova-compute[74996]:     </memballoon>
Nov 02 01:29:30 user nova-compute[74996]:   </devices>
Nov 02 01:29:30 user nova-compute[74996]: </domain>
Nov 02 01:29:30 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-603939195',display_name='tempest-VolumesAdminNegativeTest-server-603939195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-603939195',id=5,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAW0F9f6TDQcqJlm3J0zPG2j0UBnv2SWztmZTCCnSg9z3fYJ/TWFNOEtd49EX8JMMRemWCsC8Cm08rGumO7UZ/MhsM0MpHE0UuN7rQA8Ra9BV1xMDCq61t9QIuzJthGqjQ==',key_name='tempest-keypair-414965189',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f91486d1ff074f7599b5bc2e771e28d9',ramdisk_id='',reservation_id='r-2jfhtvei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1150311361',owner_user_name='tempest-VolumesAdminNegativeTest-1150311361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:29:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='369a170aab0b4d3f9de0713b52798b72',uuid=2621c5a2-acff-4055-9746-1b2f5829b39d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c117844a-dde1-4486-940f-56b671a79d69", "address": "fa:16:3e:90:c7:2d", "network": {"id": "8bca3600-c671-4a05-9913-14a9531365d1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2106930518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91486d1ff074f7599b5bc2e771e28d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc117844a-dd", "ovs_interfaceid": "c117844a-dde1-4486-940f-56b671a79d69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Converting VIF {"id": "c117844a-dde1-4486-940f-56b671a79d69", "address": "fa:16:3e:90:c7:2d", "network": {"id": "8bca3600-c671-4a05-9913-14a9531365d1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2106930518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91486d1ff074f7599b5bc2e771e28d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc117844a-dd", "ovs_interfaceid": "c117844a-dde1-4486-940f-56b671a79d69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:c7:2d,bridge_name='br-int',has_traffic_filtering=True,id=c117844a-dde1-4486-940f-56b671a79d69,network=Network(8bca3600-c671-4a05-9913-14a9531365d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc117844a-dd') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG os_vif [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:c7:2d,bridge_name='br-int',has_traffic_filtering=True,id=c117844a-dde1-4486-940f-56b671a79d69,network=Network(8bca3600-c671-4a05-9913-14a9531365d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc117844a-dd') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '294c6fbe-8675-51c7-81b1-a730e9a87a68', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc117844a-dd, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc117844a-dd, col_values=(('qos', UUID('8702ecd0-524e-4f06-bd0f-79c4240107cb')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc117844a-dd, col_values=(('external_ids', {'iface-id': 'c117844a-dde1-4486-940f-56b671a79d69', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:c7:2d', 'vm-uuid': '2621c5a2-acff-4055-9746-1b2f5829b39d'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:30 user nova-compute[74996]: INFO os_vif [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:c7:2d,bridge_name='br-int',has_traffic_filtering=True,id=c117844a-dde1-4486-940f-56b671a79d69,network=Network(8bca3600-c671-4a05-9913-14a9531365d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc117844a-dd')
Nov 02 01:29:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] No VIF found with MAC fa:16:3e:90:c7:2d, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:29:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:31 user nova-compute[74996]: DEBUG nova.compute.manager [req-ae17b577-a6b2-482e-8100-f55fe13b60fc req-e1c9ea52-41cd-40e8-868e-a7975e03f38d service nova] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Received event network-changed-c117844a-dde1-4486-940f-56b671a79d69 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:29:31 user nova-compute[74996]: DEBUG nova.compute.manager [req-ae17b577-a6b2-482e-8100-f55fe13b60fc req-e1c9ea52-41cd-40e8-868e-a7975e03f38d service nova] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Refreshing instance network info cache due to event network-changed-c117844a-dde1-4486-940f-56b671a79d69. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:29:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ae17b577-a6b2-482e-8100-f55fe13b60fc req-e1c9ea52-41cd-40e8-868e-a7975e03f38d service nova] Acquiring lock "refresh_cache-2621c5a2-acff-4055-9746-1b2f5829b39d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:29:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ae17b577-a6b2-482e-8100-f55fe13b60fc req-e1c9ea52-41cd-40e8-868e-a7975e03f38d service nova] Acquired lock "refresh_cache-2621c5a2-acff-4055-9746-1b2f5829b39d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:29:31 user nova-compute[74996]: DEBUG nova.network.neutron [req-ae17b577-a6b2-482e-8100-f55fe13b60fc req-e1c9ea52-41cd-40e8-868e-a7975e03f38d service nova] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Refreshing network info cache for port c117844a-dde1-4486-940f-56b671a79d69 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:29:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:33 user nova-compute[74996]: DEBUG nova.network.neutron [req-ae17b577-a6b2-482e-8100-f55fe13b60fc req-e1c9ea52-41cd-40e8-868e-a7975e03f38d service nova] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Updated VIF entry in instance network info cache for port c117844a-dde1-4486-940f-56b671a79d69. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:29:33 user nova-compute[74996]: DEBUG nova.network.neutron [req-ae17b577-a6b2-482e-8100-f55fe13b60fc req-e1c9ea52-41cd-40e8-868e-a7975e03f38d service nova] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Updating instance_info_cache with network_info: [{"id": "c117844a-dde1-4486-940f-56b671a79d69", "address": "fa:16:3e:90:c7:2d", "network": {"id": "8bca3600-c671-4a05-9913-14a9531365d1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2106930518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91486d1ff074f7599b5bc2e771e28d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc117844a-dd", "ovs_interfaceid": "c117844a-dde1-4486-940f-56b671a79d69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:29:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ae17b577-a6b2-482e-8100-f55fe13b60fc req-e1c9ea52-41cd-40e8-868e-a7975e03f38d service nova] Releasing lock "refresh_cache-2621c5a2-acff-4055-9746-1b2f5829b39d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:29:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-ae17b577-a6b2-482e-8100-f55fe13b60fc req-e1c9ea52-41cd-40e8-868e-a7975e03f38d service nova] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Received event network-vif-plugged-c458c481-1588-4776-a269-8f95b72195dd {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:29:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ae17b577-a6b2-482e-8100-f55fe13b60fc req-e1c9ea52-41cd-40e8-868e-a7975e03f38d service nova] Acquiring lock "fea802b7-64d9-4c77-87a7-eaba1dce5c22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ae17b577-a6b2-482e-8100-f55fe13b60fc req-e1c9ea52-41cd-40e8-868e-a7975e03f38d service nova] Lock "fea802b7-64d9-4c77-87a7-eaba1dce5c22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ae17b577-a6b2-482e-8100-f55fe13b60fc req-e1c9ea52-41cd-40e8-868e-a7975e03f38d service nova] Lock "fea802b7-64d9-4c77-87a7-eaba1dce5c22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-ae17b577-a6b2-482e-8100-f55fe13b60fc req-e1c9ea52-41cd-40e8-868e-a7975e03f38d service nova] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] No waiting events found dispatching network-vif-plugged-c458c481-1588-4776-a269-8f95b72195dd {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:29:33 user nova-compute[74996]: WARNING nova.compute.manager [req-ae17b577-a6b2-482e-8100-f55fe13b60fc req-e1c9ea52-41cd-40e8-868e-a7975e03f38d service nova] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Received unexpected event network-vif-plugged-c458c481-1588-4776-a269-8f95b72195dd for instance with vm_state active and task_state None.
Nov 02 01:29:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-ae17b577-a6b2-482e-8100-f55fe13b60fc req-e1c9ea52-41cd-40e8-868e-a7975e03f38d service nova] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Received event network-vif-plugged-975424fa-4f7a-4483-bf55-e66c9f95f2b5 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:29:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ae17b577-a6b2-482e-8100-f55fe13b60fc req-e1c9ea52-41cd-40e8-868e-a7975e03f38d service nova] Acquiring lock "3983741f-270b-4758-a676-245b7adc8cc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ae17b577-a6b2-482e-8100-f55fe13b60fc req-e1c9ea52-41cd-40e8-868e-a7975e03f38d service nova] Lock "3983741f-270b-4758-a676-245b7adc8cc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ae17b577-a6b2-482e-8100-f55fe13b60fc req-e1c9ea52-41cd-40e8-868e-a7975e03f38d service nova] Lock "3983741f-270b-4758-a676-245b7adc8cc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-ae17b577-a6b2-482e-8100-f55fe13b60fc req-e1c9ea52-41cd-40e8-868e-a7975e03f38d service nova] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] No waiting events found dispatching network-vif-plugged-975424fa-4f7a-4483-bf55-e66c9f95f2b5 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:29:33 user nova-compute[74996]: WARNING nova.compute.manager [req-ae17b577-a6b2-482e-8100-f55fe13b60fc req-e1c9ea52-41cd-40e8-868e-a7975e03f38d service nova] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Received unexpected event network-vif-plugged-975424fa-4f7a-4483-bf55-e66c9f95f2b5 for instance with vm_state active and task_state None.
Nov 02 01:29:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-ae17b577-a6b2-482e-8100-f55fe13b60fc req-e1c9ea52-41cd-40e8-868e-a7975e03f38d service nova] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Received event network-vif-plugged-975424fa-4f7a-4483-bf55-e66c9f95f2b5 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:29:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ae17b577-a6b2-482e-8100-f55fe13b60fc req-e1c9ea52-41cd-40e8-868e-a7975e03f38d service nova] Acquiring lock "3983741f-270b-4758-a676-245b7adc8cc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ae17b577-a6b2-482e-8100-f55fe13b60fc req-e1c9ea52-41cd-40e8-868e-a7975e03f38d service nova] Lock "3983741f-270b-4758-a676-245b7adc8cc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ae17b577-a6b2-482e-8100-f55fe13b60fc req-e1c9ea52-41cd-40e8-868e-a7975e03f38d service nova] Lock "3983741f-270b-4758-a676-245b7adc8cc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-ae17b577-a6b2-482e-8100-f55fe13b60fc req-e1c9ea52-41cd-40e8-868e-a7975e03f38d service nova] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] No waiting events found dispatching network-vif-plugged-975424fa-4f7a-4483-bf55-e66c9f95f2b5 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:29:33 user nova-compute[74996]: WARNING nova.compute.manager [req-ae17b577-a6b2-482e-8100-f55fe13b60fc req-e1c9ea52-41cd-40e8-868e-a7975e03f38d service nova] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Received unexpected event network-vif-plugged-975424fa-4f7a-4483-bf55-e66c9f95f2b5 for instance with vm_state active and task_state None.
Nov 02 01:29:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:35 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:29:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:29:35 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Instance spawned successfully.
Nov 02 01:29:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:29:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:36 user nova-compute[74996]: INFO nova.compute.manager [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Took 10.14 seconds to spawn the instance on the hypervisor.
Nov 02 01:29:36 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:29:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:36 user nova-compute[74996]: INFO nova.compute.manager [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Took 11.09 seconds to build instance.
Nov 02 01:29:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a3c926e3-3bcf-4554-893b-d2dfa6cd1c32 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "2621c5a2-acff-4055-9746-1b2f5829b39d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.243s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-65f1fa54-b2f8-4cd3-8929-5e448b9109c2 req-06fbf36f-2186-4a23-9480-ace8b76afaf6 service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Received event network-vif-plugged-b645a26c-6fae-4cfc-97ee-951a1cf5aec9 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:29:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-65f1fa54-b2f8-4cd3-8929-5e448b9109c2 req-06fbf36f-2186-4a23-9480-ace8b76afaf6 service nova] Acquiring lock "7307f3a3-1ad1-43f7-be49-9cd03a626cd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-65f1fa54-b2f8-4cd3-8929-5e448b9109c2 req-06fbf36f-2186-4a23-9480-ace8b76afaf6 service nova] Lock "7307f3a3-1ad1-43f7-be49-9cd03a626cd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-65f1fa54-b2f8-4cd3-8929-5e448b9109c2 req-06fbf36f-2186-4a23-9480-ace8b76afaf6 service nova] Lock "7307f3a3-1ad1-43f7-be49-9cd03a626cd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-65f1fa54-b2f8-4cd3-8929-5e448b9109c2 req-06fbf36f-2186-4a23-9480-ace8b76afaf6 service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] No waiting events found dispatching network-vif-plugged-b645a26c-6fae-4cfc-97ee-951a1cf5aec9 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:29:36 user nova-compute[74996]: WARNING nova.compute.manager [req-65f1fa54-b2f8-4cd3-8929-5e448b9109c2 req-06fbf36f-2186-4a23-9480-ace8b76afaf6 service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Received unexpected event network-vif-plugged-b645a26c-6fae-4cfc-97ee-951a1cf5aec9 for instance with vm_state active and task_state None.
Nov 02 01:29:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:38 user nova-compute[74996]: DEBUG nova.compute.manager [req-f8c76118-2c5b-4ebc-a5b3-694130f977e9 req-446efce4-b433-4adb-aaad-e03a3b7c488b service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Received event network-vif-plugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:29:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f8c76118-2c5b-4ebc-a5b3-694130f977e9 req-446efce4-b433-4adb-aaad-e03a3b7c488b service nova] Acquiring lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f8c76118-2c5b-4ebc-a5b3-694130f977e9 req-446efce4-b433-4adb-aaad-e03a3b7c488b service nova] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f8c76118-2c5b-4ebc-a5b3-694130f977e9 req-446efce4-b433-4adb-aaad-e03a3b7c488b service nova] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:38 user nova-compute[74996]: DEBUG nova.compute.manager [req-f8c76118-2c5b-4ebc-a5b3-694130f977e9 req-446efce4-b433-4adb-aaad-e03a3b7c488b service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] No waiting events found dispatching network-vif-plugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:29:38 user nova-compute[74996]: WARNING nova.compute.manager [req-f8c76118-2c5b-4ebc-a5b3-694130f977e9 req-446efce4-b433-4adb-aaad-e03a3b7c488b service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Received unexpected event network-vif-plugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad for instance with vm_state active and task_state None.
Nov 02 01:29:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:39 user nova-compute[74996]: DEBUG nova.compute.manager [req-42654093-30cb-4952-9f19-0a682bb34f6a req-ec2d4d96-db67-4c7e-ac98-ef179e615519 service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Received event network-vif-plugged-b645a26c-6fae-4cfc-97ee-951a1cf5aec9 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:29:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-42654093-30cb-4952-9f19-0a682bb34f6a req-ec2d4d96-db67-4c7e-ac98-ef179e615519 service nova] Acquiring lock "7307f3a3-1ad1-43f7-be49-9cd03a626cd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-42654093-30cb-4952-9f19-0a682bb34f6a req-ec2d4d96-db67-4c7e-ac98-ef179e615519 service nova] Lock "7307f3a3-1ad1-43f7-be49-9cd03a626cd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-42654093-30cb-4952-9f19-0a682bb34f6a req-ec2d4d96-db67-4c7e-ac98-ef179e615519 service nova] Lock "7307f3a3-1ad1-43f7-be49-9cd03a626cd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:39 user nova-compute[74996]: DEBUG nova.compute.manager [req-42654093-30cb-4952-9f19-0a682bb34f6a req-ec2d4d96-db67-4c7e-ac98-ef179e615519 service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] No waiting events found dispatching network-vif-plugged-b645a26c-6fae-4cfc-97ee-951a1cf5aec9 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:29:39 user nova-compute[74996]: WARNING nova.compute.manager [req-42654093-30cb-4952-9f19-0a682bb34f6a req-ec2d4d96-db67-4c7e-ac98-ef179e615519 service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Received unexpected event network-vif-plugged-b645a26c-6fae-4cfc-97ee-951a1cf5aec9 for instance with vm_state active and task_state None.
Nov 02 01:29:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Acquiring lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:40 user nova-compute[74996]: DEBUG nova.compute.manager [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:29:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:40 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:29:40 user nova-compute[74996]: INFO nova.compute.claims [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Claim successful on node user
Nov 02 01:29:40 user nova-compute[74996]: DEBUG nova.compute.manager [req-2fcb82f1-ae44-438a-9a3e-4ae590fd5995 req-0404fa15-5e9e-4d6c-ba71-09a8ca84efd0 service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Received event network-vif-plugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:29:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2fcb82f1-ae44-438a-9a3e-4ae590fd5995 req-0404fa15-5e9e-4d6c-ba71-09a8ca84efd0 service nova] Acquiring lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2fcb82f1-ae44-438a-9a3e-4ae590fd5995 req-0404fa15-5e9e-4d6c-ba71-09a8ca84efd0 service nova] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2fcb82f1-ae44-438a-9a3e-4ae590fd5995 req-0404fa15-5e9e-4d6c-ba71-09a8ca84efd0 service nova] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:40 user nova-compute[74996]: DEBUG nova.compute.manager [req-2fcb82f1-ae44-438a-9a3e-4ae590fd5995 req-0404fa15-5e9e-4d6c-ba71-09a8ca84efd0 service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] No waiting events found dispatching network-vif-plugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:29:40 user nova-compute[74996]: WARNING nova.compute.manager [req-2fcb82f1-ae44-438a-9a3e-4ae590fd5995 req-0404fa15-5e9e-4d6c-ba71-09a8ca84efd0 service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Received unexpected event network-vif-plugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad for instance with vm_state active and task_state None.
Nov 02 01:29:40 user nova-compute[74996]: DEBUG nova.compute.manager [req-2fcb82f1-ae44-438a-9a3e-4ae590fd5995 req-0404fa15-5e9e-4d6c-ba71-09a8ca84efd0 service nova] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Received event network-vif-plugged-c117844a-dde1-4486-940f-56b671a79d69 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:29:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2fcb82f1-ae44-438a-9a3e-4ae590fd5995 req-0404fa15-5e9e-4d6c-ba71-09a8ca84efd0 service nova] Acquiring lock "2621c5a2-acff-4055-9746-1b2f5829b39d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2fcb82f1-ae44-438a-9a3e-4ae590fd5995 req-0404fa15-5e9e-4d6c-ba71-09a8ca84efd0 service nova] Lock "2621c5a2-acff-4055-9746-1b2f5829b39d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2fcb82f1-ae44-438a-9a3e-4ae590fd5995 req-0404fa15-5e9e-4d6c-ba71-09a8ca84efd0 service nova] Lock "2621c5a2-acff-4055-9746-1b2f5829b39d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:40 user nova-compute[74996]: DEBUG nova.compute.manager [req-2fcb82f1-ae44-438a-9a3e-4ae590fd5995 req-0404fa15-5e9e-4d6c-ba71-09a8ca84efd0 service nova] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] No waiting events found dispatching network-vif-plugged-c117844a-dde1-4486-940f-56b671a79d69 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:29:40 user nova-compute[74996]: WARNING nova.compute.manager [req-2fcb82f1-ae44-438a-9a3e-4ae590fd5995 req-0404fa15-5e9e-4d6c-ba71-09a8ca84efd0 service nova] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Received unexpected event network-vif-plugged-c117844a-dde1-4486-940f-56b671a79d69 for instance with vm_state active and task_state None.
Nov 02 01:29:40 user nova-compute[74996]: DEBUG nova.compute.manager [req-2fcb82f1-ae44-438a-9a3e-4ae590fd5995 req-0404fa15-5e9e-4d6c-ba71-09a8ca84efd0 service nova] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Received event network-vif-plugged-c117844a-dde1-4486-940f-56b671a79d69 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:29:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2fcb82f1-ae44-438a-9a3e-4ae590fd5995 req-0404fa15-5e9e-4d6c-ba71-09a8ca84efd0 service nova] Acquiring lock "2621c5a2-acff-4055-9746-1b2f5829b39d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2fcb82f1-ae44-438a-9a3e-4ae590fd5995 req-0404fa15-5e9e-4d6c-ba71-09a8ca84efd0 service nova] Lock "2621c5a2-acff-4055-9746-1b2f5829b39d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2fcb82f1-ae44-438a-9a3e-4ae590fd5995 req-0404fa15-5e9e-4d6c-ba71-09a8ca84efd0 service nova] Lock "2621c5a2-acff-4055-9746-1b2f5829b39d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:40 user nova-compute[74996]: DEBUG nova.compute.manager [req-2fcb82f1-ae44-438a-9a3e-4ae590fd5995 req-0404fa15-5e9e-4d6c-ba71-09a8ca84efd0 service nova] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] No waiting events found dispatching network-vif-plugged-c117844a-dde1-4486-940f-56b671a79d69 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:29:40 user nova-compute[74996]: WARNING nova.compute.manager [req-2fcb82f1-ae44-438a-9a3e-4ae590fd5995 req-0404fa15-5e9e-4d6c-ba71-09a8ca84efd0 service nova] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Received unexpected event network-vif-plugged-c117844a-dde1-4486-940f-56b671a79d69 for instance with vm_state active and task_state None.
Nov 02 01:29:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:40 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:29:40 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:29:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:40 user nova-compute[74996]: DEBUG nova.compute.manager [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:29:40 user nova-compute[74996]: DEBUG nova.compute.manager [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:29:40 user nova-compute[74996]: DEBUG nova.network.neutron [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:29:40 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 02 01:29:40 user nova-compute[74996]: DEBUG nova.compute.manager [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:29:41 user nova-compute[74996]: DEBUG nova.policy [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b16f949e8d524b4d9e90d454fece5f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6782fc20434d9d9d40527985ce3ad1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:29:41 user nova-compute[74996]: DEBUG nova.compute.manager [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:29:41 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:29:41 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Creating image(s)
Nov 02 01:29:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Acquiring lock "/opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "/opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "/opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Acquiring lock "3d032a2ff47563bbe3779f90684970680f864932" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "3d032a2ff47563bbe3779f90684970680f864932" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d032a2ff47563bbe3779f90684970680f864932.part --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d032a2ff47563bbe3779f90684970680f864932.part --force-share --output=json" returned: 0 in 0.242s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:41 user nova-compute[74996]: DEBUG nova.virt.images [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] 38584735-89a5-4264-95ed-0ada33f021d7 was qcow2, converting to raw {{(pid=74996) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 01:29:41 user nova-compute[74996]: DEBUG nova.privsep.utils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74996) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 01:29:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3d032a2ff47563bbe3779f90684970680f864932.part /opt/stack/data/nova/instances/_base/3d032a2ff47563bbe3779f90684970680f864932.converted {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3d032a2ff47563bbe3779f90684970680f864932.part /opt/stack/data/nova/instances/_base/3d032a2ff47563bbe3779f90684970680f864932.converted" returned: 0 in 0.227s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d032a2ff47563bbe3779f90684970680f864932.converted --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d032a2ff47563bbe3779f90684970680f864932.converted --force-share --output=json" returned: 0 in 0.240s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "3d032a2ff47563bbe3779f90684970680f864932" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.250s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d032a2ff47563bbe3779f90684970680f864932 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:42 user nova-compute[74996]: DEBUG nova.network.neutron [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Successfully created port: 7ee7d00e-996e-4ba6-9a7d-642404d24f74 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:29:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d032a2ff47563bbe3779f90684970680f864932 --force-share --output=json" returned: 0 in 0.233s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Acquiring lock "3d032a2ff47563bbe3779f90684970680f864932" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "3d032a2ff47563bbe3779f90684970680f864932" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d032a2ff47563bbe3779f90684970680f864932 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d032a2ff47563bbe3779f90684970680f864932 --force-share --output=json" returned: 0 in 0.257s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3d032a2ff47563bbe3779f90684970680f864932,backing_fmt=raw /opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3d032a2ff47563bbe3779f90684970680f864932,backing_fmt=raw /opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627/disk 1073741824" returned: 0 in 0.058s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "3d032a2ff47563bbe3779f90684970680f864932" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d032a2ff47563bbe3779f90684970680f864932 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d032a2ff47563bbe3779f90684970680f864932 --force-share --output=json" returned: 0 in 0.204s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:43 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Checking if we can resize image /opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:29:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627/disk --force-share --output=json" returned: 0 in 0.351s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:43 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Cannot resize image /opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:29:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:29:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Ensure instance console log exists: /opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:29:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:44 user nova-compute[74996]: DEBUG nova.network.neutron [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Successfully updated port: 7ee7d00e-996e-4ba6-9a7d-642404d24f74 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:29:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Acquiring lock "refresh_cache-23ba82cb-ec9d-4b96-b205-3d9ac6bc8627" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:29:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Acquired lock "refresh_cache-23ba82cb-ec9d-4b96-b205-3d9ac6bc8627" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:29:44 user nova-compute[74996]: DEBUG nova.network.neutron [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:29:44 user nova-compute[74996]: DEBUG nova.compute.manager [req-1d5c6818-32a5-4890-8d31-7e36ef874c86 req-a18ae46c-ba47-4de3-9fd8-8ece17fb1362 service nova] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Received event network-changed-7ee7d00e-996e-4ba6-9a7d-642404d24f74 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:29:44 user nova-compute[74996]: DEBUG nova.compute.manager [req-1d5c6818-32a5-4890-8d31-7e36ef874c86 req-a18ae46c-ba47-4de3-9fd8-8ece17fb1362 service nova] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Refreshing instance network info cache due to event network-changed-7ee7d00e-996e-4ba6-9a7d-642404d24f74. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:29:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1d5c6818-32a5-4890-8d31-7e36ef874c86 req-a18ae46c-ba47-4de3-9fd8-8ece17fb1362 service nova] Acquiring lock "refresh_cache-23ba82cb-ec9d-4b96-b205-3d9ac6bc8627" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:29:44 user nova-compute[74996]: DEBUG nova.network.neutron [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.network.neutron [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Updating instance_info_cache with network_info: [{"id": "7ee7d00e-996e-4ba6-9a7d-642404d24f74", "address": "fa:16:3e:d4:2e:a5", "network": {"id": "d4db391d-89bd-4b81-8521-e90539933295", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-627212228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd6782fc20434d9d9d40527985ce3ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee7d00e-99", "ovs_interfaceid": "7ee7d00e-996e-4ba6-9a7d-642404d24f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Releasing lock "refresh_cache-23ba82cb-ec9d-4b96-b205-3d9ac6bc8627" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.compute.manager [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Instance network_info: |[{"id": "7ee7d00e-996e-4ba6-9a7d-642404d24f74", "address": "fa:16:3e:d4:2e:a5", "network": {"id": "d4db391d-89bd-4b81-8521-e90539933295", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-627212228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd6782fc20434d9d9d40527985ce3ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee7d00e-99", "ovs_interfaceid": "7ee7d00e-996e-4ba6-9a7d-642404d24f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1d5c6818-32a5-4890-8d31-7e36ef874c86 req-a18ae46c-ba47-4de3-9fd8-8ece17fb1362 service nova] Acquired lock "refresh_cache-23ba82cb-ec9d-4b96-b205-3d9ac6bc8627" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.network.neutron [req-1d5c6818-32a5-4890-8d31-7e36ef874c86 req-a18ae46c-ba47-4de3-9fd8-8ece17fb1362 service nova] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Refreshing network info cache for port 7ee7d00e-996e-4ba6-9a7d-642404d24f74 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Start _get_guest_xml network_info=[{"id": "7ee7d00e-996e-4ba6-9a7d-642404d24f74", "address": "fa:16:3e:d4:2e:a5", "network": {"id": "d4db391d-89bd-4b81-8521-e90539933295", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-627212228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd6782fc20434d9d9d40527985ce3ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee7d00e-99", "ovs_interfaceid": "7ee7d00e-996e-4ba6-9a7d-642404d24f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:29:30Z,direct_url=<?>,disk_format='qcow2',id=38584735-89a5-4264-95ed-0ada33f021d7,min_disk=0,min_ram=0,name='',owner='25765af8803c4fe09919dc1ee020a523',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:29:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_options': None, 'device_name': '/dev/sda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'scsi', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': '38584735-89a5-4264-95ed-0ada33f021d7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:29:45 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:29:45 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:29:30Z,direct_url=<?>,disk_format='qcow2',id=38584735-89a5-4264-95ed-0ada33f021d7,min_disk=0,min_ram=0,name='',owner='25765af8803c4fe09919dc1ee020a523',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:29:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:29:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1230440666',display_name='tempest-AttachSCSIVolumeTestJSON-server-1230440666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1230440666',id=6,image_ref='38584735-89a5-4264-95ed-0ada33f021d7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbga3R/IqjULzAeMX4I/gKpUltHYg4EoAdpyRT7+gJ2bkaOEq7dy80LcBUgyqfU7Wzqq+Ec95lSs3dey7EGZj/0cVTMQ6m1uk/X2fQ7CZoPdeg2lIDYkN80h7Pa0KurxA==',key_name='tempest-keypair-1396152305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd6782fc20434d9d9d40527985ce3ad1',ramdisk_id='',reservation_id='r-04hsn70y',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='38584735-89a5-4264-95ed-0ada33f021d7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-651942675',owner_user_name='tempest-AttachSCSIVolumeTestJSON-651942675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:29:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b16f949e8d524b4d9e90d454fece5f26',uuid=23ba82cb-ec9d-4b96-b205-3d9ac6bc8627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ee7d00e-996e-4ba6-9a7d-642404d24f74", "address": "fa:16:3e:d4:2e:a5", "network": {"id": "d4db391d-89bd-4b81-8521-e90539933295", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-627212228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd6782fc20434d9d9d40527985ce3ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee7d00e-99", "ovs_interfaceid": "7ee7d00e-996e-4ba6-9a7d-642404d24f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Converting VIF {"id": "7ee7d00e-996e-4ba6-9a7d-642404d24f74", "address": "fa:16:3e:d4:2e:a5", "network": {"id": "d4db391d-89bd-4b81-8521-e90539933295", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-627212228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd6782fc20434d9d9d40527985ce3ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee7d00e-99", "ovs_interfaceid": "7ee7d00e-996e-4ba6-9a7d-642404d24f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:2e:a5,bridge_name='br-int',has_traffic_filtering=True,id=7ee7d00e-996e-4ba6-9a7d-642404d24f74,network=Network(d4db391d-89bd-4b81-8521-e90539933295),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee7d00e-99') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.objects.instance [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lazy-loading 'pci_devices' on Instance uuid 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:29:45 user nova-compute[74996]:   <uuid>23ba82cb-ec9d-4b96-b205-3d9ac6bc8627</uuid>
Nov 02 01:29:45 user nova-compute[74996]:   <name>instance-00000006</name>
Nov 02 01:29:45 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:29:45 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:29:45 user nova-compute[74996]:   <metadata>
Nov 02 01:29:45 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:29:45 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:29:45 user nova-compute[74996]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1230440666</nova:name>
Nov 02 01:29:45 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:29:45</nova:creationTime>
Nov 02 01:29:45 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:29:45 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:29:45 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:29:45 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:29:45 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:29:45 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:29:45 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:29:45 user nova-compute[74996]:       <nova:owner>
Nov 02 01:29:45 user nova-compute[74996]:         <nova:user uuid="b16f949e8d524b4d9e90d454fece5f26">tempest-AttachSCSIVolumeTestJSON-651942675-project-member</nova:user>
Nov 02 01:29:45 user nova-compute[74996]:         <nova:project uuid="dd6782fc20434d9d9d40527985ce3ad1">tempest-AttachSCSIVolumeTestJSON-651942675</nova:project>
Nov 02 01:29:45 user nova-compute[74996]:       </nova:owner>
Nov 02 01:29:45 user nova-compute[74996]:       <nova:root type="image" uuid="38584735-89a5-4264-95ed-0ada33f021d7"/>
Nov 02 01:29:45 user nova-compute[74996]:       <nova:ports>
Nov 02 01:29:45 user nova-compute[74996]:         <nova:port uuid="7ee7d00e-996e-4ba6-9a7d-642404d24f74">
Nov 02 01:29:45 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 02 01:29:45 user nova-compute[74996]:         </nova:port>
Nov 02 01:29:45 user nova-compute[74996]:       </nova:ports>
Nov 02 01:29:45 user nova-compute[74996]:     </nova:instance>
Nov 02 01:29:45 user nova-compute[74996]:   </metadata>
Nov 02 01:29:45 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:29:45 user nova-compute[74996]:     <system>
Nov 02 01:29:45 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:29:45 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:29:45 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:29:45 user nova-compute[74996]:       <entry name="serial">23ba82cb-ec9d-4b96-b205-3d9ac6bc8627</entry>
Nov 02 01:29:45 user nova-compute[74996]:       <entry name="uuid">23ba82cb-ec9d-4b96-b205-3d9ac6bc8627</entry>
Nov 02 01:29:45 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:29:45 user nova-compute[74996]:     </system>
Nov 02 01:29:45 user nova-compute[74996]:   </sysinfo>
Nov 02 01:29:45 user nova-compute[74996]:   <os>
Nov 02 01:29:45 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:29:45 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:29:45 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:29:45 user nova-compute[74996]:   </os>
Nov 02 01:29:45 user nova-compute[74996]:   <features>
Nov 02 01:29:45 user nova-compute[74996]:     <acpi/>
Nov 02 01:29:45 user nova-compute[74996]:     <apic/>
Nov 02 01:29:45 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:29:45 user nova-compute[74996]:   </features>
Nov 02 01:29:45 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:29:45 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:29:45 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:29:45 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:29:45 user nova-compute[74996]:   </clock>
Nov 02 01:29:45 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:29:45 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:29:45 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:29:45 user nova-compute[74996]:   </cpu>
Nov 02 01:29:45 user nova-compute[74996]:   <devices>
Nov 02 01:29:45 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:29:45 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:29:45 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627/disk"/>
Nov 02 01:29:45 user nova-compute[74996]:       <target dev="sda" bus="scsi"/>
Nov 02 01:29:45 user nova-compute[74996]:       <address type="drive" controller="0" unit="0"/>
Nov 02 01:29:45 user nova-compute[74996]:     </disk>
Nov 02 01:29:45 user nova-compute[74996]:     <disk type="file" device="cdrom">
Nov 02 01:29:45 user nova-compute[74996]:       <driver name="qemu" type="raw" cache="none"/>
Nov 02 01:29:45 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627/disk.config"/>
Nov 02 01:29:45 user nova-compute[74996]:       <target dev="sdb" bus="scsi"/>
Nov 02 01:29:45 user nova-compute[74996]:       <address type="drive" controller="0" unit="1"/>
Nov 02 01:29:45 user nova-compute[74996]:     </disk>
Nov 02 01:29:45 user nova-compute[74996]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 02 01:29:45 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:29:45 user nova-compute[74996]:       <mac address="fa:16:3e:d4:2e:a5"/>
Nov 02 01:29:45 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:29:45 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:29:45 user nova-compute[74996]:       <target dev="tap7ee7d00e-99"/>
Nov 02 01:29:45 user nova-compute[74996]:     </interface>
Nov 02 01:29:45 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:29:45 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627/console.log" append="off"/>
Nov 02 01:29:45 user nova-compute[74996]:     </serial>
Nov 02 01:29:45 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:29:45 user nova-compute[74996]:     <video>
Nov 02 01:29:45 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:29:45 user nova-compute[74996]:     </video>
Nov 02 01:29:45 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:29:45 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:29:45 user nova-compute[74996]:     </rng>
Nov 02 01:29:45 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:29:45 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:29:45 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:29:45 user nova-compute[74996]:     </memballoon>
Nov 02 01:29:45 user nova-compute[74996]:   </devices>
Nov 02 01:29:45 user nova-compute[74996]: </domain>
Nov 02 01:29:45 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:29:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1230440666',display_name='tempest-AttachSCSIVolumeTestJSON-server-1230440666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1230440666',id=6,image_ref='38584735-89a5-4264-95ed-0ada33f021d7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbga3R/IqjULzAeMX4I/gKpUltHYg4EoAdpyRT7+gJ2bkaOEq7dy80LcBUgyqfU7Wzqq+Ec95lSs3dey7EGZj/0cVTMQ6m1uk/X2fQ7CZoPdeg2lIDYkN80h7Pa0KurxA==',key_name='tempest-keypair-1396152305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd6782fc20434d9d9d40527985ce3ad1',ramdisk_id='',reservation_id='r-04hsn70y',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='38584735-89a5-4264-95ed-0ada33f021d7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-651942675',owner_user_name='tempest-AttachSCSIVolumeTestJSON-651942675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:29:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b16f949e8d524b4d9e90d454fece5f26',uuid=23ba82cb-ec9d-4b96-b205-3d9ac6bc8627,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ee7d00e-996e-4ba6-9a7d-642404d24f74", "address": "fa:16:3e:d4:2e:a5", "network": {"id": "d4db391d-89bd-4b81-8521-e90539933295", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-627212228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd6782fc20434d9d9d40527985ce3ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee7d00e-99", "ovs_interfaceid": "7ee7d00e-996e-4ba6-9a7d-642404d24f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Converting VIF {"id": "7ee7d00e-996e-4ba6-9a7d-642404d24f74", "address": "fa:16:3e:d4:2e:a5", "network": {"id": "d4db391d-89bd-4b81-8521-e90539933295", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-627212228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd6782fc20434d9d9d40527985ce3ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee7d00e-99", "ovs_interfaceid": "7ee7d00e-996e-4ba6-9a7d-642404d24f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:2e:a5,bridge_name='br-int',has_traffic_filtering=True,id=7ee7d00e-996e-4ba6-9a7d-642404d24f74,network=Network(d4db391d-89bd-4b81-8521-e90539933295),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee7d00e-99') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG os_vif [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:2e:a5,bridge_name='br-int',has_traffic_filtering=True,id=7ee7d00e-996e-4ba6-9a7d-642404d24f74,network=Network(d4db391d-89bd-4b81-8521-e90539933295),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee7d00e-99') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '203f87fb-afda-50db-9b22-c89ddf740062', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ee7d00e-99, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ee7d00e-99, col_values=(('qos', UUID('150dda72-9597-40db-9df6-7439eb2afcb2')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ee7d00e-99, col_values=(('external_ids', {'iface-id': '7ee7d00e-996e-4ba6-9a7d-642404d24f74', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:2e:a5', 'vm-uuid': '23ba82cb-ec9d-4b96-b205-3d9ac6bc8627'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:45 user nova-compute[74996]: INFO os_vif [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:2e:a5,bridge_name='br-int',has_traffic_filtering=True,id=7ee7d00e-996e-4ba6-9a7d-642404d24f74,network=Network(d4db391d-89bd-4b81-8521-e90539933295),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee7d00e-99')
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] No BDM found with device name sda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] No VIF found with MAC fa:16:3e:d4:2e:a5, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:29:45 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Using config drive
Nov 02 01:29:45 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Creating config drive at /opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627/disk.config
Nov 02 01:29:45 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpumisi151 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:45 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpumisi151" returned: 0 in 0.064s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:46 user nova-compute[74996]: DEBUG nova.network.neutron [req-1d5c6818-32a5-4890-8d31-7e36ef874c86 req-a18ae46c-ba47-4de3-9fd8-8ece17fb1362 service nova] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Updated VIF entry in instance network info cache for port 7ee7d00e-996e-4ba6-9a7d-642404d24f74. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:29:46 user nova-compute[74996]: DEBUG nova.network.neutron [req-1d5c6818-32a5-4890-8d31-7e36ef874c86 req-a18ae46c-ba47-4de3-9fd8-8ece17fb1362 service nova] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Updating instance_info_cache with network_info: [{"id": "7ee7d00e-996e-4ba6-9a7d-642404d24f74", "address": "fa:16:3e:d4:2e:a5", "network": {"id": "d4db391d-89bd-4b81-8521-e90539933295", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-627212228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd6782fc20434d9d9d40527985ce3ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee7d00e-99", "ovs_interfaceid": "7ee7d00e-996e-4ba6-9a7d-642404d24f74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:29:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1d5c6818-32a5-4890-8d31-7e36ef874c86 req-a18ae46c-ba47-4de3-9fd8-8ece17fb1362 service nova] Releasing lock "refresh_cache-23ba82cb-ec9d-4b96-b205-3d9ac6bc8627" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:29:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Acquiring lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:48 user nova-compute[74996]: DEBUG nova.compute.manager [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:29:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:29:48 user nova-compute[74996]: INFO nova.compute.claims [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Claim successful on node user
Nov 02 01:29:48 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:29:48 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:29:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:48 user nova-compute[74996]: DEBUG nova.compute.manager [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:29:48 user nova-compute[74996]: DEBUG nova.compute.manager [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:29:48 user nova-compute[74996]: DEBUG nova.network.neutron [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:29:48 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:29:48 user nova-compute[74996]: DEBUG nova.compute.manager [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:29:48 user nova-compute[74996]: DEBUG nova.policy [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '105cb894b7204a69b0401665b9e9dd0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc357c4550694aefaf63faf246b9eef9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:29:48 user nova-compute[74996]: DEBUG nova.compute.manager [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:29:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:29:48 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Creating image(s)
Nov 02 01:29:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Acquiring lock "/opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Lock "/opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Lock "/opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.206s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.241s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0/disk 1073741824" returned: 0 in 0.048s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:49 user nova-compute[74996]: DEBUG nova.network.neutron [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Successfully created port: 88b99660-8af7-4f3a-95fc-a797a886a253 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:29:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.208s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:49 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:29:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:49 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Cannot resize image /opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:29:49 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:29:49 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Ensure instance console log exists: /opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:29:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:49 user nova-compute[74996]: DEBUG nova.compute.manager [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:29:49 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:29:49 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Instance spawned successfully.
Nov 02 01:29:49 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:29:49 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:49 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:49 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:49 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:50 user nova-compute[74996]: INFO nova.compute.manager [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Took 8.90 seconds to spawn the instance on the hypervisor.
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.compute.manager [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.network.neutron [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Successfully updated port: 88b99660-8af7-4f3a-95fc-a797a886a253 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Acquiring lock "refresh_cache-d843d91a-afc3-45f8-9a89-8bc40e81f0d0" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Acquired lock "refresh_cache-d843d91a-afc3-45f8-9a89-8bc40e81f0d0" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.network.neutron [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.compute.manager [req-25186c32-900a-4424-9786-7326f516916f req-04db191f-44d4-4541-b6aa-bcd478bc5822 service nova] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Received event network-changed-88b99660-8af7-4f3a-95fc-a797a886a253 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.compute.manager [req-25186c32-900a-4424-9786-7326f516916f req-04db191f-44d4-4541-b6aa-bcd478bc5822 service nova] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Refreshing instance network info cache due to event network-changed-88b99660-8af7-4f3a-95fc-a797a886a253. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-25186c32-900a-4424-9786-7326f516916f req-04db191f-44d4-4541-b6aa-bcd478bc5822 service nova] Acquiring lock "refresh_cache-d843d91a-afc3-45f8-9a89-8bc40e81f0d0" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:29:50 user nova-compute[74996]: INFO nova.compute.manager [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Took 10.03 seconds to build instance.
Nov 02 01:29:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3ee186df-888e-403c-9a98-35471d284dbe tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.247s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.network.neutron [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.network.neutron [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Updating instance_info_cache with network_info: [{"id": "88b99660-8af7-4f3a-95fc-a797a886a253", "address": "fa:16:3e:50:c2:14", "network": {"id": "e87c8aa5-2cd6-40da-8b68-dd408a09f642", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1821225633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc357c4550694aefaf63faf246b9eef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b99660-8a", "ovs_interfaceid": "88b99660-8af7-4f3a-95fc-a797a886a253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Releasing lock "refresh_cache-d843d91a-afc3-45f8-9a89-8bc40e81f0d0" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.compute.manager [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Instance network_info: |[{"id": "88b99660-8af7-4f3a-95fc-a797a886a253", "address": "fa:16:3e:50:c2:14", "network": {"id": "e87c8aa5-2cd6-40da-8b68-dd408a09f642", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1821225633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc357c4550694aefaf63faf246b9eef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b99660-8a", "ovs_interfaceid": "88b99660-8af7-4f3a-95fc-a797a886a253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-25186c32-900a-4424-9786-7326f516916f req-04db191f-44d4-4541-b6aa-bcd478bc5822 service nova] Acquired lock "refresh_cache-d843d91a-afc3-45f8-9a89-8bc40e81f0d0" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.network.neutron [req-25186c32-900a-4424-9786-7326f516916f req-04db191f-44d4-4541-b6aa-bcd478bc5822 service nova] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Refreshing network info cache for port 88b99660-8af7-4f3a-95fc-a797a886a253 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Start _get_guest_xml network_info=[{"id": "88b99660-8af7-4f3a-95fc-a797a886a253", "address": "fa:16:3e:50:c2:14", "network": {"id": "e87c8aa5-2cd6-40da-8b68-dd408a09f642", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1821225633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc357c4550694aefaf63faf246b9eef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b99660-8a", "ovs_interfaceid": "88b99660-8af7-4f3a-95fc-a797a886a253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:29:50 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:29:50 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:29:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-653293421',display_name='tempest-VolumesAssistedSnapshotsTest-server-653293421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-653293421',id=7,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEwsD6PyQpzu5botVkuWYUcZ3sAmeLDdqDVC1rASHY9lb/uxy7MzqB/AAWZtS8b+zANnHIoifK6DjKLsHImx2NLFr+MorBhsXbwuZ1su0DMPDS3N5vVv21r882u5CBfJg==',key_name='tempest-keypair-1860474834',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc357c4550694aefaf63faf246b9eef9',ramdisk_id='',reservation_id='r-5pu60mhh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-100316394',owner_user_name='tempest-VolumesAssistedSnapshotsTest-100316394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:29:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='105cb894b7204a69b0401665b9e9dd0e',uuid=d843d91a-afc3-45f8-9a89-8bc40e81f0d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88b99660-8af7-4f3a-95fc-a797a886a253", "address": "fa:16:3e:50:c2:14", "network": {"id": "e87c8aa5-2cd6-40da-8b68-dd408a09f642", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1821225633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc357c4550694aefaf63faf246b9eef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b99660-8a", "ovs_interfaceid": "88b99660-8af7-4f3a-95fc-a797a886a253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Converting VIF {"id": "88b99660-8af7-4f3a-95fc-a797a886a253", "address": "fa:16:3e:50:c2:14", "network": {"id": "e87c8aa5-2cd6-40da-8b68-dd408a09f642", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1821225633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc357c4550694aefaf63faf246b9eef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b99660-8a", "ovs_interfaceid": "88b99660-8af7-4f3a-95fc-a797a886a253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:c2:14,bridge_name='br-int',has_traffic_filtering=True,id=88b99660-8af7-4f3a-95fc-a797a886a253,network=Network(e87c8aa5-2cd6-40da-8b68-dd408a09f642),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88b99660-8a') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.objects.instance [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Lazy-loading 'pci_devices' on Instance uuid d843d91a-afc3-45f8-9a89-8bc40e81f0d0 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:29:50 user nova-compute[74996]:   <uuid>d843d91a-afc3-45f8-9a89-8bc40e81f0d0</uuid>
Nov 02 01:29:50 user nova-compute[74996]:   <name>instance-00000007</name>
Nov 02 01:29:50 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:29:50 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:29:50 user nova-compute[74996]:   <metadata>
Nov 02 01:29:50 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:29:50 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:29:50 user nova-compute[74996]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-653293421</nova:name>
Nov 02 01:29:50 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:29:50</nova:creationTime>
Nov 02 01:29:50 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:29:50 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:29:50 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:29:50 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:29:50 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:29:50 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:29:50 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:29:50 user nova-compute[74996]:       <nova:owner>
Nov 02 01:29:50 user nova-compute[74996]:         <nova:user uuid="105cb894b7204a69b0401665b9e9dd0e">tempest-VolumesAssistedSnapshotsTest-100316394-project-member</nova:user>
Nov 02 01:29:50 user nova-compute[74996]:         <nova:project uuid="dc357c4550694aefaf63faf246b9eef9">tempest-VolumesAssistedSnapshotsTest-100316394</nova:project>
Nov 02 01:29:50 user nova-compute[74996]:       </nova:owner>
Nov 02 01:29:50 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:29:50 user nova-compute[74996]:       <nova:ports>
Nov 02 01:29:50 user nova-compute[74996]:         <nova:port uuid="88b99660-8af7-4f3a-95fc-a797a886a253">
Nov 02 01:29:50 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 02 01:29:50 user nova-compute[74996]:         </nova:port>
Nov 02 01:29:50 user nova-compute[74996]:       </nova:ports>
Nov 02 01:29:50 user nova-compute[74996]:     </nova:instance>
Nov 02 01:29:50 user nova-compute[74996]:   </metadata>
Nov 02 01:29:50 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:29:50 user nova-compute[74996]:     <system>
Nov 02 01:29:50 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:29:50 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:29:50 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:29:50 user nova-compute[74996]:       <entry name="serial">d843d91a-afc3-45f8-9a89-8bc40e81f0d0</entry>
Nov 02 01:29:50 user nova-compute[74996]:       <entry name="uuid">d843d91a-afc3-45f8-9a89-8bc40e81f0d0</entry>
Nov 02 01:29:50 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:29:50 user nova-compute[74996]:     </system>
Nov 02 01:29:50 user nova-compute[74996]:   </sysinfo>
Nov 02 01:29:50 user nova-compute[74996]:   <os>
Nov 02 01:29:50 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:29:50 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:29:50 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:29:50 user nova-compute[74996]:   </os>
Nov 02 01:29:50 user nova-compute[74996]:   <features>
Nov 02 01:29:50 user nova-compute[74996]:     <acpi/>
Nov 02 01:29:50 user nova-compute[74996]:     <apic/>
Nov 02 01:29:50 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:29:50 user nova-compute[74996]:   </features>
Nov 02 01:29:50 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:29:50 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:29:50 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:29:50 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:29:50 user nova-compute[74996]:   </clock>
Nov 02 01:29:50 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:29:50 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:29:50 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:29:50 user nova-compute[74996]:   </cpu>
Nov 02 01:29:50 user nova-compute[74996]:   <devices>
Nov 02 01:29:50 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:29:50 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:29:50 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0/disk"/>
Nov 02 01:29:50 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:29:50 user nova-compute[74996]:     </disk>
Nov 02 01:29:50 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:29:50 user nova-compute[74996]:       <mac address="fa:16:3e:50:c2:14"/>
Nov 02 01:29:50 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:29:50 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:29:50 user nova-compute[74996]:       <target dev="tap88b99660-8a"/>
Nov 02 01:29:50 user nova-compute[74996]:     </interface>
Nov 02 01:29:50 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:29:50 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0/console.log" append="off"/>
Nov 02 01:29:50 user nova-compute[74996]:     </serial>
Nov 02 01:29:50 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:29:50 user nova-compute[74996]:     <video>
Nov 02 01:29:50 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:29:50 user nova-compute[74996]:     </video>
Nov 02 01:29:50 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:29:50 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:29:50 user nova-compute[74996]:     </rng>
Nov 02 01:29:50 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:29:50 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:29:50 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:29:50 user nova-compute[74996]:     </memballoon>
Nov 02 01:29:50 user nova-compute[74996]:   </devices>
Nov 02 01:29:50 user nova-compute[74996]: </domain>
Nov 02 01:29:50 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:29:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-653293421',display_name='tempest-VolumesAssistedSnapshotsTest-server-653293421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-653293421',id=7,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEwsD6PyQpzu5botVkuWYUcZ3sAmeLDdqDVC1rASHY9lb/uxy7MzqB/AAWZtS8b+zANnHIoifK6DjKLsHImx2NLFr+MorBhsXbwuZ1su0DMPDS3N5vVv21r882u5CBfJg==',key_name='tempest-keypair-1860474834',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc357c4550694aefaf63faf246b9eef9',ramdisk_id='',reservation_id='r-5pu60mhh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-100316394',owner_user_name='tempest-VolumesAssistedSnapshotsTest-100316394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:29:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='105cb894b7204a69b0401665b9e9dd0e',uuid=d843d91a-afc3-45f8-9a89-8bc40e81f0d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88b99660-8af7-4f3a-95fc-a797a886a253", "address": "fa:16:3e:50:c2:14", "network": {"id": "e87c8aa5-2cd6-40da-8b68-dd408a09f642", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1821225633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc357c4550694aefaf63faf246b9eef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b99660-8a", "ovs_interfaceid": "88b99660-8af7-4f3a-95fc-a797a886a253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Converting VIF {"id": "88b99660-8af7-4f3a-95fc-a797a886a253", "address": "fa:16:3e:50:c2:14", "network": {"id": "e87c8aa5-2cd6-40da-8b68-dd408a09f642", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1821225633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc357c4550694aefaf63faf246b9eef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b99660-8a", "ovs_interfaceid": "88b99660-8af7-4f3a-95fc-a797a886a253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:c2:14,bridge_name='br-int',has_traffic_filtering=True,id=88b99660-8af7-4f3a-95fc-a797a886a253,network=Network(e87c8aa5-2cd6-40da-8b68-dd408a09f642),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88b99660-8a') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG os_vif [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:c2:14,bridge_name='br-int',has_traffic_filtering=True,id=88b99660-8af7-4f3a-95fc-a797a886a253,network=Network(e87c8aa5-2cd6-40da-8b68-dd408a09f642),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88b99660-8a') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '57030e26-5fdc-577e-a7eb-19f7c4e6377e', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88b99660-8a, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap88b99660-8a, col_values=(('qos', UUID('c0349f2f-f818-4720-8b2b-6742aee55bd6')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap88b99660-8a, col_values=(('external_ids', {'iface-id': '88b99660-8af7-4f3a-95fc-a797a886a253', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:c2:14', 'vm-uuid': 'd843d91a-afc3-45f8-9a89-8bc40e81f0d0'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:50 user nova-compute[74996]: INFO os_vif [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:c2:14,bridge_name='br-int',has_traffic_filtering=True,id=88b99660-8af7-4f3a-95fc-a797a886a253,network=Network(e87c8aa5-2cd6-40da-8b68-dd408a09f642),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88b99660-8a')
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:29:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] No VIF found with MAC fa:16:3e:50:c2:14, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:29:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:51 user nova-compute[74996]: DEBUG nova.network.neutron [req-25186c32-900a-4424-9786-7326f516916f req-04db191f-44d4-4541-b6aa-bcd478bc5822 service nova] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Updated VIF entry in instance network info cache for port 88b99660-8af7-4f3a-95fc-a797a886a253. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:29:51 user nova-compute[74996]: DEBUG nova.network.neutron [req-25186c32-900a-4424-9786-7326f516916f req-04db191f-44d4-4541-b6aa-bcd478bc5822 service nova] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Updating instance_info_cache with network_info: [{"id": "88b99660-8af7-4f3a-95fc-a797a886a253", "address": "fa:16:3e:50:c2:14", "network": {"id": "e87c8aa5-2cd6-40da-8b68-dd408a09f642", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1821225633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc357c4550694aefaf63faf246b9eef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b99660-8a", "ovs_interfaceid": "88b99660-8af7-4f3a-95fc-a797a886a253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:29:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-25186c32-900a-4424-9786-7326f516916f req-04db191f-44d4-4541-b6aa-bcd478bc5822 service nova] Releasing lock "refresh_cache-d843d91a-afc3-45f8-9a89-8bc40e81f0d0" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:29:52 user nova-compute[74996]: DEBUG nova.compute.manager [req-9824f63f-2f03-4af5-b862-9a3c31f3a7c0 req-52f212bc-a544-400a-93c6-e67ce192435f service nova] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Received event network-vif-plugged-7ee7d00e-996e-4ba6-9a7d-642404d24f74 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:29:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9824f63f-2f03-4af5-b862-9a3c31f3a7c0 req-52f212bc-a544-400a-93c6-e67ce192435f service nova] Acquiring lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9824f63f-2f03-4af5-b862-9a3c31f3a7c0 req-52f212bc-a544-400a-93c6-e67ce192435f service nova] Lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9824f63f-2f03-4af5-b862-9a3c31f3a7c0 req-52f212bc-a544-400a-93c6-e67ce192435f service nova] Lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:52 user nova-compute[74996]: DEBUG nova.compute.manager [req-9824f63f-2f03-4af5-b862-9a3c31f3a7c0 req-52f212bc-a544-400a-93c6-e67ce192435f service nova] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] No waiting events found dispatching network-vif-plugged-7ee7d00e-996e-4ba6-9a7d-642404d24f74 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:29:52 user nova-compute[74996]: WARNING nova.compute.manager [req-9824f63f-2f03-4af5-b862-9a3c31f3a7c0 req-52f212bc-a544-400a-93c6-e67ce192435f service nova] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Received unexpected event network-vif-plugged-7ee7d00e-996e-4ba6-9a7d-642404d24f74 for instance with vm_state active and task_state None.
Nov 02 01:29:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:54 user nova-compute[74996]: DEBUG nova.compute.manager [req-d9769745-bf92-4acc-a54a-62b4d84200e2 req-1c15d761-caa9-40df-b027-ff5211cdd44d service nova] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Received event network-vif-plugged-7ee7d00e-996e-4ba6-9a7d-642404d24f74 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:29:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d9769745-bf92-4acc-a54a-62b4d84200e2 req-1c15d761-caa9-40df-b027-ff5211cdd44d service nova] Acquiring lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d9769745-bf92-4acc-a54a-62b4d84200e2 req-1c15d761-caa9-40df-b027-ff5211cdd44d service nova] Lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d9769745-bf92-4acc-a54a-62b4d84200e2 req-1c15d761-caa9-40df-b027-ff5211cdd44d service nova] Lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:54 user nova-compute[74996]: DEBUG nova.compute.manager [req-d9769745-bf92-4acc-a54a-62b4d84200e2 req-1c15d761-caa9-40df-b027-ff5211cdd44d service nova] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] No waiting events found dispatching network-vif-plugged-7ee7d00e-996e-4ba6-9a7d-642404d24f74 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:29:54 user nova-compute[74996]: WARNING nova.compute.manager [req-d9769745-bf92-4acc-a54a-62b4d84200e2 req-1c15d761-caa9-40df-b027-ff5211cdd44d service nova] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Received unexpected event network-vif-plugged-7ee7d00e-996e-4ba6-9a7d-642404d24f74 for instance with vm_state active and task_state None.
Nov 02 01:29:54 user nova-compute[74996]: DEBUG nova.compute.manager [req-591cd764-8c0a-4325-beca-015689a2e0ef req-8e93f7c7-7dec-4c19-80ac-74c415a1a582 service nova] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Received event network-vif-plugged-88b99660-8af7-4f3a-95fc-a797a886a253 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:29:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-591cd764-8c0a-4325-beca-015689a2e0ef req-8e93f7c7-7dec-4c19-80ac-74c415a1a582 service nova] Acquiring lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-591cd764-8c0a-4325-beca-015689a2e0ef req-8e93f7c7-7dec-4c19-80ac-74c415a1a582 service nova] Lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-591cd764-8c0a-4325-beca-015689a2e0ef req-8e93f7c7-7dec-4c19-80ac-74c415a1a582 service nova] Lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:54 user nova-compute[74996]: DEBUG nova.compute.manager [req-591cd764-8c0a-4325-beca-015689a2e0ef req-8e93f7c7-7dec-4c19-80ac-74c415a1a582 service nova] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] No waiting events found dispatching network-vif-plugged-88b99660-8af7-4f3a-95fc-a797a886a253 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:29:54 user nova-compute[74996]: WARNING nova.compute.manager [req-591cd764-8c0a-4325-beca-015689a2e0ef req-8e93f7c7-7dec-4c19-80ac-74c415a1a582 service nova] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Received unexpected event network-vif-plugged-88b99660-8af7-4f3a-95fc-a797a886a253 for instance with vm_state building and task_state spawning.
Nov 02 01:29:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Acquiring lock "909a8a42-017d-4db3-a150-6861c20f0d31" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Lock "909a8a42-017d-4db3-a150-6861c20f0d31" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:54 user nova-compute[74996]: DEBUG nova.compute.manager [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:29:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:55 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:29:55 user nova-compute[74996]: INFO nova.compute.claims [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Claim successful on node user
Nov 02 01:29:55 user nova-compute[74996]: DEBUG nova.compute.manager [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:29:55 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:29:55 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Instance spawned successfully.
Nov 02 01:29:55 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:29:55 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:55 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:55 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:55 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:55 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:55 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:29:55 user nova-compute[74996]: INFO nova.compute.manager [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Took 6.34 seconds to spawn the instance on the hypervisor.
Nov 02 01:29:55 user nova-compute[74996]: DEBUG nova.compute.manager [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:29:55 user nova-compute[74996]: INFO nova.compute.manager [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Took 7.19 seconds to build instance.
Nov 02 01:29:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-447bd753-194e-4b42-aead-d05807b4d37e tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.358s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:55 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:29:55 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:29:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:55 user nova-compute[74996]: DEBUG nova.compute.manager [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:29:55 user nova-compute[74996]: DEBUG nova.compute.manager [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:29:55 user nova-compute[74996]: DEBUG nova.network.neutron [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:29:55 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:29:55 user nova-compute[74996]: DEBUG nova.compute.manager [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:29:55 user nova-compute[74996]: DEBUG nova.policy [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '844b526666b34c4d837cb2aff9d6f036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfcf41fa791405f8b7679fa0060f2f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:29:55 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:55 user nova-compute[74996]: DEBUG nova.compute.manager [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:29:55 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:29:55 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Creating image(s)
Nov 02 01:29:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Acquiring lock "/opt/stack/data/nova/instances/909a8a42-017d-4db3-a150-6861c20f0d31/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Lock "/opt/stack/data/nova/instances/909a8a42-017d-4db3-a150-6861c20f0d31/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.007s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Lock "/opt/stack/data/nova/instances/909a8a42-017d-4db3-a150-6861c20f0d31/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:55 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.232s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.220s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/909a8a42-017d-4db3-a150-6861c20f0d31/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/909a8a42-017d-4db3-a150-6861c20f0d31/disk 1073741824" returned: 0 in 0.061s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:56 user nova-compute[74996]: DEBUG nova.compute.manager [req-6afef2a2-1e86-410d-8fcc-3b4dafeef02e req-f7e686fb-5df8-4fd7-9993-cbc37759c524 service nova] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Received event network-vif-plugged-88b99660-8af7-4f3a-95fc-a797a886a253 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:29:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6afef2a2-1e86-410d-8fcc-3b4dafeef02e req-f7e686fb-5df8-4fd7-9993-cbc37759c524 service nova] Acquiring lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6afef2a2-1e86-410d-8fcc-3b4dafeef02e req-f7e686fb-5df8-4fd7-9993-cbc37759c524 service nova] Lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6afef2a2-1e86-410d-8fcc-3b4dafeef02e req-f7e686fb-5df8-4fd7-9993-cbc37759c524 service nova] Lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:56 user nova-compute[74996]: DEBUG nova.compute.manager [req-6afef2a2-1e86-410d-8fcc-3b4dafeef02e req-f7e686fb-5df8-4fd7-9993-cbc37759c524 service nova] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] No waiting events found dispatching network-vif-plugged-88b99660-8af7-4f3a-95fc-a797a886a253 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:29:56 user nova-compute[74996]: WARNING nova.compute.manager [req-6afef2a2-1e86-410d-8fcc-3b4dafeef02e req-f7e686fb-5df8-4fd7-9993-cbc37759c524 service nova] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Received unexpected event network-vif-plugged-88b99660-8af7-4f3a-95fc-a797a886a253 for instance with vm_state active and task_state None.
Nov 02 01:29:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.200s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:56 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Checking if we can resize image /opt/stack/data/nova/instances/909a8a42-017d-4db3-a150-6861c20f0d31/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:29:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909a8a42-017d-4db3-a150-6861c20f0d31/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:29:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909a8a42-017d-4db3-a150-6861c20f0d31/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:29:56 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Cannot resize image /opt/stack/data/nova/instances/909a8a42-017d-4db3-a150-6861c20f0d31/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:29:56 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:29:56 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Ensure instance console log exists: /opt/stack/data/nova/instances/909a8a42-017d-4db3-a150-6861c20f0d31/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:29:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:56 user nova-compute[74996]: DEBUG nova.network.neutron [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Successfully created port: 28e931f0-f97b-41ee-8629-51e34d358056 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:29:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:57 user nova-compute[74996]: DEBUG nova.network.neutron [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Successfully updated port: 28e931f0-f97b-41ee-8629-51e34d358056 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:29:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Acquiring lock "refresh_cache-909a8a42-017d-4db3-a150-6861c20f0d31" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:29:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Acquired lock "refresh_cache-909a8a42-017d-4db3-a150-6861c20f0d31" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:29:57 user nova-compute[74996]: DEBUG nova.network.neutron [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:29:57 user nova-compute[74996]: DEBUG nova.network.neutron [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:29:57 user nova-compute[74996]: DEBUG nova.network.neutron [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Updating instance_info_cache with network_info: [{"id": "28e931f0-f97b-41ee-8629-51e34d358056", "address": "fa:16:3e:2d:e6:29", "network": {"id": "4223d148-0d8a-4df4-966d-e576de223b86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-984618786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dfcf41fa791405f8b7679fa0060f2f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e931f0-f9", "ovs_interfaceid": "28e931f0-f97b-41ee-8629-51e34d358056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:29:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Releasing lock "refresh_cache-909a8a42-017d-4db3-a150-6861c20f0d31" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:29:57 user nova-compute[74996]: DEBUG nova.compute.manager [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Instance network_info: |[{"id": "28e931f0-f97b-41ee-8629-51e34d358056", "address": "fa:16:3e:2d:e6:29", "network": {"id": "4223d148-0d8a-4df4-966d-e576de223b86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-984618786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dfcf41fa791405f8b7679fa0060f2f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e931f0-f9", "ovs_interfaceid": "28e931f0-f97b-41ee-8629-51e34d358056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Start _get_guest_xml network_info=[{"id": "28e931f0-f97b-41ee-8629-51e34d358056", "address": "fa:16:3e:2d:e6:29", "network": {"id": "4223d148-0d8a-4df4-966d-e576de223b86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-984618786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dfcf41fa791405f8b7679fa0060f2f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e931f0-f9", "ovs_interfaceid": "28e931f0-f97b-41ee-8629-51e34d358056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:29:58 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:29:58 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:29:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-833894709',display_name='tempest-VolumesActionsTest-instance-833894709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-833894709',id=8,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3dfcf41fa791405f8b7679fa0060f2f9',ramdisk_id='',reservation_id='r-ymbem7uh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-742258024',owner_user_name='tempest-VolumesActionsTest-742258024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:29:56Z,user_data=None,user_id='844b526666b34c4d837cb2aff9d6f036',uuid=909a8a42-017d-4db3-a150-6861c20f0d31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28e931f0-f97b-41ee-8629-51e34d358056", "address": "fa:16:3e:2d:e6:29", "network": {"id": "4223d148-0d8a-4df4-966d-e576de223b86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-984618786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dfcf41fa791405f8b7679fa0060f2f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e931f0-f9", "ovs_interfaceid": "28e931f0-f97b-41ee-8629-51e34d358056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Converting VIF {"id": "28e931f0-f97b-41ee-8629-51e34d358056", "address": "fa:16:3e:2d:e6:29", "network": {"id": "4223d148-0d8a-4df4-966d-e576de223b86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-984618786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dfcf41fa791405f8b7679fa0060f2f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e931f0-f9", "ovs_interfaceid": "28e931f0-f97b-41ee-8629-51e34d358056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:e6:29,bridge_name='br-int',has_traffic_filtering=True,id=28e931f0-f97b-41ee-8629-51e34d358056,network=Network(4223d148-0d8a-4df4-966d-e576de223b86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e931f0-f9') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.objects.instance [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Lazy-loading 'pci_devices' on Instance uuid 909a8a42-017d-4db3-a150-6861c20f0d31 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:29:58 user nova-compute[74996]:   <uuid>909a8a42-017d-4db3-a150-6861c20f0d31</uuid>
Nov 02 01:29:58 user nova-compute[74996]:   <name>instance-00000008</name>
Nov 02 01:29:58 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:29:58 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:29:58 user nova-compute[74996]:   <metadata>
Nov 02 01:29:58 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:29:58 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:29:58 user nova-compute[74996]:       <nova:name>tempest-VolumesActionsTest-instance-833894709</nova:name>
Nov 02 01:29:58 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:29:58</nova:creationTime>
Nov 02 01:29:58 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:29:58 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:29:58 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:29:58 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:29:58 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:29:58 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:29:58 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:29:58 user nova-compute[74996]:       <nova:owner>
Nov 02 01:29:58 user nova-compute[74996]:         <nova:user uuid="844b526666b34c4d837cb2aff9d6f036">tempest-VolumesActionsTest-742258024-project-member</nova:user>
Nov 02 01:29:58 user nova-compute[74996]:         <nova:project uuid="3dfcf41fa791405f8b7679fa0060f2f9">tempest-VolumesActionsTest-742258024</nova:project>
Nov 02 01:29:58 user nova-compute[74996]:       </nova:owner>
Nov 02 01:29:58 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:29:58 user nova-compute[74996]:       <nova:ports>
Nov 02 01:29:58 user nova-compute[74996]:         <nova:port uuid="28e931f0-f97b-41ee-8629-51e34d358056">
Nov 02 01:29:58 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 02 01:29:58 user nova-compute[74996]:         </nova:port>
Nov 02 01:29:58 user nova-compute[74996]:       </nova:ports>
Nov 02 01:29:58 user nova-compute[74996]:     </nova:instance>
Nov 02 01:29:58 user nova-compute[74996]:   </metadata>
Nov 02 01:29:58 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:29:58 user nova-compute[74996]:     <system>
Nov 02 01:29:58 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:29:58 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:29:58 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:29:58 user nova-compute[74996]:       <entry name="serial">909a8a42-017d-4db3-a150-6861c20f0d31</entry>
Nov 02 01:29:58 user nova-compute[74996]:       <entry name="uuid">909a8a42-017d-4db3-a150-6861c20f0d31</entry>
Nov 02 01:29:58 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:29:58 user nova-compute[74996]:     </system>
Nov 02 01:29:58 user nova-compute[74996]:   </sysinfo>
Nov 02 01:29:58 user nova-compute[74996]:   <os>
Nov 02 01:29:58 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:29:58 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:29:58 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:29:58 user nova-compute[74996]:   </os>
Nov 02 01:29:58 user nova-compute[74996]:   <features>
Nov 02 01:29:58 user nova-compute[74996]:     <acpi/>
Nov 02 01:29:58 user nova-compute[74996]:     <apic/>
Nov 02 01:29:58 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:29:58 user nova-compute[74996]:   </features>
Nov 02 01:29:58 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:29:58 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:29:58 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:29:58 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:29:58 user nova-compute[74996]:   </clock>
Nov 02 01:29:58 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:29:58 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:29:58 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:29:58 user nova-compute[74996]:   </cpu>
Nov 02 01:29:58 user nova-compute[74996]:   <devices>
Nov 02 01:29:58 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:29:58 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:29:58 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/909a8a42-017d-4db3-a150-6861c20f0d31/disk"/>
Nov 02 01:29:58 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:29:58 user nova-compute[74996]:     </disk>
Nov 02 01:29:58 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:29:58 user nova-compute[74996]:       <mac address="fa:16:3e:2d:e6:29"/>
Nov 02 01:29:58 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:29:58 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:29:58 user nova-compute[74996]:       <target dev="tap28e931f0-f9"/>
Nov 02 01:29:58 user nova-compute[74996]:     </interface>
Nov 02 01:29:58 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:29:58 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/909a8a42-017d-4db3-a150-6861c20f0d31/console.log" append="off"/>
Nov 02 01:29:58 user nova-compute[74996]:     </serial>
Nov 02 01:29:58 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:29:58 user nova-compute[74996]:     <video>
Nov 02 01:29:58 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:29:58 user nova-compute[74996]:     </video>
Nov 02 01:29:58 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:29:58 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:29:58 user nova-compute[74996]:     </rng>
Nov 02 01:29:58 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:29:58 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:29:58 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:29:58 user nova-compute[74996]:     </memballoon>
Nov 02 01:29:58 user nova-compute[74996]:   </devices>
Nov 02 01:29:58 user nova-compute[74996]: </domain>
Nov 02 01:29:58 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:29:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-833894709',display_name='tempest-VolumesActionsTest-instance-833894709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-833894709',id=8,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3dfcf41fa791405f8b7679fa0060f2f9',ramdisk_id='',reservation_id='r-ymbem7uh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-742258024',owner_user_name='tempest-VolumesActionsTest-742258024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:29:56Z,user_data=None,user_id='844b526666b34c4d837cb2aff9d6f036',uuid=909a8a42-017d-4db3-a150-6861c20f0d31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28e931f0-f97b-41ee-8629-51e34d358056", "address": "fa:16:3e:2d:e6:29", "network": {"id": "4223d148-0d8a-4df4-966d-e576de223b86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-984618786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dfcf41fa791405f8b7679fa0060f2f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e931f0-f9", "ovs_interfaceid": "28e931f0-f97b-41ee-8629-51e34d358056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Converting VIF {"id": "28e931f0-f97b-41ee-8629-51e34d358056", "address": "fa:16:3e:2d:e6:29", "network": {"id": "4223d148-0d8a-4df4-966d-e576de223b86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-984618786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dfcf41fa791405f8b7679fa0060f2f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e931f0-f9", "ovs_interfaceid": "28e931f0-f97b-41ee-8629-51e34d358056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:e6:29,bridge_name='br-int',has_traffic_filtering=True,id=28e931f0-f97b-41ee-8629-51e34d358056,network=Network(4223d148-0d8a-4df4-966d-e576de223b86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e931f0-f9') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG os_vif [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:e6:29,bridge_name='br-int',has_traffic_filtering=True,id=28e931f0-f97b-41ee-8629-51e34d358056,network=Network(4223d148-0d8a-4df4-966d-e576de223b86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e931f0-f9') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c43ac273-893c-5249-a704-669f3ab8719f', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28e931f0-f9, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28e931f0-f9, col_values=(('qos', UUID('fd55265a-5bf8-429f-ad37-dce979f35e8c')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28e931f0-f9, col_values=(('external_ids', {'iface-id': '28e931f0-f97b-41ee-8629-51e34d358056', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:e6:29', 'vm-uuid': '909a8a42-017d-4db3-a150-6861c20f0d31'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:58 user nova-compute[74996]: INFO os_vif [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:e6:29,bridge_name='br-int',has_traffic_filtering=True,id=28e931f0-f97b-41ee-8629-51e34d358056,network=Network(4223d148-0d8a-4df4-966d-e576de223b86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e931f0-f9')
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] No VIF found with MAC fa:16:3e:2d:e6:29, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.compute.manager [req-4cbcb87a-d0e9-418f-beb2-cc046b71ae77 req-142a9ad0-b559-4d3e-a7b6-95ceff3fb094 service nova] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Received event network-changed-28e931f0-f97b-41ee-8629-51e34d358056 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.compute.manager [req-4cbcb87a-d0e9-418f-beb2-cc046b71ae77 req-142a9ad0-b559-4d3e-a7b6-95ceff3fb094 service nova] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Refreshing instance network info cache due to event network-changed-28e931f0-f97b-41ee-8629-51e34d358056. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4cbcb87a-d0e9-418f-beb2-cc046b71ae77 req-142a9ad0-b559-4d3e-a7b6-95ceff3fb094 service nova] Acquiring lock "refresh_cache-909a8a42-017d-4db3-a150-6861c20f0d31" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4cbcb87a-d0e9-418f-beb2-cc046b71ae77 req-142a9ad0-b559-4d3e-a7b6-95ceff3fb094 service nova] Acquired lock "refresh_cache-909a8a42-017d-4db3-a150-6861c20f0d31" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.network.neutron [req-4cbcb87a-d0e9-418f-beb2-cc046b71ae77 req-142a9ad0-b559-4d3e-a7b6-95ceff3fb094 service nova] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Refreshing network info cache for port 28e931f0-f97b-41ee-8629-51e34d358056 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.network.neutron [req-4cbcb87a-d0e9-418f-beb2-cc046b71ae77 req-142a9ad0-b559-4d3e-a7b6-95ceff3fb094 service nova] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Updated VIF entry in instance network info cache for port 28e931f0-f97b-41ee-8629-51e34d358056. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG nova.network.neutron [req-4cbcb87a-d0e9-418f-beb2-cc046b71ae77 req-142a9ad0-b559-4d3e-a7b6-95ceff3fb094 service nova] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Updating instance_info_cache with network_info: [{"id": "28e931f0-f97b-41ee-8629-51e34d358056", "address": "fa:16:3e:2d:e6:29", "network": {"id": "4223d148-0d8a-4df4-966d-e576de223b86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-984618786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dfcf41fa791405f8b7679fa0060f2f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e931f0-f9", "ovs_interfaceid": "28e931f0-f97b-41ee-8629-51e34d358056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:29:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4cbcb87a-d0e9-418f-beb2-cc046b71ae77 req-142a9ad0-b559-4d3e-a7b6-95ceff3fb094 service nova] Releasing lock "refresh_cache-909a8a42-017d-4db3-a150-6861c20f0d31" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:29:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:29:59 user nova-compute[74996]: DEBUG nova.compute.manager [req-81cbfb44-74bc-4089-87d4-c253e0c61a63 req-4e9abe44-1dcc-48ca-af90-26ab271aa5aa service nova] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Received event network-vif-plugged-28e931f0-f97b-41ee-8629-51e34d358056 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:29:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-81cbfb44-74bc-4089-87d4-c253e0c61a63 req-4e9abe44-1dcc-48ca-af90-26ab271aa5aa service nova] Acquiring lock "909a8a42-017d-4db3-a150-6861c20f0d31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:29:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-81cbfb44-74bc-4089-87d4-c253e0c61a63 req-4e9abe44-1dcc-48ca-af90-26ab271aa5aa service nova] Lock "909a8a42-017d-4db3-a150-6861c20f0d31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:29:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-81cbfb44-74bc-4089-87d4-c253e0c61a63 req-4e9abe44-1dcc-48ca-af90-26ab271aa5aa service nova] Lock "909a8a42-017d-4db3-a150-6861c20f0d31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:29:59 user nova-compute[74996]: DEBUG nova.compute.manager [req-81cbfb44-74bc-4089-87d4-c253e0c61a63 req-4e9abe44-1dcc-48ca-af90-26ab271aa5aa service nova] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] No waiting events found dispatching network-vif-plugged-28e931f0-f97b-41ee-8629-51e34d358056 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:29:59 user nova-compute[74996]: WARNING nova.compute.manager [req-81cbfb44-74bc-4089-87d4-c253e0c61a63 req-4e9abe44-1dcc-48ca-af90-26ab271aa5aa service nova] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Received unexpected event network-vif-plugged-28e931f0-f97b-41ee-8629-51e34d358056 for instance with vm_state building and task_state spawning.
Nov 02 01:30:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:01 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:30:01 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Cleaning up deleted instances {{(pid=74996) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 01:30:01 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] There are 0 instances to clean {{(pid=74996) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 01:30:01 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:30:01 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74996) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 01:30:01 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:30:01 user nova-compute[74996]: DEBUG nova.compute.manager [req-b9e339de-e243-4f3e-ae25-6d855faefa23 req-ba9d07a4-6e2e-48dd-8b72-5aab216df861 service nova] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Received event network-vif-plugged-28e931f0-f97b-41ee-8629-51e34d358056 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:30:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b9e339de-e243-4f3e-ae25-6d855faefa23 req-ba9d07a4-6e2e-48dd-8b72-5aab216df861 service nova] Acquiring lock "909a8a42-017d-4db3-a150-6861c20f0d31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:30:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b9e339de-e243-4f3e-ae25-6d855faefa23 req-ba9d07a4-6e2e-48dd-8b72-5aab216df861 service nova] Lock "909a8a42-017d-4db3-a150-6861c20f0d31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:30:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b9e339de-e243-4f3e-ae25-6d855faefa23 req-ba9d07a4-6e2e-48dd-8b72-5aab216df861 service nova] Lock "909a8a42-017d-4db3-a150-6861c20f0d31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:30:01 user nova-compute[74996]: DEBUG nova.compute.manager [req-b9e339de-e243-4f3e-ae25-6d855faefa23 req-ba9d07a4-6e2e-48dd-8b72-5aab216df861 service nova] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] No waiting events found dispatching network-vif-plugged-28e931f0-f97b-41ee-8629-51e34d358056 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:30:01 user nova-compute[74996]: WARNING nova.compute.manager [req-b9e339de-e243-4f3e-ae25-6d855faefa23 req-ba9d07a4-6e2e-48dd-8b72-5aab216df861 service nova] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Received unexpected event network-vif-plugged-28e931f0-f97b-41ee-8629-51e34d358056 for instance with vm_state building and task_state spawning.
Nov 02 01:30:02 user nova-compute[74996]: DEBUG nova.compute.manager [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:30:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:30:02 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Instance spawned successfully.
Nov 02 01:30:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:30:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:30:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:30:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:30:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:30:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:30:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:30:02 user nova-compute[74996]: INFO nova.compute.manager [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Took 6.23 seconds to spawn the instance on the hypervisor.
Nov 02 01:30:02 user nova-compute[74996]: DEBUG nova.compute.manager [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:30:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:02 user nova-compute[74996]: INFO nova.compute.manager [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Took 7.26 seconds to build instance.
Nov 02 01:30:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cdb25db3-6d2f-4d9d-88ae-96f27bb8159f tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Lock "909a8a42-017d-4db3-a150-6861c20f0d31" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.388s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:30:02 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:30:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:05 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:30:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:30:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:30:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:30:05 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:30:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:30:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:30:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:30:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:30:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:30:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:30:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:30:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:30:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:30:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:30:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:30:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:30:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:30:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:30:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:30:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:30:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:30:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:30:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:30:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:30:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3983741f-270b-4758-a676-245b7adc8cc8/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:30:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3983741f-270b-4758-a676-245b7adc8cc8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:30:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3983741f-270b-4758-a676-245b7adc8cc8/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:30:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3983741f-270b-4758-a676-245b7adc8cc8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:30:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:30:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:30:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:30:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:30:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909a8a42-017d-4db3-a150-6861c20f0d31/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:30:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909a8a42-017d-4db3-a150-6861c20f0d31/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:30:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909a8a42-017d-4db3-a150-6861c20f0d31/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:30:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909a8a42-017d-4db3-a150-6861c20f0d31/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:30:09 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:30:09 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:30:09 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=7584MB free_disk=25.47812271118164GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:30:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:30:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:30:09 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 3983741f-270b-4758-a676-245b7adc8cc8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:30:09 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance c04b39dd-3961-4e23-ad43-34a218f4a472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:30:09 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance fea802b7-64d9-4c77-87a7-eaba1dce5c22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:30:09 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7307f3a3-1ad1-43f7-be49-9cd03a626cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:30:09 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 2621c5a2-acff-4055-9746-1b2f5829b39d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:30:09 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:30:09 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance d843d91a-afc3-45f8-9a89-8bc40e81f0d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:30:09 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 909a8a42-017d-4db3-a150-6861c20f0d31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:30:09 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:30:09 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:30:09 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:30:09 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:30:09 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:30:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.677s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:30:10 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:30:10 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:30:10 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:30:10 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Rebuilding the list of instances to heal {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 01:30:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-3983741f-270b-4758-a676-245b7adc8cc8" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:30:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-3983741f-270b-4758-a676-245b7adc8cc8" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:30:10 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 01:30:10 user nova-compute[74996]: DEBUG nova.objects.instance [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lazy-loading 'info_cache' on Instance uuid 3983741f-270b-4758-a676-245b7adc8cc8 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:30:11 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Updating instance_info_cache with network_info: [{"id": "975424fa-4f7a-4483-bf55-e66c9f95f2b5", "address": "fa:16:3e:ad:63:3e", "network": {"id": "19b893a3-ff14-40bd-bc4a-d5594baee6b0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1986254622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eda3a1bcf0fa436c89c8047b8c410176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap975424fa-4f", "ovs_interfaceid": "975424fa-4f7a-4483-bf55-e66c9f95f2b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:30:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-3983741f-270b-4758-a676-245b7adc8cc8" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:30:11 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 01:30:11 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:30:11 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:30:11 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:30:11 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:30:11 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:30:11 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:30:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Acquiring lock "ff502988-e729-4509-bd2d-ff16bf9e0a08" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:30:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lock "ff502988-e729-4509-bd2d-ff16bf9e0a08" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:30:24 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:30:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:30:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:30:25 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:30:25 user nova-compute[74996]: INFO nova.compute.claims [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Claim successful on node user
Nov 02 01:30:25 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Refreshing inventories for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 01:30:25 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Updating ProviderTree inventory for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 01:30:25 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Updating inventory in ProviderTree for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 01:30:25 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Refreshing aggregate associations for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259, aggregates: None {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 01:30:25 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Refreshing trait associations for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 01:30:25 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:30:25 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:30:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.649s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:30:25 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:30:25 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:30:25 user nova-compute[74996]: DEBUG nova.network.neutron [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:30:25 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:30:25 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:30:25 user nova-compute[74996]: DEBUG nova.policy [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60c00f8021b9408ebc66dffbb8c3ff5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ece99d67094759b97f5209450d3ac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:30:25 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:30:25 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:30:25 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Creating image(s)
Nov 02 01:30:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:30:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lock "/opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:30:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lock "/opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:30:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:30:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.184s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:30:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:30:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:30:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:30:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.165s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:30:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:30:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08/disk 1073741824" returned: 0 in 0.051s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:30:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:30:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:30:26 user nova-compute[74996]: DEBUG nova.network.neutron [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Successfully created port: a7987061-7da2-417b-a279-9ed0d87f5488 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:30:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.199s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:30:26 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:30:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:30:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:30:26 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Cannot resize image /opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:30:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:30:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Ensure instance console log exists: /opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:30:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:30:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:30:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:30:26 user nova-compute[74996]: DEBUG nova.network.neutron [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Successfully updated port: a7987061-7da2-417b-a279-9ed0d87f5488 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Acquiring lock "refresh_cache-ff502988-e729-4509-bd2d-ff16bf9e0a08" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Acquired lock "refresh_cache-ff502988-e729-4509-bd2d-ff16bf9e0a08" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.network.neutron [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.compute.manager [req-685ad971-8392-4915-94e8-fbc7496774be req-d3cbaf0d-bfed-47a0-a046-73e674829942 service nova] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Received event network-changed-a7987061-7da2-417b-a279-9ed0d87f5488 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.compute.manager [req-685ad971-8392-4915-94e8-fbc7496774be req-d3cbaf0d-bfed-47a0-a046-73e674829942 service nova] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Refreshing instance network info cache due to event network-changed-a7987061-7da2-417b-a279-9ed0d87f5488. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-685ad971-8392-4915-94e8-fbc7496774be req-d3cbaf0d-bfed-47a0-a046-73e674829942 service nova] Acquiring lock "refresh_cache-ff502988-e729-4509-bd2d-ff16bf9e0a08" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.network.neutron [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.network.neutron [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Updating instance_info_cache with network_info: [{"id": "a7987061-7da2-417b-a279-9ed0d87f5488", "address": "fa:16:3e:3f:49:3f", "network": {"id": "2a0924da-5d99-47ea-be8c-887374c16253", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2096520879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8ece99d67094759b97f5209450d3ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7987061-7d", "ovs_interfaceid": "a7987061-7da2-417b-a279-9ed0d87f5488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Releasing lock "refresh_cache-ff502988-e729-4509-bd2d-ff16bf9e0a08" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Instance network_info: |[{"id": "a7987061-7da2-417b-a279-9ed0d87f5488", "address": "fa:16:3e:3f:49:3f", "network": {"id": "2a0924da-5d99-47ea-be8c-887374c16253", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2096520879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8ece99d67094759b97f5209450d3ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7987061-7d", "ovs_interfaceid": "a7987061-7da2-417b-a279-9ed0d87f5488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-685ad971-8392-4915-94e8-fbc7496774be req-d3cbaf0d-bfed-47a0-a046-73e674829942 service nova] Acquired lock "refresh_cache-ff502988-e729-4509-bd2d-ff16bf9e0a08" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.network.neutron [req-685ad971-8392-4915-94e8-fbc7496774be req-d3cbaf0d-bfed-47a0-a046-73e674829942 service nova] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Refreshing network info cache for port a7987061-7da2-417b-a279-9ed0d87f5488 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Start _get_guest_xml network_info=[{"id": "a7987061-7da2-417b-a279-9ed0d87f5488", "address": "fa:16:3e:3f:49:3f", "network": {"id": "2a0924da-5d99-47ea-be8c-887374c16253", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2096520879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8ece99d67094759b97f5209450d3ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7987061-7d", "ovs_interfaceid": "a7987061-7da2-417b-a279-9ed0d87f5488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:30:27 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:30:27 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:30:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2140949878',display_name='tempest-TestVolumeSwap-server-2140949878',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2140949878',id=9,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJUKTLJZRxcaxbUDr7Ir9AqhEUMIG+xsuaJ57NEbkfTz6qcXkQglur9HjDvrmPA9V7A/22aD8pCZ8PLurqwp5klC0yBHGcsOCkxOhyTHErP8RU24mU91pwuvFsIjLDwMw==',key_name='tempest-keypair-829203099',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8ece99d67094759b97f5209450d3ac7',ramdisk_id='',reservation_id='r-340d0ev1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-208204034',owner_user_name='tempest-TestVolumeSwap-208204034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:30:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60c00f8021b9408ebc66dffbb8c3ff5c',uuid=ff502988-e729-4509-bd2d-ff16bf9e0a08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7987061-7da2-417b-a279-9ed0d87f5488", "address": "fa:16:3e:3f:49:3f", "network": {"id": "2a0924da-5d99-47ea-be8c-887374c16253", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2096520879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8ece99d67094759b97f5209450d3ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7987061-7d", "ovs_interfaceid": "a7987061-7da2-417b-a279-9ed0d87f5488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Converting VIF {"id": "a7987061-7da2-417b-a279-9ed0d87f5488", "address": "fa:16:3e:3f:49:3f", "network": {"id": "2a0924da-5d99-47ea-be8c-887374c16253", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2096520879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8ece99d67094759b97f5209450d3ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7987061-7d", "ovs_interfaceid": "a7987061-7da2-417b-a279-9ed0d87f5488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:49:3f,bridge_name='br-int',has_traffic_filtering=True,id=a7987061-7da2-417b-a279-9ed0d87f5488,network=Network(2a0924da-5d99-47ea-be8c-887374c16253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7987061-7d') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.objects.instance [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lazy-loading 'pci_devices' on Instance uuid ff502988-e729-4509-bd2d-ff16bf9e0a08 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:30:27 user nova-compute[74996]:   <uuid>ff502988-e729-4509-bd2d-ff16bf9e0a08</uuid>
Nov 02 01:30:27 user nova-compute[74996]:   <name>instance-00000009</name>
Nov 02 01:30:27 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:30:27 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:30:27 user nova-compute[74996]:   <metadata>
Nov 02 01:30:27 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:30:27 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:30:27 user nova-compute[74996]:       <nova:name>tempest-TestVolumeSwap-server-2140949878</nova:name>
Nov 02 01:30:27 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:30:27</nova:creationTime>
Nov 02 01:30:27 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:30:27 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:30:27 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:30:27 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:30:27 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:30:27 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:30:27 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:30:27 user nova-compute[74996]:       <nova:owner>
Nov 02 01:30:27 user nova-compute[74996]:         <nova:user uuid="60c00f8021b9408ebc66dffbb8c3ff5c">tempest-TestVolumeSwap-208204034-project-member</nova:user>
Nov 02 01:30:27 user nova-compute[74996]:         <nova:project uuid="f8ece99d67094759b97f5209450d3ac7">tempest-TestVolumeSwap-208204034</nova:project>
Nov 02 01:30:27 user nova-compute[74996]:       </nova:owner>
Nov 02 01:30:27 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:30:27 user nova-compute[74996]:       <nova:ports>
Nov 02 01:30:27 user nova-compute[74996]:         <nova:port uuid="a7987061-7da2-417b-a279-9ed0d87f5488">
Nov 02 01:30:27 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 02 01:30:27 user nova-compute[74996]:         </nova:port>
Nov 02 01:30:27 user nova-compute[74996]:       </nova:ports>
Nov 02 01:30:27 user nova-compute[74996]:     </nova:instance>
Nov 02 01:30:27 user nova-compute[74996]:   </metadata>
Nov 02 01:30:27 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:30:27 user nova-compute[74996]:     <system>
Nov 02 01:30:27 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:30:27 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:30:27 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:30:27 user nova-compute[74996]:       <entry name="serial">ff502988-e729-4509-bd2d-ff16bf9e0a08</entry>
Nov 02 01:30:27 user nova-compute[74996]:       <entry name="uuid">ff502988-e729-4509-bd2d-ff16bf9e0a08</entry>
Nov 02 01:30:27 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:30:27 user nova-compute[74996]:     </system>
Nov 02 01:30:27 user nova-compute[74996]:   </sysinfo>
Nov 02 01:30:27 user nova-compute[74996]:   <os>
Nov 02 01:30:27 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:30:27 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:30:27 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:30:27 user nova-compute[74996]:   </os>
Nov 02 01:30:27 user nova-compute[74996]:   <features>
Nov 02 01:30:27 user nova-compute[74996]:     <acpi/>
Nov 02 01:30:27 user nova-compute[74996]:     <apic/>
Nov 02 01:30:27 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:30:27 user nova-compute[74996]:   </features>
Nov 02 01:30:27 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:30:27 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:30:27 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:30:27 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:30:27 user nova-compute[74996]:   </clock>
Nov 02 01:30:27 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:30:27 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:30:27 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:30:27 user nova-compute[74996]:   </cpu>
Nov 02 01:30:27 user nova-compute[74996]:   <devices>
Nov 02 01:30:27 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:30:27 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:30:27 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08/disk"/>
Nov 02 01:30:27 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:30:27 user nova-compute[74996]:     </disk>
Nov 02 01:30:27 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:30:27 user nova-compute[74996]:       <mac address="fa:16:3e:3f:49:3f"/>
Nov 02 01:30:27 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:30:27 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:30:27 user nova-compute[74996]:       <target dev="tapa7987061-7d"/>
Nov 02 01:30:27 user nova-compute[74996]:     </interface>
Nov 02 01:30:27 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:30:27 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08/console.log" append="off"/>
Nov 02 01:30:27 user nova-compute[74996]:     </serial>
Nov 02 01:30:27 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:30:27 user nova-compute[74996]:     <video>
Nov 02 01:30:27 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:30:27 user nova-compute[74996]:     </video>
Nov 02 01:30:27 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:30:27 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:30:27 user nova-compute[74996]:     </rng>
Nov 02 01:30:27 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:30:27 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:30:27 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:30:27 user nova-compute[74996]:     </memballoon>
Nov 02 01:30:27 user nova-compute[74996]:   </devices>
Nov 02 01:30:27 user nova-compute[74996]: </domain>
Nov 02 01:30:27 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:30:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2140949878',display_name='tempest-TestVolumeSwap-server-2140949878',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2140949878',id=9,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJUKTLJZRxcaxbUDr7Ir9AqhEUMIG+xsuaJ57NEbkfTz6qcXkQglur9HjDvrmPA9V7A/22aD8pCZ8PLurqwp5klC0yBHGcsOCkxOhyTHErP8RU24mU91pwuvFsIjLDwMw==',key_name='tempest-keypair-829203099',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8ece99d67094759b97f5209450d3ac7',ramdisk_id='',reservation_id='r-340d0ev1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-208204034',owner_user_name='tempest-TestVolumeSwap-208204034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:30:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60c00f8021b9408ebc66dffbb8c3ff5c',uuid=ff502988-e729-4509-bd2d-ff16bf9e0a08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7987061-7da2-417b-a279-9ed0d87f5488", "address": "fa:16:3e:3f:49:3f", "network": {"id": "2a0924da-5d99-47ea-be8c-887374c16253", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2096520879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8ece99d67094759b97f5209450d3ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7987061-7d", "ovs_interfaceid": "a7987061-7da2-417b-a279-9ed0d87f5488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Converting VIF {"id": "a7987061-7da2-417b-a279-9ed0d87f5488", "address": "fa:16:3e:3f:49:3f", "network": {"id": "2a0924da-5d99-47ea-be8c-887374c16253", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2096520879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8ece99d67094759b97f5209450d3ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7987061-7d", "ovs_interfaceid": "a7987061-7da2-417b-a279-9ed0d87f5488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:49:3f,bridge_name='br-int',has_traffic_filtering=True,id=a7987061-7da2-417b-a279-9ed0d87f5488,network=Network(2a0924da-5d99-47ea-be8c-887374c16253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7987061-7d') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG os_vif [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:49:3f,bridge_name='br-int',has_traffic_filtering=True,id=a7987061-7da2-417b-a279-9ed0d87f5488,network=Network(2a0924da-5d99-47ea-be8c-887374c16253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7987061-7d') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '040acedb-b693-5f1a-b06f-418368837540', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7987061-7d, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7987061-7d, col_values=(('qos', UUID('f157dccb-31c4-469b-b292-35b2a27344d4')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7987061-7d, col_values=(('external_ids', {'iface-id': 'a7987061-7da2-417b-a279-9ed0d87f5488', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:49:3f', 'vm-uuid': 'ff502988-e729-4509-bd2d-ff16bf9e0a08'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:27 user nova-compute[74996]: INFO os_vif [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:49:3f,bridge_name='br-int',has_traffic_filtering=True,id=a7987061-7da2-417b-a279-9ed0d87f5488,network=Network(2a0924da-5d99-47ea-be8c-887374c16253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7987061-7d')
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] No VIF found with MAC fa:16:3e:3f:49:3f, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.network.neutron [req-685ad971-8392-4915-94e8-fbc7496774be req-d3cbaf0d-bfed-47a0-a046-73e674829942 service nova] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Updated VIF entry in instance network info cache for port a7987061-7da2-417b-a279-9ed0d87f5488. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG nova.network.neutron [req-685ad971-8392-4915-94e8-fbc7496774be req-d3cbaf0d-bfed-47a0-a046-73e674829942 service nova] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Updating instance_info_cache with network_info: [{"id": "a7987061-7da2-417b-a279-9ed0d87f5488", "address": "fa:16:3e:3f:49:3f", "network": {"id": "2a0924da-5d99-47ea-be8c-887374c16253", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2096520879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8ece99d67094759b97f5209450d3ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7987061-7d", "ovs_interfaceid": "a7987061-7da2-417b-a279-9ed0d87f5488", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:30:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-685ad971-8392-4915-94e8-fbc7496774be req-d3cbaf0d-bfed-47a0-a046-73e674829942 service nova] Releasing lock "refresh_cache-ff502988-e729-4509-bd2d-ff16bf9e0a08" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:30:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:29 user nova-compute[74996]: DEBUG nova.compute.manager [req-45d8c67e-d397-4fec-ba72-63cdaeb934a8 req-ca14baf5-8fb7-471f-adb7-36ccfc596e5e service nova] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Received event network-vif-plugged-a7987061-7da2-417b-a279-9ed0d87f5488 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:30:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-45d8c67e-d397-4fec-ba72-63cdaeb934a8 req-ca14baf5-8fb7-471f-adb7-36ccfc596e5e service nova] Acquiring lock "ff502988-e729-4509-bd2d-ff16bf9e0a08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:30:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-45d8c67e-d397-4fec-ba72-63cdaeb934a8 req-ca14baf5-8fb7-471f-adb7-36ccfc596e5e service nova] Lock "ff502988-e729-4509-bd2d-ff16bf9e0a08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:30:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-45d8c67e-d397-4fec-ba72-63cdaeb934a8 req-ca14baf5-8fb7-471f-adb7-36ccfc596e5e service nova] Lock "ff502988-e729-4509-bd2d-ff16bf9e0a08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:30:29 user nova-compute[74996]: DEBUG nova.compute.manager [req-45d8c67e-d397-4fec-ba72-63cdaeb934a8 req-ca14baf5-8fb7-471f-adb7-36ccfc596e5e service nova] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] No waiting events found dispatching network-vif-plugged-a7987061-7da2-417b-a279-9ed0d87f5488 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:30:29 user nova-compute[74996]: WARNING nova.compute.manager [req-45d8c67e-d397-4fec-ba72-63cdaeb934a8 req-ca14baf5-8fb7-471f-adb7-36ccfc596e5e service nova] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Received unexpected event network-vif-plugged-a7987061-7da2-417b-a279-9ed0d87f5488 for instance with vm_state building and task_state spawning.
Nov 02 01:30:30 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:30:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:30:30 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Instance spawned successfully.
Nov 02 01:30:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:30:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:30:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:30:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:30:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:30:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:30:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:30:31 user nova-compute[74996]: INFO nova.compute.manager [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 02 01:30:31 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:30:31 user nova-compute[74996]: INFO nova.compute.manager [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Took 6.14 seconds to build instance.
Nov 02 01:30:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1f5bf2eb-7327-4c7e-b420-edd5ec375778 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lock "ff502988-e729-4509-bd2d-ff16bf9e0a08" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.238s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:30:31 user nova-compute[74996]: DEBUG nova.compute.manager [req-a11dc372-2a4d-4d03-a618-3658a9ba7274 req-57041366-1a8a-42a1-ac4f-85638a4597d2 service nova] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Received event network-vif-plugged-a7987061-7da2-417b-a279-9ed0d87f5488 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:30:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a11dc372-2a4d-4d03-a618-3658a9ba7274 req-57041366-1a8a-42a1-ac4f-85638a4597d2 service nova] Acquiring lock "ff502988-e729-4509-bd2d-ff16bf9e0a08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:30:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a11dc372-2a4d-4d03-a618-3658a9ba7274 req-57041366-1a8a-42a1-ac4f-85638a4597d2 service nova] Lock "ff502988-e729-4509-bd2d-ff16bf9e0a08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:30:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a11dc372-2a4d-4d03-a618-3658a9ba7274 req-57041366-1a8a-42a1-ac4f-85638a4597d2 service nova] Lock "ff502988-e729-4509-bd2d-ff16bf9e0a08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:30:31 user nova-compute[74996]: DEBUG nova.compute.manager [req-a11dc372-2a4d-4d03-a618-3658a9ba7274 req-57041366-1a8a-42a1-ac4f-85638a4597d2 service nova] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] No waiting events found dispatching network-vif-plugged-a7987061-7da2-417b-a279-9ed0d87f5488 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:30:31 user nova-compute[74996]: WARNING nova.compute.manager [req-a11dc372-2a4d-4d03-a618-3658a9ba7274 req-57041366-1a8a-42a1-ac4f-85638a4597d2 service nova] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Received unexpected event network-vif-plugged-a7987061-7da2-417b-a279-9ed0d87f5488 for instance with vm_state active and task_state None.
Nov 02 01:30:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:30:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:30:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:30:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:02 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:31:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:03 user nova-compute[74996]: DEBUG nova.compute.manager [req-fbdf77dc-af4f-41a4-8b8d-e59ff83b249b req-f812b21d-cb44-40ef-9b98-a62ad47d3c9a service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Received event network-changed-0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:31:03 user nova-compute[74996]: DEBUG nova.compute.manager [req-fbdf77dc-af4f-41a4-8b8d-e59ff83b249b req-f812b21d-cb44-40ef-9b98-a62ad47d3c9a service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Refreshing instance network info cache due to event network-changed-0a0d9417-e8c0-4392-ba9b-f1e27712adad. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:31:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-fbdf77dc-af4f-41a4-8b8d-e59ff83b249b req-f812b21d-cb44-40ef-9b98-a62ad47d3c9a service nova] Acquiring lock "refresh_cache-c04b39dd-3961-4e23-ad43-34a218f4a472" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:31:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-fbdf77dc-af4f-41a4-8b8d-e59ff83b249b req-f812b21d-cb44-40ef-9b98-a62ad47d3c9a service nova] Acquired lock "refresh_cache-c04b39dd-3961-4e23-ad43-34a218f4a472" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:31:03 user nova-compute[74996]: DEBUG nova.network.neutron [req-fbdf77dc-af4f-41a4-8b8d-e59ff83b249b req-f812b21d-cb44-40ef-9b98-a62ad47d3c9a service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Refreshing network info cache for port 0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:31:04 user nova-compute[74996]: DEBUG nova.network.neutron [req-fbdf77dc-af4f-41a4-8b8d-e59ff83b249b req-f812b21d-cb44-40ef-9b98-a62ad47d3c9a service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Updated VIF entry in instance network info cache for port 0a0d9417-e8c0-4392-ba9b-f1e27712adad. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:31:04 user nova-compute[74996]: DEBUG nova.network.neutron [req-fbdf77dc-af4f-41a4-8b8d-e59ff83b249b req-f812b21d-cb44-40ef-9b98-a62ad47d3c9a service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Updating instance_info_cache with network_info: [{"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:31:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-fbdf77dc-af4f-41a4-8b8d-e59ff83b249b req-f812b21d-cb44-40ef-9b98-a62ad47d3c9a service nova] Releasing lock "refresh_cache-c04b39dd-3961-4e23-ad43-34a218f4a472" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:31:04 user nova-compute[74996]: DEBUG nova.compute.manager [None req-923e08ce-1a6f-4409-937f-b997d2319f13 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:31:04 user nova-compute[74996]: INFO nova.compute.manager [None req-923e08ce-1a6f-4409-937f-b997d2319f13 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] instance snapshotting
Nov 02 01:31:04 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-923e08ce-1a6f-4409-937f-b997d2319f13 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Beginning live snapshot process
Nov 02 01:31:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-923e08ce-1a6f-4409-937f-b997d2319f13 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json -f qcow2 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-923e08ce-1a6f-4409-937f-b997d2319f13 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-923e08ce-1a6f-4409-937f-b997d2319f13 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json -f qcow2 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-923e08ce-1a6f-4409-937f-b997d2319f13 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-923e08ce-1a6f-4409-937f-b997d2319f13 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-923e08ce-1a6f-4409-937f-b997d2319f13 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.180s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-923e08ce-1a6f-4409-937f-b997d2319f13 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcfdcd793/0bb564db2b5746bfa6b863a33dec4a3c.delta 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-923e08ce-1a6f-4409-937f-b997d2319f13 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcfdcd793/0bb564db2b5746bfa6b863a33dec4a3c.delta 1073741824" returned: 0 in 0.049s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:05 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-923e08ce-1a6f-4409-937f-b997d2319f13 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 02 01:31:05 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-923e08ce-1a6f-4409-937f-b997d2319f13 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74996) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 02 01:31:05 user nova-compute[74996]: INFO nova.virt.libvirt.host [None req-923e08ce-1a6f-4409-937f-b997d2319f13 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] UEFI support detected
Nov 02 01:31:05 user nova-compute[74996]: DEBUG nova.compute.manager [req-418da61e-2ebd-4e44-8ac9-0cb71b63d1a8 req-98d27d98-03b9-46d0-9d18-4dc76689cb29 service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Received event network-changed-b645a26c-6fae-4cfc-97ee-951a1cf5aec9 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:31:05 user nova-compute[74996]: DEBUG nova.compute.manager [req-418da61e-2ebd-4e44-8ac9-0cb71b63d1a8 req-98d27d98-03b9-46d0-9d18-4dc76689cb29 service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Refreshing instance network info cache due to event network-changed-b645a26c-6fae-4cfc-97ee-951a1cf5aec9. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:31:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-418da61e-2ebd-4e44-8ac9-0cb71b63d1a8 req-98d27d98-03b9-46d0-9d18-4dc76689cb29 service nova] Acquiring lock "refresh_cache-7307f3a3-1ad1-43f7-be49-9cd03a626cd7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:31:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-418da61e-2ebd-4e44-8ac9-0cb71b63d1a8 req-98d27d98-03b9-46d0-9d18-4dc76689cb29 service nova] Acquired lock "refresh_cache-7307f3a3-1ad1-43f7-be49-9cd03a626cd7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:31:05 user nova-compute[74996]: DEBUG nova.network.neutron [req-418da61e-2ebd-4e44-8ac9-0cb71b63d1a8 req-98d27d98-03b9-46d0-9d18-4dc76689cb29 service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Refreshing network info cache for port b645a26c-6fae-4cfc-97ee-951a1cf5aec9 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:31:06 user nova-compute[74996]: DEBUG nova.network.neutron [req-418da61e-2ebd-4e44-8ac9-0cb71b63d1a8 req-98d27d98-03b9-46d0-9d18-4dc76689cb29 service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Updated VIF entry in instance network info cache for port b645a26c-6fae-4cfc-97ee-951a1cf5aec9. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:31:06 user nova-compute[74996]: DEBUG nova.network.neutron [req-418da61e-2ebd-4e44-8ac9-0cb71b63d1a8 req-98d27d98-03b9-46d0-9d18-4dc76689cb29 service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Updating instance_info_cache with network_info: [{"id": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "address": "fa:16:3e:97:27:02", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb645a26c-6f", "ovs_interfaceid": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:31:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-923e08ce-1a6f-4409-937f-b997d2319f13 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] COPY block job progress, current cursor: 720896 final cursor: 75497472 {{(pid=74996) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 01:31:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-418da61e-2ebd-4e44-8ac9-0cb71b63d1a8 req-98d27d98-03b9-46d0-9d18-4dc76689cb29 service nova] Releasing lock "refresh_cache-7307f3a3-1ad1-43f7-be49-9cd03a626cd7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:31:06 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:31:06 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:31:06 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:31:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:31:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:31:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:31:06 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:31:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-923e08ce-1a6f-4409-937f-b997d2319f13 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74996) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 01:31:06 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-923e08ce-1a6f-4409-937f-b997d2319f13 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 02 01:31:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:06 user nova-compute[74996]: DEBUG nova.privsep.utils [None req-923e08ce-1a6f-4409-937f-b997d2319f13 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74996) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 01:31:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-923e08ce-1a6f-4409-937f-b997d2319f13 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcfdcd793/0bb564db2b5746bfa6b863a33dec4a3c.delta /opt/stack/data/nova/instances/snapshots/tmpcfdcd793/0bb564db2b5746bfa6b863a33dec4a3c {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-923e08ce-1a6f-4409-937f-b997d2319f13 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcfdcd793/0bb564db2b5746bfa6b863a33dec4a3c.delta /opt/stack/data/nova/instances/snapshots/tmpcfdcd793/0bb564db2b5746bfa6b863a33dec4a3c" returned: 0 in 0.281s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:06 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-923e08ce-1a6f-4409-937f-b997d2319f13 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Snapshot extracted, beginning image upload
Nov 02 01:31:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Acquiring lock "3983741f-270b-4758-a676-245b7adc8cc8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:31:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "3983741f-270b-4758-a676-245b7adc8cc8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:31:07 user nova-compute[74996]: DEBUG nova.objects.instance [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lazy-loading 'flavor' on Instance uuid 3983741f-270b-4758-a676-245b7adc8cc8 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:31:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "3983741f-270b-4758-a676-245b7adc8cc8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.118s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:31:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Acquiring lock "3983741f-270b-4758-a676-245b7adc8cc8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:31:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "3983741f-270b-4758-a676-245b7adc8cc8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:31:07 user nova-compute[74996]: INFO nova.compute.manager [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Attaching volume e8e2e33f-9f5b-490a-9998-f340837ab044 to /dev/vdb
Nov 02 01:31:08 user nova-compute[74996]: DEBUG os_brick.utils [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:31:08 user nova-compute[74996]: INFO oslo.privsep.daemon [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpfgq6wnuf/privsep.sock']
Nov 02 01:31:08 user sudo[86424]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpfgq6wnuf/privsep.sock
Nov 02 01:31:08 user sudo[86424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 02 01:31:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3983741f-270b-4758-a676-245b7adc8cc8/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3983741f-270b-4758-a676-245b7adc8cc8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3983741f-270b-4758-a676-245b7adc8cc8/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3983741f-270b-4758-a676-245b7adc8cc8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909a8a42-017d-4db3-a150-6861c20f0d31/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:09 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-923e08ce-1a6f-4409-937f-b997d2319f13 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Snapshot image upload complete
Nov 02 01:31:09 user nova-compute[74996]: INFO nova.compute.manager [None req-923e08ce-1a6f-4409-937f-b997d2319f13 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Took 5.03 seconds to snapshot the instance on the hypervisor.
Nov 02 01:31:09 user sudo[86424]: pam_unix(sudo:session): session closed for user root
Nov 02 01:31:09 user nova-compute[74996]: INFO oslo.privsep.daemon [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Spawned new privsep daemon via rootwrap
Nov 02 01:31:09 user nova-compute[74996]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 02 01:31:09 user nova-compute[74996]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 02 01:31:09 user nova-compute[74996]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 02 01:31:09 user nova-compute[74996]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86449
Nov 02 01:31:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909a8a42-017d-4db3-a150-6861c20f0d31/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909a8a42-017d-4db3-a150-6861c20f0d31/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:09 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a087f2be-d969-465e-90d8-dbc5ae4601d9]: (2,) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909a8a42-017d-4db3-a150-6861c20f0d31/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:09 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[653fbf4a-a878-4990-8a3f-7737eea68b5e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:09 user nova-compute[74996]: WARNING os_brick.initiator.connectors.nvmeof [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 02 01:31:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b8d90b-f762-464c-af62-1e30283bb5c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:10 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:31:10 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:31:10 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=7305MB free_disk=25.3685302734375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75cce2a-b73f-451a-9594-fc93434a5b65]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06a71f7-80d8-4523-8329-67c307bd289e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:31:10 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:31:10 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[de979eb4-c24c-4ddc-a880-eaa633d19125]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG os_brick.utils [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] <== get_connector_properties: return (2199ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Updating existing volume attachment record: a4771ea0-6db5-4247-97ee-f9040f8e4931 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 3983741f-270b-4758-a676-245b7adc8cc8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance c04b39dd-3961-4e23-ad43-34a218f4a472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance fea802b7-64d9-4c77-87a7-eaba1dce5c22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7307f3a3-1ad1-43f7-be49-9cd03a626cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 2621c5a2-acff-4055-9746-1b2f5829b39d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance d843d91a-afc3-45f8-9a89-8bc40e81f0d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 909a8a42-017d-4db3-a150-6861c20f0d31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance ff502988-e729-4509-bd2d-ff16bf9e0a08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:31:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.566s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:31:11 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:31:11 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:31:11 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:31:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-c04b39dd-3961-4e23-ad43-34a218f4a472" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:31:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-c04b39dd-3961-4e23-ad43-34a218f4a472" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:31:11 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 01:31:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:12 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Updating instance_info_cache with network_info: [{"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:31:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-c04b39dd-3961-4e23-ad43-34a218f4a472" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:31:12 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 01:31:12 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:31:12 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:31:12 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:31:12 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:31:12 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:31:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:15 user nova-compute[74996]: DEBUG nova.compute.manager [req-66439f3b-632b-4d6d-9fc4-932a9b93eaf1 req-250dd177-3b61-4d07-a8d1-316a92d5cdde service nova] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Received event network-changed-c117844a-dde1-4486-940f-56b671a79d69 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:31:15 user nova-compute[74996]: DEBUG nova.compute.manager [req-66439f3b-632b-4d6d-9fc4-932a9b93eaf1 req-250dd177-3b61-4d07-a8d1-316a92d5cdde service nova] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Refreshing instance network info cache due to event network-changed-c117844a-dde1-4486-940f-56b671a79d69. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:31:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-66439f3b-632b-4d6d-9fc4-932a9b93eaf1 req-250dd177-3b61-4d07-a8d1-316a92d5cdde service nova] Acquiring lock "refresh_cache-2621c5a2-acff-4055-9746-1b2f5829b39d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:31:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-66439f3b-632b-4d6d-9fc4-932a9b93eaf1 req-250dd177-3b61-4d07-a8d1-316a92d5cdde service nova] Acquired lock "refresh_cache-2621c5a2-acff-4055-9746-1b2f5829b39d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:31:15 user nova-compute[74996]: DEBUG nova.network.neutron [req-66439f3b-632b-4d6d-9fc4-932a9b93eaf1 req-250dd177-3b61-4d07-a8d1-316a92d5cdde service nova] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Refreshing network info cache for port c117844a-dde1-4486-940f-56b671a79d69 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:31:16 user nova-compute[74996]: DEBUG nova.network.neutron [req-66439f3b-632b-4d6d-9fc4-932a9b93eaf1 req-250dd177-3b61-4d07-a8d1-316a92d5cdde service nova] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Updated VIF entry in instance network info cache for port c117844a-dde1-4486-940f-56b671a79d69. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:31:16 user nova-compute[74996]: DEBUG nova.network.neutron [req-66439f3b-632b-4d6d-9fc4-932a9b93eaf1 req-250dd177-3b61-4d07-a8d1-316a92d5cdde service nova] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Updating instance_info_cache with network_info: [{"id": "c117844a-dde1-4486-940f-56b671a79d69", "address": "fa:16:3e:90:c7:2d", "network": {"id": "8bca3600-c671-4a05-9913-14a9531365d1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2106930518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91486d1ff074f7599b5bc2e771e28d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc117844a-dd", "ovs_interfaceid": "c117844a-dde1-4486-940f-56b671a79d69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:31:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-66439f3b-632b-4d6d-9fc4-932a9b93eaf1 req-250dd177-3b61-4d07-a8d1-316a92d5cdde service nova] Releasing lock "refresh_cache-2621c5a2-acff-4055-9746-1b2f5829b39d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:31:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Acquiring lock "2621c5a2-acff-4055-9746-1b2f5829b39d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:31:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "2621c5a2-acff-4055-9746-1b2f5829b39d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:31:21 user nova-compute[74996]: DEBUG nova.objects.instance [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lazy-loading 'flavor' on Instance uuid 2621c5a2-acff-4055-9746-1b2f5829b39d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:31:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "2621c5a2-acff-4055-9746-1b2f5829b39d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:31:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Acquiring lock "2621c5a2-acff-4055-9746-1b2f5829b39d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:31:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "2621c5a2-acff-4055-9746-1b2f5829b39d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:31:21 user nova-compute[74996]: INFO nova.compute.manager [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Attaching volume eed0f918-5b85-47c7-81df-65950e4e3715 to /dev/vdb
Nov 02 01:31:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:22 user nova-compute[74996]: DEBUG os_brick.utils [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:31:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[317afccd-b142-49be-9946-607e1d494bac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[db61b803-770f-4850-a8dd-9ca610652c70]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acbc011-b7e5-4e51-bd89-0aef679bef9a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9419ac4-c5e2-44cf-a90e-6f098fa57d53]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:31:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:31:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:31:22 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:31:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[52abef94-ec87-42a3-9aad-ab1e4e04a302]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:31:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:31:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:31:22 user nova-compute[74996]: DEBUG os_brick.utils [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:31:22 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Updating existing volume attachment record: fc4f4396-eeda-4928-9d77-22805811819f {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:31:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG os_brick.initiator.connector [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Factory for ISCSI on None {{(pid=74996) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jpzkySol', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:31:30 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:31:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:31:30 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:31:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:31:30 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c67548-9856-4a28-b76c-9f494ded7e05]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:31:30 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef223c3-a306-4347-b920-87812a9d1d98]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044] added
Nov 02 01:31:30 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae9cdbe-54a4-4c12-8eab-0e87edf2f873]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[217d6de1-d769-4bee-a8cf-bd2126ecef4e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jpzkySol {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jpzkySol" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4ef5ee-29a1-44c8-99f4-469b51afacb8]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jpzkySol'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e117ae3-2b97-44e1-8df2-b8976f369f11]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f288bc0-f4f2-4000-b828-7780b14f7228]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 01:31:30 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 01:31:30 user nova-compute[74996]:  {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:31:30 user nova-compute[74996]: WARNING os_brick.initiator.connectors.iscsi [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 01:31:30 user nova-compute[74996]: 
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044 -p 172.16.0.220:3260 --login" returned: 0 in 0.132s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7265bee7-4460-4971-88dd-a4af50bfea1a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044, portal: 172.16.0.220,3260]
Nov 02 01:31:30 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044, portal: 172.16.0.220,3260] successful.
Nov 02 01:31:30 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7047d365-9972-464f-b109-8ad551d1351a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1bfe3c-e9f9-48ec-87ea-4e0fb7cd0aa4]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044 (non-flash)
Nov 02 01:31:30 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044 (non-flash)
Nov 02 01:31:30 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] HCTL ('33', '-', '-', 0) found on session 1 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a9899a-dec8-4ddf-afaa-bd4f157e7c3e]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:30 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Searching for a device in session 1 and hctl ['33', '*', '*', 0] yield: None {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:31:31 user nova-compute[74996]: DEBUG nova.compute.manager [req-d5c7e187-ee19-4568-9119-ed7309e416d2 req-b3294f89-d034-4df0-b0f9-c2c9198c55d9 service nova] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Received event network-changed-7ee7d00e-996e-4ba6-9a7d-642404d24f74 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:31:31 user nova-compute[74996]: DEBUG nova.compute.manager [req-d5c7e187-ee19-4568-9119-ed7309e416d2 req-b3294f89-d034-4df0-b0f9-c2c9198c55d9 service nova] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Refreshing instance network info cache due to event network-changed-7ee7d00e-996e-4ba6-9a7d-642404d24f74. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:31:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d5c7e187-ee19-4568-9119-ed7309e416d2 req-b3294f89-d034-4df0-b0f9-c2c9198c55d9 service nova] Acquiring lock "refresh_cache-23ba82cb-ec9d-4b96-b205-3d9ac6bc8627" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:31:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d5c7e187-ee19-4568-9119-ed7309e416d2 req-b3294f89-d034-4df0-b0f9-c2c9198c55d9 service nova] Acquired lock "refresh_cache-23ba82cb-ec9d-4b96-b205-3d9ac6bc8627" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:31:31 user nova-compute[74996]: DEBUG nova.network.neutron [req-d5c7e187-ee19-4568-9119-ed7309e416d2 req-b3294f89-d034-4df0-b0f9-c2c9198c55d9 service nova] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Refreshing network info cache for port 7ee7d00e-996e-4ba6-9a7d-642404d24f74 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:31:31 user nova-compute[74996]: DEBUG nova.network.neutron [req-d5c7e187-ee19-4568-9119-ed7309e416d2 req-b3294f89-d034-4df0-b0f9-c2c9198c55d9 service nova] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Updated VIF entry in instance network info cache for port 7ee7d00e-996e-4ba6-9a7d-642404d24f74. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:31:31 user nova-compute[74996]: DEBUG nova.network.neutron [req-d5c7e187-ee19-4568-9119-ed7309e416d2 req-b3294f89-d034-4df0-b0f9-c2c9198c55d9 service nova] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Updating instance_info_cache with network_info: [{"id": "7ee7d00e-996e-4ba6-9a7d-642404d24f74", "address": "fa:16:3e:d4:2e:a5", "network": {"id": "d4db391d-89bd-4b81-8521-e90539933295", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-627212228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd6782fc20434d9d9d40527985ce3ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee7d00e-99", "ovs_interfaceid": "7ee7d00e-996e-4ba6-9a7d-642404d24f74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:31:31 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Searching for a device in session 1 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:31:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jpzkySol', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:31:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:31:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '26463643238393733', 'path': '/dev/sdb'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:31:31 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463643238393733', 'path': '/dev/sdb'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:31:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d5c7e187-ee19-4568-9119-ed7309e416d2 req-b3294f89-d034-4df0-b0f9-c2c9198c55d9 service nova] Releasing lock "refresh_cache-23ba82cb-ec9d-4b96-b205-3d9ac6bc8627" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:31:31 user nova-compute[74996]: DEBUG nova.objects.instance [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lazy-loading 'flavor' on Instance uuid 3983741f-270b-4758-a676-245b7adc8cc8 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:31:31 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 01:31:31 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:31:31 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 01:31:31 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:31:31 user nova-compute[74996]:   <serial>e8e2e33f-9f5b-490a-9998-f340837ab044</serial>
Nov 02 01:31:31 user nova-compute[74996]: </disk>
Nov 02 01:31:31 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 01:31:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:31:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:31:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] No VIF found with MAC fa:16:3e:ad:63:3e, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:31:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c437c6da-7089-4933-9a01-7fa5c4e99af7 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "3983741f-270b-4758-a676-245b7adc8cc8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.570s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:31:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Acquiring lock "3983741f-270b-4758-a676-245b7adc8cc8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:31:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "3983741f-270b-4758-a676-245b7adc8cc8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:31:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Acquiring lock "3983741f-270b-4758-a676-245b7adc8cc8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:31:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "3983741f-270b-4758-a676-245b7adc8cc8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:31:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "3983741f-270b-4758-a676-245b7adc8cc8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:31:32 user nova-compute[74996]: INFO nova.compute.manager [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Terminating instance
Nov 02 01:31:32 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-4e74b4a8-e137-4f1f-a9cb-e24a702669f2 req-19c01ff9-6687-44e9-9aa5-eb89333c4c95 service nova] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Received event network-vif-unplugged-975424fa-4f7a-4483-bf55-e66c9f95f2b5 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4e74b4a8-e137-4f1f-a9cb-e24a702669f2 req-19c01ff9-6687-44e9-9aa5-eb89333c4c95 service nova] Acquiring lock "3983741f-270b-4758-a676-245b7adc8cc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4e74b4a8-e137-4f1f-a9cb-e24a702669f2 req-19c01ff9-6687-44e9-9aa5-eb89333c4c95 service nova] Lock "3983741f-270b-4758-a676-245b7adc8cc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4e74b4a8-e137-4f1f-a9cb-e24a702669f2 req-19c01ff9-6687-44e9-9aa5-eb89333c4c95 service nova] Lock "3983741f-270b-4758-a676-245b7adc8cc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-4e74b4a8-e137-4f1f-a9cb-e24a702669f2 req-19c01ff9-6687-44e9-9aa5-eb89333c4c95 service nova] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] No waiting events found dispatching network-vif-unplugged-975424fa-4f7a-4483-bf55-e66c9f95f2b5 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-4e74b4a8-e137-4f1f-a9cb-e24a702669f2 req-19c01ff9-6687-44e9-9aa5-eb89333c4c95 service nova] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Received event network-vif-unplugged-975424fa-4f7a-4483-bf55-e66c9f95f2b5 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:31:33 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Instance destroyed successfully.
Nov 02 01:31:33 user nova-compute[74996]: DEBUG nova.objects.instance [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lazy-loading 'resources' on Instance uuid 3983741f-270b-4758-a676-245b7adc8cc8 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:29:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1794916877',display_name='tempest-DeleteServersTestJSON-server-1794916877',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1794916877',id=1,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:29:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eda3a1bcf0fa436c89c8047b8c410176',ramdisk_id='',reservation_id='r-mli5h0ea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-940408768',owner_user_name='tempest-DeleteServersTestJSON-940408768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:29:30Z,user_data=None,user_id='9a2eafbf71ee44c797c4497af8e5b22a',uuid=3983741f-270b-4758-a676-245b7adc8cc8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "975424fa-4f7a-4483-bf55-e66c9f95f2b5", "address": "fa:16:3e:ad:63:3e", "network": {"id": "19b893a3-ff14-40bd-bc4a-d5594baee6b0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1986254622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eda3a1bcf0fa436c89c8047b8c410176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap975424fa-4f", "ovs_interfaceid": "975424fa-4f7a-4483-bf55-e66c9f95f2b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Converting VIF {"id": "975424fa-4f7a-4483-bf55-e66c9f95f2b5", "address": "fa:16:3e:ad:63:3e", "network": {"id": "19b893a3-ff14-40bd-bc4a-d5594baee6b0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1986254622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eda3a1bcf0fa436c89c8047b8c410176", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap975424fa-4f", "ovs_interfaceid": "975424fa-4f7a-4483-bf55-e66c9f95f2b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:63:3e,bridge_name='br-int',has_traffic_filtering=True,id=975424fa-4f7a-4483-bf55-e66c9f95f2b5,network=Network(19b893a3-ff14-40bd-bc4a-d5594baee6b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap975424fa-4f') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG os_vif [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:63:3e,bridge_name='br-int',has_traffic_filtering=True,id=975424fa-4f7a-4483-bf55-e66c9f95f2b5,network=Network(19b893a3-ff14-40bd-bc4a-d5594baee6b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap975424fa-4f') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap975424fa-4f, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c5895643-f5de-43f6-9ba7-877723d77589) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:31:33 user nova-compute[74996]: INFO os_vif [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:63:3e,bridge_name='br-int',has_traffic_filtering=True,id=975424fa-4f7a-4483-bf55-e66c9f95f2b5,network=Network(19b893a3-ff14-40bd-bc4a-d5594baee6b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap975424fa-4f')
Nov 02 01:31:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jpzkySol', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:31:33 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:31:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f02800-138f-4459-ad81-4441f6e93348]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:31:33 user nova-compute[74996]: No targets found.
Nov 02 01:31:33 user nova-compute[74996]: iSNS:
Nov 02 01:31:33 user nova-compute[74996]: No targets found.
Nov 02 01:31:33 user nova-compute[74996]: STATIC:
Nov 02 01:31:33 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044
Nov 02 01:31:33 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:31:33 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:31:33 user nova-compute[74996]: FIRMWARE:
Nov 02 01:31:33 user nova-compute[74996]: No targets found.
Nov 02 01:31:33 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:31:33 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:31:33 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0874d65b-b6cd-438f-9521-426abaffd73b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f233fd4-a905-4a68-b1e9-e3c1fa7cd903]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044 (non-flash)
Nov 02 01:31:33 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044 (non-flash)
Nov 02 01:31:33 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830c407130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044'): ({'sdb'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Removing single pathed devices sdb {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66ee4fe-7892-4c55-a61e-bceef845b0b0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0996ff-6b85-4eb1-ae9b-b9ebfac285c4]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Flushing IO for device /dev/sdb {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1191554b-28ff-477e-ba1f-0d4a1605a06b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:31:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:34 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c70a27f-bd22-4625-b625-a2507d4d3b0a]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:34 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:31:34 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:31:34 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:31:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:34 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1f7729-ebdb-4f90-a632-536fb50113ed]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:34 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:31:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:34 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[67624e45-0955-4e43-92db-1b2a64b62784]: (4, ('Logging out of session [sid: 1, target: iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044, portal: 172.16.0.220,3260]\nLogout of [sid: 1, target: iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:34 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 1, target: iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044, portal: 172.16.0.220,3260]
Nov 02 01:31:34 user nova-compute[74996]: Logout of [sid: 1, target: iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044, portal: 172.16.0.220,3260] successful.
Nov 02 01:31:34 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:31:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e2e33f-9f5b-490a-9998-f340837ab044 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:34 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e91fc6-5d7d-4a12-8000-45370bd32ace]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:34 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:31:34 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:31:34 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] <== disconnect_volume: return (315ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:31:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:31:34 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Deleting instance files /opt/stack/data/nova/instances/3983741f-270b-4758-a676-245b7adc8cc8_del
Nov 02 01:31:34 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Deletion of /opt/stack/data/nova/instances/3983741f-270b-4758-a676-245b7adc8cc8_del complete
Nov 02 01:31:34 user nova-compute[74996]: INFO nova.compute.manager [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 02 01:31:34 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:31:34 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:31:34 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:31:34 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:31:34 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Took 0.51 seconds to deallocate network for instance.
Nov 02 01:31:35 user nova-compute[74996]: DEBUG nova.compute.manager [req-7dff1894-f794-4ac0-806a-4b3ff7495d1e req-3da4ac2d-367b-4221-b3fd-ab12c8e1e21c service nova] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Received event network-vif-plugged-975424fa-4f7a-4483-bf55-e66c9f95f2b5 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:31:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7dff1894-f794-4ac0-806a-4b3ff7495d1e req-3da4ac2d-367b-4221-b3fd-ab12c8e1e21c service nova] Acquiring lock "3983741f-270b-4758-a676-245b7adc8cc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:31:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7dff1894-f794-4ac0-806a-4b3ff7495d1e req-3da4ac2d-367b-4221-b3fd-ab12c8e1e21c service nova] Lock "3983741f-270b-4758-a676-245b7adc8cc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:31:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7dff1894-f794-4ac0-806a-4b3ff7495d1e req-3da4ac2d-367b-4221-b3fd-ab12c8e1e21c service nova] Lock "3983741f-270b-4758-a676-245b7adc8cc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:31:35 user nova-compute[74996]: DEBUG nova.compute.manager [req-7dff1894-f794-4ac0-806a-4b3ff7495d1e req-3da4ac2d-367b-4221-b3fd-ab12c8e1e21c service nova] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] No waiting events found dispatching network-vif-plugged-975424fa-4f7a-4483-bf55-e66c9f95f2b5 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:31:35 user nova-compute[74996]: WARNING nova.compute.manager [req-7dff1894-f794-4ac0-806a-4b3ff7495d1e req-3da4ac2d-367b-4221-b3fd-ab12c8e1e21c service nova] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Received unexpected event network-vif-plugged-975424fa-4f7a-4483-bf55-e66c9f95f2b5 for instance with vm_state active and task_state deleting.
Nov 02 01:31:35 user nova-compute[74996]: DEBUG nova.compute.manager [req-7dff1894-f794-4ac0-806a-4b3ff7495d1e req-3da4ac2d-367b-4221-b3fd-ab12c8e1e21c service nova] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Received event network-vif-deleted-975424fa-4f7a-4483-bf55-e66c9f95f2b5 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:31:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Acquiring lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:31:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:31:37 user nova-compute[74996]: DEBUG nova.objects.instance [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lazy-loading 'flavor' on Instance uuid 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:31:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:31:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Acquiring lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:31:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:31:37 user nova-compute[74996]: INFO nova.compute.manager [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Attaching volume 84358aab-af7e-4b30-9d7f-ce6bc683070e to /dev/sdc
Nov 02 01:31:37 user nova-compute[74996]: DEBUG os_brick.utils [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:31:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fda9af4-5073-4a8d-b548-90d75ea6420d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[221c5064-0ee1-492b-9a25-9ea5b7fa2126]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8bfbf1-4798-4cdf-bef8-f070200bde25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e717862f-35a9-4e51-a34b-308109fc3bd1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:31:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:31:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:31:37 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:31:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa33c5f8-58de-4473-bccd-03d30c0ba51d]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:31:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:31:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:31:37 user nova-compute[74996]: DEBUG os_brick.utils [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:31:37 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Updating existing volume attachment record: b64bdf5d-9e18-4584-b841-47bfc8a09173 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:31:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:38 user nova-compute[74996]: DEBUG nova.compute.manager [req-fb775454-64bb-4df1-aabc-e8cbecfa3cd4 req-b73cc45a-a5d2-4c0f-b9ce-3f7125eac040 service nova] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Received event network-changed-88b99660-8af7-4f3a-95fc-a797a886a253 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:31:38 user nova-compute[74996]: DEBUG nova.compute.manager [req-fb775454-64bb-4df1-aabc-e8cbecfa3cd4 req-b73cc45a-a5d2-4c0f-b9ce-3f7125eac040 service nova] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Refreshing instance network info cache due to event network-changed-88b99660-8af7-4f3a-95fc-a797a886a253. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:31:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-fb775454-64bb-4df1-aabc-e8cbecfa3cd4 req-b73cc45a-a5d2-4c0f-b9ce-3f7125eac040 service nova] Acquiring lock "refresh_cache-d843d91a-afc3-45f8-9a89-8bc40e81f0d0" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:31:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-fb775454-64bb-4df1-aabc-e8cbecfa3cd4 req-b73cc45a-a5d2-4c0f-b9ce-3f7125eac040 service nova] Acquired lock "refresh_cache-d843d91a-afc3-45f8-9a89-8bc40e81f0d0" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:31:38 user nova-compute[74996]: DEBUG nova.network.neutron [req-fb775454-64bb-4df1-aabc-e8cbecfa3cd4 req-b73cc45a-a5d2-4c0f-b9ce-3f7125eac040 service nova] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Refreshing network info cache for port 88b99660-8af7-4f3a-95fc-a797a886a253 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:31:39 user nova-compute[74996]: DEBUG nova.network.neutron [req-fb775454-64bb-4df1-aabc-e8cbecfa3cd4 req-b73cc45a-a5d2-4c0f-b9ce-3f7125eac040 service nova] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Updated VIF entry in instance network info cache for port 88b99660-8af7-4f3a-95fc-a797a886a253. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:31:39 user nova-compute[74996]: DEBUG nova.network.neutron [req-fb775454-64bb-4df1-aabc-e8cbecfa3cd4 req-b73cc45a-a5d2-4c0f-b9ce-3f7125eac040 service nova] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Updating instance_info_cache with network_info: [{"id": "88b99660-8af7-4f3a-95fc-a797a886a253", "address": "fa:16:3e:50:c2:14", "network": {"id": "e87c8aa5-2cd6-40da-8b68-dd408a09f642", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1821225633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc357c4550694aefaf63faf246b9eef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b99660-8a", "ovs_interfaceid": "88b99660-8af7-4f3a-95fc-a797a886a253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:31:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-fb775454-64bb-4df1-aabc-e8cbecfa3cd4 req-b73cc45a-a5d2-4c0f-b9ce-3f7125eac040 service nova] Releasing lock "refresh_cache-d843d91a-afc3-45f8-9a89-8bc40e81f0d0" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HTWqwYSu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:31:42 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:31:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:31:42 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:31:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:31:42 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:31:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[251f411b-2dbe-4f45-abe5-8dfc897eba54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:31:42 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b82a45c-211d-4eef-9ab6-a50390a4a1f1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715] added
Nov 02 01:31:42 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3148c913-98f1-43d7-8187-83479113fdd4]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a3c124-ee7a-4843-a737-4d59ef76229e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HTWqwYSu {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HTWqwYSu" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97502d5-5e55-423e-b9cc-bc7121cbb66a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HTWqwYSu'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cf8801-4f77-4443-889b-ee5aa7656187]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[54301168-adca-4dd4-9877-86fc5be307a9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 01:31:42 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 01:31:42 user nova-compute[74996]:  {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:31:42 user nova-compute[74996]: WARNING os_brick.initiator.connectors.iscsi [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 01:31:42 user nova-compute[74996]: 
Nov 02 01:31:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1796d3-8b62-45f1-8b3c-b334f31ffe57]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715, portal: 172.16.0.220,3260]
Nov 02 01:31:42 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715, portal: 172.16.0.220,3260] successful.
Nov 02 01:31:42 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:31:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a75ed7-02ba-4008-8cad-93c2b82bd496]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[46839927-3c44-4f04-b3b5-1cc3aea15e9a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 (non-flash)
Nov 02 01:31:43 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 (non-flash)
Nov 02 01:31:43 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe837ff-886c-47ca-bb50-579b93790042]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Acquiring lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG nova.objects.instance [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Lazy-loading 'flavor' on Instance uuid d843d91a-afc3-45f8-9a89-8bc40e81f0d0 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Acquiring lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:31:43 user nova-compute[74996]: INFO nova.compute.manager [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Attaching volume 5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 to /dev/vdb
Nov 02 01:31:43 user nova-compute[74996]: DEBUG os_brick.utils [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ba31bf-b5ad-4a39-a699-8f2653f9df27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd70092-e353-480e-8fd8-b7b3df3c81b2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:44 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f57e35-ef39-4f0a-8c78-3f805153aa38]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:44 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47b85ef-c41d-4d37-ab5b-7fba6f70111a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:31:44 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:31:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:44 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:31:44 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HTWqwYSu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:31:44 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:31:44 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23566363765366166', 'path': '/dev/sdb'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:31:44 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566363765366166', 'path': '/dev/sdb'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:31:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:31:44 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:31:44 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3045ea71-d1e1-47aa-97c6-51bb6583bc5e]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:44 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:31:44 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:31:44 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:31:44 user nova-compute[74996]: DEBUG os_brick.utils [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:31:44 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Updating existing volume attachment record: f8296e55-0213-4d8c-a10c-fe56de985cb2 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:31:44 user nova-compute[74996]: DEBUG nova.objects.instance [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lazy-loading 'flavor' on Instance uuid 2621c5a2-acff-4055-9746-1b2f5829b39d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:31:44 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 01:31:44 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:31:44 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 01:31:44 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:31:44 user nova-compute[74996]:   <serial>eed0f918-5b85-47c7-81df-65950e4e3715</serial>
Nov 02 01:31:44 user nova-compute[74996]: </disk>
Nov 02 01:31:44 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 01:31:44 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:31:44 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:31:44 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] No VIF found with MAC fa:16:3e:90:c7:2d, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:31:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:56 user nova-compute[74996]: INFO nova.compute.manager [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] [instance: 3983741f-270b-4758-a676-245b7adc8cc8] Took 22.02 seconds to detach 1 volumes for instance.
Nov 02 01:31:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:31:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:31:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7cefcd18-34fe-41f7-9e7f-2af6cbb73efd tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "2621c5a2-acff-4055-9746-1b2f5829b39d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 34.857s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:31:57 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Deleted allocations for instance 3983741f-270b-4758-a676-245b7adc8cc8
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1aa1ffdf-033a-4e23-b28b-28119f65ca47 tempest-DeleteServersTestJSON-940408768 tempest-DeleteServersTestJSON-940408768-project-member] Lock "3983741f-270b-4758-a676-245b7adc8cc8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 24.361s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zNIUvZxY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:31:57 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:31:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:31:57 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:31:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:31:57 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8513c0-f1c7-4b3d-a07a-f038ca64eb51]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:31:57 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdcbee4-ddf7-4c87-91aa-b5842e1d064c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e] added
Nov 02 01:31:57 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff95cf6-2976-45ef-b48a-29386185d090]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9862e2b-d3a7-440a-9adc-c3204dcdd419]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zNIUvZxY {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zNIUvZxY" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef1181f-5c7b-4895-bbf0-7a5ea9e128f6]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zNIUvZxY'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eec1279-ebc4-4eb9-8b60-89f1748290d8]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe84ac9-942d-4087-9e5c-1e8e142793fe]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 (non-flash)
Nov 02 01:31:57 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 (non-flash)
Nov 02 01:31:57 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b60630f-0e3b-4b36-96b5-4f17079629fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e, portal: 172.16.0.220,3260]
Nov 02 01:31:57 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e, portal: 172.16.0.220,3260] successful.
Nov 02 01:31:57 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c31e12-7688-47ed-9570-81c0113c06f7]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e9a0f2-552f-4a19-a28d-f0e2d278b8f5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 (non-flash)
Nov 02 01:31:57 user nova-compute[74996]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e (non-flash)
Nov 02 01:31:57 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 (non-flash)
Nov 02 01:31:57 user nova-compute[74996]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e (non-flash)
Nov 02 01:31:57 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dd310f-938d-4f1e-a81e-0ef47965a3a8]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:31:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zNIUvZxY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:31:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Acquiring lock "2621c5a2-acff-4055-9746-1b2f5829b39d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:31:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "2621c5a2-acff-4055-9746-1b2f5829b39d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:31:58 user nova-compute[74996]: INFO nova.compute.manager [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Detaching volume eed0f918-5b85-47c7-81df-65950e4e3715
Nov 02 01:31:58 user nova-compute[74996]: INFO nova.virt.block_device [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Attempting to driver detach volume eed0f918-5b85-47c7-81df-65950e4e3715 from mountpoint /dev/vdb
Nov 02 01:31:58 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Attempting to detach device vdb from instance 2621c5a2-acff-4055-9746-1b2f5829b39d from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 01:31:58 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 01:31:58 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:31:58 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 01:31:58 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:31:58 user nova-compute[74996]:   <serial>eed0f918-5b85-47c7-81df-65950e4e3715</serial>
Nov 02 01:31:58 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 01:31:58 user nova-compute[74996]: </disk>
Nov 02 01:31:58 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:31:58 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Successfully detached device vdb from instance 2621c5a2-acff-4055-9746-1b2f5829b39d from the persistent domain config.
Nov 02 01:31:58 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2621c5a2-acff-4055-9746-1b2f5829b39d from the live domain config. {{(pid=74996) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 01:31:58 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 01:31:58 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:31:58 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 01:31:58 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:31:58 user nova-compute[74996]:   <serial>eed0f918-5b85-47c7-81df-65950e4e3715</serial>
Nov 02 01:31:58 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 01:31:58 user nova-compute[74996]: </disk>
Nov 02 01:31:58 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:31:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:31:58 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:31:58 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26263633938386230', 'path': '/dev/sdc'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:31:58 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263633938386230', 'path': '/dev/sdc'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:31:58 user nova-compute[74996]: DEBUG nova.objects.instance [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lazy-loading 'flavor' on Instance uuid 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:31:58 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 01:31:58 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:31:58 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 01:31:58 user nova-compute[74996]:   <target dev="sdc" bus="scsi"/>
Nov 02 01:31:58 user nova-compute[74996]:   <serial>84358aab-af7e-4b30-9d7f-ce6bc683070e</serial>
Nov 02 01:31:58 user nova-compute[74996]:   <address type="drive" controller="0" unit="2"/>
Nov 02 01:31:58 user nova-compute[74996]: </disk>
Nov 02 01:31:58 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 01:31:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2621c5a2-acff-4055-9746-1b2f5829b39d {{(pid=74996) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 01:31:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] No BDM found with device name sda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:31:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:31:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:31:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] No VIF found with MAC fa:16:3e:d4:2e:a5, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:31:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6597f646-472b-43b9-88d1-755bba9b6bf2 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.290s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:32:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Acquiring lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:32:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:32:01 user nova-compute[74996]: INFO nova.compute.manager [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Detaching volume 84358aab-af7e-4b30-9d7f-ce6bc683070e
Nov 02 01:32:01 user nova-compute[74996]: INFO nova.virt.block_device [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Attempting to driver detach volume 84358aab-af7e-4b30-9d7f-ce6bc683070e from mountpoint /dev/sdc
Nov 02 01:32:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Attempting to detach device sdc from instance 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627 from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 01:32:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 01:32:01 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:32:01 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 01:32:01 user nova-compute[74996]:   <target dev="sdc" bus="scsi"/>
Nov 02 01:32:01 user nova-compute[74996]:   <serial>84358aab-af7e-4b30-9d7f-ce6bc683070e</serial>
Nov 02 01:32:01 user nova-compute[74996]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 02 01:32:01 user nova-compute[74996]: </disk>
Nov 02 01:32:01 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:32:01 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Successfully detached device sdc from instance 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627 from the persistent domain config.
Nov 02 01:32:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627 from the live domain config. {{(pid=74996) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 01:32:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 01:32:01 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:32:01 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 01:32:01 user nova-compute[74996]:   <target dev="sdc" bus="scsi"/>
Nov 02 01:32:01 user nova-compute[74996]:   <serial>84358aab-af7e-4b30-9d7f-ce6bc683070e</serial>
Nov 02 01:32:01 user nova-compute[74996]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 02 01:32:01 user nova-compute[74996]: </disk>
Nov 02 01:32:01 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:32:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627 {{(pid=74996) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 01:32:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CPsbYEoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:32:04 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:32:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:32:04 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:32:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:32:04 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb6a5cf-b08d-4762-b6c3-e2a63e0f24e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:32:04 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e63681-c97a-4ab2-a64a-330dde4836e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5] added
Nov 02 01:32:04 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f7fd9a-776e-491d-a998-a1a6f36d1445]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8b6e35-ae22-4df7-95f2-866cc5188193]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CPsbYEoO {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CPsbYEoO" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0a3244-c3a1-4118-a645-8aacd4ed2a3f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CPsbYEoO'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[126ebda4-e333-4e29-a20c-ec689361e9cf]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e0a2d9-10f6-4ed4-9548-53305953a781]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 (non-flash)
Nov 02 01:32:04 user nova-compute[74996]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e (non-flash)
Nov 02 01:32:04 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 (non-flash)
Nov 02 01:32:04 user nova-compute[74996]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e (non-flash)
Nov 02 01:32:04 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7cbd15-9b96-4ca4-a4bc-d9ea781e5bd7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5, portal: 172.16.0.220,3260]
Nov 02 01:32:04 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5, portal: 172.16.0.220,3260] successful.
Nov 02 01:32:04 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d42918-6cf8-41be-8807-705ff95e43db]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e01cdc-1354-4964-8d62-4bf60ac39368]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 (non-flash)
Nov 02 01:32:04 user nova-compute[74996]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e (non-flash)
Nov 02 01:32:04 user nova-compute[74996]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 (non-flash)
Nov 02 01:32:04 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 (non-flash)
Nov 02 01:32:04 user nova-compute[74996]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e (non-flash)
Nov 02 01:32:04 user nova-compute[74996]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 (non-flash)
Nov 02 01:32:04 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb0732e-ee4b-400c-87ad-d759b6f919e4]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CPsbYEoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:05 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:32:05 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23434386235373831', 'path': '/dev/sdd'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:32:05 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434386235373831', 'path': '/dev/sdd'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:32:05 user nova-compute[74996]: DEBUG nova.objects.instance [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Lazy-loading 'flavor' on Instance uuid d843d91a-afc3-45f8-9a89-8bc40e81f0d0 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:32:05 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] attach device xml: <disk type="block" device="disk">
Nov 02 01:32:05 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:32:05 user nova-compute[74996]:   <source dev="/dev/sdd"/>
Nov 02 01:32:05 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:32:05 user nova-compute[74996]:   <serial>5d50ca55-1169-4ad8-abfb-cd4b0baf67a5</serial>
Nov 02 01:32:05 user nova-compute[74996]: </disk>
Nov 02 01:32:05 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 01:32:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:32:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:32:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] No VIF found with MAC fa:16:3e:50:c2:14, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:32:06 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:32:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d2beaeb0-0813-49b9-b6ab-236dd09f8d0b tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.453s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:32:07 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:32:07 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:32:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:32:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:32:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:32:07 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:32:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e748cb8c-c37f-44d9-899d-0fcf2fcdefd2 tempest-VolumesAssistedSnapshotsTest-2111002868 tempest-VolumesAssistedSnapshotsTest-2111002868-project] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] volume_snapshot_create: create_info: {'snapshot_id': '6fbffbae-cfc9-493b-98e9-b8a34e562b28', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74996) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 02 01:32:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e748cb8c-c37f-44d9-899d-0fcf2fcdefd2 tempest-VolumesAssistedSnapshotsTest-2111002868 tempest-VolumesAssistedSnapshotsTest-2111002868-project] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] snap xml: <domainsnapshot>
Nov 02 01:32:07 user nova-compute[74996]:   <disks>
Nov 02 01:32:07 user nova-compute[74996]:     <disk name="/dev/sdd" snapshot="external" type="file">
Nov 02 01:32:07 user nova-compute[74996]:       <source file="/dev/new_file"/>
Nov 02 01:32:07 user nova-compute[74996]:     </disk>
Nov 02 01:32:07 user nova-compute[74996]:     <disk name="vda" snapshot="no"/>
Nov 02 01:32:07 user nova-compute[74996]:   </disks>
Nov 02 01:32:07 user nova-compute[74996]: </domainsnapshot>
Nov 02 01:32:07 user nova-compute[74996]:  {{(pid=74996) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 02 01:32:07 user nova-compute[74996]: DEBUG nova.objects.instance [None req-e748cb8c-c37f-44d9-899d-0fcf2fcdefd2 tempest-VolumesAssistedSnapshotsTest-2111002868 tempest-VolumesAssistedSnapshotsTest-2111002868-project] Lazy-loading 'system_metadata' on Instance uuid d843d91a-afc3-45f8-9a89-8bc40e81f0d0 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:32:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1b65a30d-63d1-496e-af60-a8b2b55c0a21 tempest-VolumesAssistedSnapshotsTest-2111002868 tempest-VolumesAssistedSnapshotsTest-2111002868-project] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] volume_snapshot_delete: delete_info: {'volume_id': '5d50ca55-1169-4ad8-abfb-cd4b0baf67a5'} {{(pid=74996) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [None req-1b65a30d-63d1-496e-af60-a8b2b55c0a21 tempest-VolumesAssistedSnapshotsTest-2111002868 tempest-VolumesAssistedSnapshotsTest-2111002868-project] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Traceback (most recent call last):
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]     if delete_info['type'] != 'qcow2':
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] KeyError: 'type'
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] 
Nov 02 01:32:07 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-e748cb8c-c37f-44d9-899d-0fcf2fcdefd2 tempest-VolumesAssistedSnapshotsTest-2111002868 tempest-VolumesAssistedSnapshotsTest-2111002868-project] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [None req-e748cb8c-c37f-44d9-899d-0fcf2fcdefd2 tempest-VolumesAssistedSnapshotsTest-2111002868 tempest-VolumesAssistedSnapshotsTest-2111002868-project] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Traceback (most recent call last):
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]     rv = execute(f, *args, **kwargs)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]     six.reraise(c, e, tb)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]     raise value
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]     rv = meth(*args, **kwargs)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] 
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [None req-e748cb8c-c37f-44d9-899d-0fcf2fcdefd2 tempest-VolumesAssistedSnapshotsTest-2111002868 tempest-VolumesAssistedSnapshotsTest-2111002868-project] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Traceback (most recent call last):
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]     self._volume_snapshot_create(context, instance, guest,
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]     rv = execute(f, *args, **kwargs)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]     six.reraise(c, e, tb)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]     raise value
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]     rv = meth(*args, **kwargs)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] 
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [None req-1b65a30d-63d1-496e-af60-a8b2b55c0a21 tempest-VolumesAssistedSnapshotsTest-2111002868 tempest-VolumesAssistedSnapshotsTest-2111002868-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver 
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver 
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-64df3b38-de43-4848-aa61-e10d32655dff)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver 
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver 
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver 
Nov 02 01:32:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server [None req-1b65a30d-63d1-496e-af60-a8b2b55c0a21 tempest-VolumesAssistedSnapshotsTest-2111002868 tempest-VolumesAssistedSnapshotsTest-2111002868-project] Exception during message handling: KeyError: 'type'
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server 
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver [None req-e748cb8c-c37f-44d9-899d-0fcf2fcdefd2 tempest-VolumesAssistedSnapshotsTest-2111002868 tempest-VolumesAssistedSnapshotsTest-2111002868-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 6fbffbae-cfc9-493b-98e9-b8a34e562b28 could not be found.
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     raise value
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver 
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver 
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 6fbffbae-cfc9-493b-98e9-b8a34e562b28 could not be found. (HTTP 404) (Request-ID: req-b1b5733c-03df-4dca-a295-80cb0261277e)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver 
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver 
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 6fbffbae-cfc9-493b-98e9-b8a34e562b28 could not be found.
Nov 02 01:32:07 user nova-compute[74996]: ERROR nova.virt.libvirt.driver 
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server [None req-e748cb8c-c37f-44d9-899d-0fcf2fcdefd2 tempest-VolumesAssistedSnapshotsTest-2111002868 tempest-VolumesAssistedSnapshotsTest-2111002868-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     raise value
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 02 01:32:07 user nova-compute[74996]: ERROR oslo_messaging.rpc.server 
Nov 02 01:32:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Acquiring lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:32:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:32:07 user nova-compute[74996]: INFO nova.compute.manager [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Detaching volume 5d50ca55-1169-4ad8-abfb-cd4b0baf67a5
Nov 02 01:32:08 user nova-compute[74996]: INFO nova.virt.block_device [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Attempting to driver detach volume 5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 from mountpoint /dev/vdb
Nov 02 01:32:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:08 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Attempting to detach device vdb from instance d843d91a-afc3-45f8-9a89-8bc40e81f0d0 from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 01:32:08 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] detach device xml: <disk type="block" device="disk">
Nov 02 01:32:08 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:32:08 user nova-compute[74996]:   <source dev="/dev/sdd"/>
Nov 02 01:32:08 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:32:08 user nova-compute[74996]:   <serial>5d50ca55-1169-4ad8-abfb-cd4b0baf67a5</serial>
Nov 02 01:32:08 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 01:32:08 user nova-compute[74996]: </disk>
Nov 02 01:32:08 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:32:08 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Successfully detached device vdb from instance d843d91a-afc3-45f8-9a89-8bc40e81f0d0 from the persistent domain config.
Nov 02 01:32:08 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d843d91a-afc3-45f8-9a89-8bc40e81f0d0 from the live domain config. {{(pid=74996) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 01:32:08 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] detach device xml: <disk type="block" device="disk">
Nov 02 01:32:08 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:32:08 user nova-compute[74996]:   <source dev="/dev/sdd"/>
Nov 02 01:32:08 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:32:08 user nova-compute[74996]:   <serial>5d50ca55-1169-4ad8-abfb-cd4b0baf67a5</serial>
Nov 02 01:32:08 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 01:32:08 user nova-compute[74996]: </disk>
Nov 02 01:32:08 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:32:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:08 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:32:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:08 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d843d91a-afc3-45f8-9a89-8bc40e81f0d0 {{(pid=74996) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 01:32:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909a8a42-017d-4db3-a150-6861c20f0d31/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909a8a42-017d-4db3-a150-6861c20f0d31/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909a8a42-017d-4db3-a150-6861c20f0d31/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/909a8a42-017d-4db3-a150-6861c20f0d31/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:10 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:11 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:32:11 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:32:11 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=7729MB free_disk=25.347576141357422GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:32:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:32:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:32:11 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance c04b39dd-3961-4e23-ad43-34a218f4a472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:32:11 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance fea802b7-64d9-4c77-87a7-eaba1dce5c22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:32:11 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7307f3a3-1ad1-43f7-be49-9cd03a626cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:32:11 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 2621c5a2-acff-4055-9746-1b2f5829b39d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:32:11 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:32:11 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance d843d91a-afc3-45f8-9a89-8bc40e81f0d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:32:11 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 909a8a42-017d-4db3-a150-6861c20f0d31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:32:11 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance ff502988-e729-4509-bd2d-ff16bf9e0a08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:32:11 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:32:11 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:32:11 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:32:11 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:32:11 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:32:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.482s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:32:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:12 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:32:12 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:32:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-fea802b7-64d9-4c77-87a7-eaba1dce5c22" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:32:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-fea802b7-64d9-4c77-87a7-eaba1dce5c22" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:32:12 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 01:32:13 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Updating instance_info_cache with network_info: [{"id": "c458c481-1588-4776-a269-8f95b72195dd", "address": "fa:16:3e:7f:23:3e", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc458c481-15", "ovs_interfaceid": "c458c481-1588-4776-a269-8f95b72195dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:32:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-fea802b7-64d9-4c77-87a7-eaba1dce5c22" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:32:13 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 01:32:13 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:32:13 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:32:13 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:32:13 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:32:13 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:32:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:16 user nova-compute[74996]: DEBUG nova.compute.manager [req-98f59778-b63d-4296-8c95-c0fb7e77c064 req-031fcfc0-e834-4c08-a570-9da30e6e6952 service nova] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Received event network-changed-a7987061-7da2-417b-a279-9ed0d87f5488 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:32:16 user nova-compute[74996]: DEBUG nova.compute.manager [req-98f59778-b63d-4296-8c95-c0fb7e77c064 req-031fcfc0-e834-4c08-a570-9da30e6e6952 service nova] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Refreshing instance network info cache due to event network-changed-a7987061-7da2-417b-a279-9ed0d87f5488. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:32:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-98f59778-b63d-4296-8c95-c0fb7e77c064 req-031fcfc0-e834-4c08-a570-9da30e6e6952 service nova] Acquiring lock "refresh_cache-ff502988-e729-4509-bd2d-ff16bf9e0a08" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:32:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-98f59778-b63d-4296-8c95-c0fb7e77c064 req-031fcfc0-e834-4c08-a570-9da30e6e6952 service nova] Acquired lock "refresh_cache-ff502988-e729-4509-bd2d-ff16bf9e0a08" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:32:16 user nova-compute[74996]: DEBUG nova.network.neutron [req-98f59778-b63d-4296-8c95-c0fb7e77c064 req-031fcfc0-e834-4c08-a570-9da30e6e6952 service nova] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Refreshing network info cache for port a7987061-7da2-417b-a279-9ed0d87f5488 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:32:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Acquiring lock "ff502988-e729-4509-bd2d-ff16bf9e0a08" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:32:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lock "ff502988-e729-4509-bd2d-ff16bf9e0a08" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:32:16 user nova-compute[74996]: DEBUG nova.objects.instance [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lazy-loading 'flavor' on Instance uuid ff502988-e729-4509-bd2d-ff16bf9e0a08 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:32:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lock "ff502988-e729-4509-bd2d-ff16bf9e0a08" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:32:16 user nova-compute[74996]: DEBUG nova.network.neutron [req-98f59778-b63d-4296-8c95-c0fb7e77c064 req-031fcfc0-e834-4c08-a570-9da30e6e6952 service nova] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Updated VIF entry in instance network info cache for port a7987061-7da2-417b-a279-9ed0d87f5488. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:32:16 user nova-compute[74996]: DEBUG nova.network.neutron [req-98f59778-b63d-4296-8c95-c0fb7e77c064 req-031fcfc0-e834-4c08-a570-9da30e6e6952 service nova] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Updating instance_info_cache with network_info: [{"id": "a7987061-7da2-417b-a279-9ed0d87f5488", "address": "fa:16:3e:3f:49:3f", "network": {"id": "2a0924da-5d99-47ea-be8c-887374c16253", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2096520879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8ece99d67094759b97f5209450d3ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7987061-7d", "ovs_interfaceid": "a7987061-7da2-417b-a279-9ed0d87f5488", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:32:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-98f59778-b63d-4296-8c95-c0fb7e77c064 req-031fcfc0-e834-4c08-a570-9da30e6e6952 service nova] Releasing lock "refresh_cache-ff502988-e729-4509-bd2d-ff16bf9e0a08" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:32:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Acquiring lock "ff502988-e729-4509-bd2d-ff16bf9e0a08" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:32:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lock "ff502988-e729-4509-bd2d-ff16bf9e0a08" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:32:16 user nova-compute[74996]: INFO nova.compute.manager [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Attaching volume 92b78930-a1df-4860-96ee-a62bfbbb3a2a to /dev/vdb
Nov 02 01:32:16 user nova-compute[74996]: DEBUG os_brick.utils [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:32:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:17 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1e4e40-c257-4957-907c-d77a6225a885]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:17 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2635a34f-026a-444e-96cf-b8bd37230e3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:17 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc1fcfd-bf03-4c52-a335-a5e5cf669af0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:17 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bd5844-f277-488e-af3a-caa97b70ad62]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:32:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:32:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:32:17 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:32:17 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e089ea1-27b8-4e67-856e-5a058f72d7c7]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:32:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:32:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:32:17 user nova-compute[74996]: DEBUG os_brick.utils [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:32:17 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Updating existing volume attachment record: 7926dd47-c04e-41ba-bec5-7c56f8c5a598 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:32:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:19 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2621c5a2-acff-4055-9746-1b2f5829b39d is timed out.
Nov 02 01:32:19 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Successfully detached device vdb from instance 2621c5a2-acff-4055-9746-1b2f5829b39d from the live domain config.
Nov 02 01:32:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HTWqwYSu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:32:19 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:32:19 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9318362-b597-4362-a3b9-a9d4c9f2e9cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:32:19 user nova-compute[74996]: No targets found.
Nov 02 01:32:19 user nova-compute[74996]: iSNS:
Nov 02 01:32:19 user nova-compute[74996]: No targets found.
Nov 02 01:32:19 user nova-compute[74996]: STATIC:
Nov 02 01:32:19 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715
Nov 02 01:32:19 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:32:19 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:32:19 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e
Nov 02 01:32:19 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:32:19 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:32:19 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5
Nov 02 01:32:19 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:32:19 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:32:19 user nova-compute[74996]: FIRMWARE:
Nov 02 01:32:19 user nova-compute[74996]: No targets found.
Nov 02 01:32:19 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:32:19 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:32:19 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f491949-71df-4792-abd7-fb287da8e334]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0db3f63-319c-493d-a91b-3070f7f55567]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 (non-flash)
Nov 02 01:32:19 user nova-compute[74996]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e (non-flash)
Nov 02 01:32:19 user nova-compute[74996]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 (non-flash)
Nov 02 01:32:19 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 (non-flash)
Nov 02 01:32:19 user nova-compute[74996]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e (non-flash)
Nov 02 01:32:19 user nova-compute[74996]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 (non-flash)
Nov 02 01:32:19 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e87cb7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715'): ({'sdb'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Removing single pathed devices sdb {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[683fae59-265d-49eb-8d46-1058fdc6dde8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ef9dfc-e487-413f-8167-849be34ce669]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Flushing IO for device /dev/sdb {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.011s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03e4d75-5ccf-4c68-a0bd-6b16f75bad04]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9a03ae-b86a-41dd-9e96-763f0774edd9]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa953df1-615e-468e-8eb9-3014c9dfe960]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa62e53-a24b-4b85-a81d-55f2e13de291]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715, portal: 172.16.0.220,3260]
Nov 02 01:32:19 user nova-compute[74996]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715, portal: 172.16.0.220,3260] successful.
Nov 02 01:32:19 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eed0f918-5b85-47c7-81df-65950e4e3715 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0588dc-fd42-41d2-af4e-129726b5b5fb]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] <== disconnect_volume: return (286ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a38df1e7-2e1e-49cd-9049-625f8e8d59ed tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Acquiring lock "909a8a42-017d-4db3-a150-6861c20f0d31" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a38df1e7-2e1e-49cd-9049-625f8e8d59ed tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Lock "909a8a42-017d-4db3-a150-6861c20f0d31" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a38df1e7-2e1e-49cd-9049-625f8e8d59ed tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Acquiring lock "909a8a42-017d-4db3-a150-6861c20f0d31-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a38df1e7-2e1e-49cd-9049-625f8e8d59ed tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Lock "909a8a42-017d-4db3-a150-6861c20f0d31-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a38df1e7-2e1e-49cd-9049-625f8e8d59ed tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Lock "909a8a42-017d-4db3-a150-6861c20f0d31-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:32:19 user nova-compute[74996]: INFO nova.compute.manager [None req-a38df1e7-2e1e-49cd-9049-625f8e8d59ed tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Terminating instance
Nov 02 01:32:19 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a38df1e7-2e1e-49cd-9049-625f8e8d59ed tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:32:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:20 user nova-compute[74996]: DEBUG nova.compute.manager [req-047d0633-fdfe-4022-9833-dab344463b04 req-3c131831-1bcf-4901-ac79-3d762e376269 service nova] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Received event network-vif-unplugged-28e931f0-f97b-41ee-8629-51e34d358056 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:32:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-047d0633-fdfe-4022-9833-dab344463b04 req-3c131831-1bcf-4901-ac79-3d762e376269 service nova] Acquiring lock "909a8a42-017d-4db3-a150-6861c20f0d31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:32:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-047d0633-fdfe-4022-9833-dab344463b04 req-3c131831-1bcf-4901-ac79-3d762e376269 service nova] Lock "909a8a42-017d-4db3-a150-6861c20f0d31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:32:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-047d0633-fdfe-4022-9833-dab344463b04 req-3c131831-1bcf-4901-ac79-3d762e376269 service nova] Lock "909a8a42-017d-4db3-a150-6861c20f0d31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:32:20 user nova-compute[74996]: DEBUG nova.compute.manager [req-047d0633-fdfe-4022-9833-dab344463b04 req-3c131831-1bcf-4901-ac79-3d762e376269 service nova] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] No waiting events found dispatching network-vif-unplugged-28e931f0-f97b-41ee-8629-51e34d358056 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:32:20 user nova-compute[74996]: DEBUG nova.compute.manager [req-047d0633-fdfe-4022-9833-dab344463b04 req-3c131831-1bcf-4901-ac79-3d762e376269 service nova] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Received event network-vif-unplugged-28e931f0-f97b-41ee-8629-51e34d358056 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:32:20 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Instance destroyed successfully.
Nov 02 01:32:20 user nova-compute[74996]: DEBUG nova.objects.instance [None req-a38df1e7-2e1e-49cd-9049-625f8e8d59ed tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Lazy-loading 'resources' on Instance uuid 909a8a42-017d-4db3-a150-6861c20f0d31 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:32:20 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-a38df1e7-2e1e-49cd-9049-625f8e8d59ed tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:29:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-833894709',display_name='tempest-VolumesActionsTest-instance-833894709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-833894709',id=8,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:30:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3dfcf41fa791405f8b7679fa0060f2f9',ramdisk_id='',reservation_id='r-ymbem7uh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-742258024',owner_user_name='tempest-VolumesActionsTest-742258024-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:30:02Z,user_data=None,user_id='844b526666b34c4d837cb2aff9d6f036',uuid=909a8a42-017d-4db3-a150-6861c20f0d31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28e931f0-f97b-41ee-8629-51e34d358056", "address": "fa:16:3e:2d:e6:29", "network": {"id": "4223d148-0d8a-4df4-966d-e576de223b86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-984618786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dfcf41fa791405f8b7679fa0060f2f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e931f0-f9", "ovs_interfaceid": "28e931f0-f97b-41ee-8629-51e34d358056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:32:20 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-a38df1e7-2e1e-49cd-9049-625f8e8d59ed tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Converting VIF {"id": "28e931f0-f97b-41ee-8629-51e34d358056", "address": "fa:16:3e:2d:e6:29", "network": {"id": "4223d148-0d8a-4df4-966d-e576de223b86", "bridge": "br-int", "label": "tempest-VolumesActionsTest-984618786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dfcf41fa791405f8b7679fa0060f2f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e931f0-f9", "ovs_interfaceid": "28e931f0-f97b-41ee-8629-51e34d358056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:32:20 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-a38df1e7-2e1e-49cd-9049-625f8e8d59ed tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:e6:29,bridge_name='br-int',has_traffic_filtering=True,id=28e931f0-f97b-41ee-8629-51e34d358056,network=Network(4223d148-0d8a-4df4-966d-e576de223b86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e931f0-f9') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:32:20 user nova-compute[74996]: DEBUG os_vif [None req-a38df1e7-2e1e-49cd-9049-625f8e8d59ed tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:e6:29,bridge_name='br-int',has_traffic_filtering=True,id=28e931f0-f97b-41ee-8629-51e34d358056,network=Network(4223d148-0d8a-4df4-966d-e576de223b86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e931f0-f9') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:32:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28e931f0-f9, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:32:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:32:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd55265a-5bf8-429f-ad37-dce979f35e8c) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:32:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:20 user nova-compute[74996]: INFO os_vif [None req-a38df1e7-2e1e-49cd-9049-625f8e8d59ed tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:e6:29,bridge_name='br-int',has_traffic_filtering=True,id=28e931f0-f97b-41ee-8629-51e34d358056,network=Network(4223d148-0d8a-4df4-966d-e576de223b86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e931f0-f9')
Nov 02 01:32:20 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-a38df1e7-2e1e-49cd-9049-625f8e8d59ed tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Deleting instance files /opt/stack/data/nova/instances/909a8a42-017d-4db3-a150-6861c20f0d31_del
Nov 02 01:32:20 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-a38df1e7-2e1e-49cd-9049-625f8e8d59ed tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Deletion of /opt/stack/data/nova/instances/909a8a42-017d-4db3-a150-6861c20f0d31_del complete
Nov 02 01:32:20 user nova-compute[74996]: INFO nova.compute.manager [None req-a38df1e7-2e1e-49cd-9049-625f8e8d59ed tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 02 01:32:20 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-a38df1e7-2e1e-49cd-9049-625f8e8d59ed tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:32:20 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:32:20 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:32:21 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Took 0.50 seconds to deallocate network for instance.
Nov 02 01:32:21 user nova-compute[74996]: DEBUG nova.compute.manager [req-6b7e20be-3e89-4621-9cd5-5123c148ee76 req-7a4d0087-da39-44b0-85e9-74f05c6212bb service nova] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Received event network-vif-deleted-28e931f0-f97b-41ee-8629-51e34d358056 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a38df1e7-2e1e-49cd-9049-625f8e8d59ed tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a38df1e7-2e1e-49cd-9049-625f8e8d59ed tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-a38df1e7-2e1e-49cd-9049-625f8e8d59ed tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-a38df1e7-2e1e-49cd-9049-625f8e8d59ed tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a38df1e7-2e1e-49cd-9049-625f8e8d59ed tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:32:21 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-a38df1e7-2e1e-49cd-9049-625f8e8d59ed tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Deleted allocations for instance 909a8a42-017d-4db3-a150-6861c20f0d31
Nov 02 01:32:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a38df1e7-2e1e-49cd-9049-625f8e8d59ed tempest-VolumesActionsTest-742258024 tempest-VolumesActionsTest-742258024-project-member] Lock "909a8a42-017d-4db3-a150-6861c20f0d31" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.716s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:32:21 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627 is timed out.
Nov 02 01:32:21 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Successfully detached device sdc from instance 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627 from the live domain config.
Nov 02 01:32:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zNIUvZxY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:32:21 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:32:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11b5395-9074-496d-8edb-fb88cf8f61b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:32:21 user nova-compute[74996]: No targets found.
Nov 02 01:32:21 user nova-compute[74996]: iSNS:
Nov 02 01:32:21 user nova-compute[74996]: No targets found.
Nov 02 01:32:21 user nova-compute[74996]: STATIC:
Nov 02 01:32:21 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e
Nov 02 01:32:21 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:32:21 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:32:21 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5
Nov 02 01:32:21 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:32:21 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:32:21 user nova-compute[74996]: FIRMWARE:
Nov 02 01:32:21 user nova-compute[74996]: No targets found.
Nov 02 01:32:21 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:32:21 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:32:21 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9486dcf7-3b5f-4324-9f55-b26e8dd85a89]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e510ae1d-c81e-4f59-8caf-65dc1687f290]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e (non-flash)
Nov 02 01:32:21 user nova-compute[74996]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 (non-flash)
Nov 02 01:32:21 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e (non-flash)
Nov 02 01:32:21 user nova-compute[74996]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 (non-flash)
Nov 02 01:32:21 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830c12c160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e'): ({'sdc'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Removing single pathed devices sdc {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec82887-8f2f-4701-9794-8065bf10d45b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f87bda-39af-493b-8eb9-1d08db071b50]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Flushing IO for device /dev/sdc {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[354add99-f71a-426a-aa0f-7dff0e75206a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0d7ddc-1c9e-4619-99ba-b52dbac1ae4e]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e11e4e3-13d7-493f-b96d-962d2c6c83d9]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:32:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9dec46f-da6d-469a-89c9-337bcfc14c55]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e, portal: 172.16.0.220,3260]
Nov 02 01:32:22 user nova-compute[74996]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e, portal: 172.16.0.220,3260] successful.
Nov 02 01:32:22 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:32:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84358aab-af7e-4b30-9d7f-ce6bc683070e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf56877-10ed-4cc6-be3f-7faef0da36aa]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:32:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:32:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] <== disconnect_volume: return (326ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:32:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:32:22 user nova-compute[74996]: DEBUG nova.compute.manager [req-1594511c-3519-4c39-9c7c-ee43a205da63 req-ff5c33b8-2be2-48c1-8777-f169ed9fe39d service nova] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Received event network-vif-plugged-28e931f0-f97b-41ee-8629-51e34d358056 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:32:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1594511c-3519-4c39-9c7c-ee43a205da63 req-ff5c33b8-2be2-48c1-8777-f169ed9fe39d service nova] Acquiring lock "909a8a42-017d-4db3-a150-6861c20f0d31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:32:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1594511c-3519-4c39-9c7c-ee43a205da63 req-ff5c33b8-2be2-48c1-8777-f169ed9fe39d service nova] Lock "909a8a42-017d-4db3-a150-6861c20f0d31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:32:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1594511c-3519-4c39-9c7c-ee43a205da63 req-ff5c33b8-2be2-48c1-8777-f169ed9fe39d service nova] Lock "909a8a42-017d-4db3-a150-6861c20f0d31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:32:22 user nova-compute[74996]: DEBUG nova.compute.manager [req-1594511c-3519-4c39-9c7c-ee43a205da63 req-ff5c33b8-2be2-48c1-8777-f169ed9fe39d service nova] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] No waiting events found dispatching network-vif-plugged-28e931f0-f97b-41ee-8629-51e34d358056 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:32:22 user nova-compute[74996]: WARNING nova.compute.manager [req-1594511c-3519-4c39-9c7c-ee43a205da63 req-ff5c33b8-2be2-48c1-8777-f169ed9fe39d service nova] [instance: 909a8a42-017d-4db3-a150-6861c20f0d31] Received unexpected event network-vif-plugged-28e931f0-f97b-41ee-8629-51e34d358056 for instance with vm_state deleted and task_state None.
Nov 02 01:32:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:25 user nova-compute[74996]: DEBUG nova.objects.instance [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lazy-loading 'flavor' on Instance uuid 2621c5a2-acff-4055-9746-1b2f5829b39d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:32:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-dcb37d43-e23c-483a-9583-62606f4028c8 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "2621c5a2-acff-4055-9746-1b2f5829b39d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.611s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:32:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:28 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d843d91a-afc3-45f8-9a89-8bc40e81f0d0 is timed out.
Nov 02 01:32:28 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Successfully detached device vdb from instance d843d91a-afc3-45f8-9a89-8bc40e81f0d0 from the live domain config.
Nov 02 01:32:28 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CPsbYEoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:32:28 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:32:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[af53e9fe-fe90-4c78-b980-4be1fea2bf48]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:32:28 user nova-compute[74996]: No targets found.
Nov 02 01:32:28 user nova-compute[74996]: iSNS:
Nov 02 01:32:28 user nova-compute[74996]: No targets found.
Nov 02 01:32:28 user nova-compute[74996]: STATIC:
Nov 02 01:32:28 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5
Nov 02 01:32:28 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:32:28 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:32:28 user nova-compute[74996]: FIRMWARE:
Nov 02 01:32:28 user nova-compute[74996]: No targets found.
Nov 02 01:32:28 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:32:28 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:32:28 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[02323528-3474-4c6c-9edd-881be0d0cd9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[66312d4f-b933-4c5e-ae49-5d091aef8a23]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 (non-flash)
Nov 02 01:32:28 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 (non-flash)
Nov 02 01:32:28 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f831428a710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5'): ({'sdd'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Removing single pathed devices sdd {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[384d5312-5bb9-438c-8d87-9593f5275efc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[11da5e0c-8b91-42df-9849-3c4880ffc1e9]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Flushing IO for device /dev/sdd {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b747e0-42b0-4019-90aa-a479d9e75f4f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a4ffb6-2d78-495f-afe3-db5782bc7c5b]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] SCSI volumes sdd have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b388f6-e7ff-4c1a-9522-faff53179d3e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1242dd-049c-4262-83c7-7163103d3660]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5, portal: 172.16.0.220,3260]
Nov 02 01:32:28 user nova-compute[74996]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5, portal: 172.16.0.220,3260] successful.
Nov 02 01:32:28 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d50ca55-1169-4ad8-abfb-cd4b0baf67a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6eeef7-310b-4466-b5ef-a3e34c3d44cc]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.249s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] <== disconnect_volume: return (250ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:32:28 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:32:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:37 user nova-compute[74996]: DEBUG nova.objects.instance [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lazy-loading 'flavor' on Instance uuid 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ad0ee615-60d3-4a60-a50a-d8f1ad4473af tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 36.847s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEYcOyzH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:32:38 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:32:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:32:38 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:32:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:32:38 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3a0bd7-3acd-493d-9f2e-e3f6739d8fda]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:32:38 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5093acd5-dc96-448c-8f2f-c3b0118a122a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a] added
Nov 02 01:32:38 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[373f363b-93b8-4caf-b788-758ae2487f78]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5ef7ad-8549-4a4c-9a84-bc21066222f4]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JEYcOyzH {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JEYcOyzH" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af96602-1de5-4ed1-a36e-1f9402dda296]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JEYcOyzH'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[833bb6f5-e621-4411-a000-6b646192cf14]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70d4ebc-ff55-48cc-a7e0-ace2b515e5c1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 01:32:38 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 01:32:38 user nova-compute[74996]:  {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:32:38 user nova-compute[74996]: WARNING os_brick.initiator.connectors.iscsi [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 01:32:38 user nova-compute[74996]: 
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e713e2c6-6bc0-4d25-aeec-afb2eac42476]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a, portal: 172.16.0.220,3260]
Nov 02 01:32:38 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a, portal: 172.16.0.220,3260] successful.
Nov 02 01:32:38 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9525653-dc2b-4ca7-8cbd-4bcc8cc65f1b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[649052c9-ecea-461d-a552-c221ad8e5c6d]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)
Nov 02 01:32:38 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)
Nov 02 01:32:38 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] HCTL ('33', '-', '-', 0) found on session 5 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f8fdeb-796f-4414-b15d-e6c6a1475c7c]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Searching for a device in session 5 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEYcOyzH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-035e5a7b-60da-4c7c-897c-b5c6a7920402 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Acquiring lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-035e5a7b-60da-4c7c-897c-b5c6a7920402 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-035e5a7b-60da-4c7c-897c-b5c6a7920402 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Acquiring lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-035e5a7b-60da-4c7c-897c-b5c6a7920402 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-035e5a7b-60da-4c7c-897c-b5c6a7920402 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:32:38 user nova-compute[74996]: INFO nova.compute.manager [None req-035e5a7b-60da-4c7c-897c-b5c6a7920402 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Terminating instance
Nov 02 01:32:38 user nova-compute[74996]: DEBUG nova.compute.manager [None req-035e5a7b-60da-4c7c-897c-b5c6a7920402 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:38 user nova-compute[74996]: DEBUG nova.compute.manager [req-cee4837d-c3a1-4235-8df5-7b89458ffb2a req-b3478abb-6c96-4da2-ab7f-aa12a694c05c service nova] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Received event network-vif-unplugged-7ee7d00e-996e-4ba6-9a7d-642404d24f74 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:32:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cee4837d-c3a1-4235-8df5-7b89458ffb2a req-b3478abb-6c96-4da2-ab7f-aa12a694c05c service nova] Acquiring lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:32:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cee4837d-c3a1-4235-8df5-7b89458ffb2a req-b3478abb-6c96-4da2-ab7f-aa12a694c05c service nova] Lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.010s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:32:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cee4837d-c3a1-4235-8df5-7b89458ffb2a req-b3478abb-6c96-4da2-ab7f-aa12a694c05c service nova] Lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:32:39 user nova-compute[74996]: DEBUG nova.compute.manager [req-cee4837d-c3a1-4235-8df5-7b89458ffb2a req-b3478abb-6c96-4da2-ab7f-aa12a694c05c service nova] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] No waiting events found dispatching network-vif-unplugged-7ee7d00e-996e-4ba6-9a7d-642404d24f74 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:32:39 user nova-compute[74996]: DEBUG nova.compute.manager [req-cee4837d-c3a1-4235-8df5-7b89458ffb2a req-b3478abb-6c96-4da2-ab7f-aa12a694c05c service nova] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Received event network-vif-unplugged-7ee7d00e-996e-4ba6-9a7d-642404d24f74 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:32:39 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:32:39 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26463313333313665', 'path': '/dev/sdb'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:32:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463313333313665', 'path': '/dev/sdb'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:32:39 user nova-compute[74996]: DEBUG nova.objects.instance [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lazy-loading 'flavor' on Instance uuid ff502988-e729-4509-bd2d-ff16bf9e0a08 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:32:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 01:32:39 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:32:39 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 01:32:39 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:32:39 user nova-compute[74996]:   <serial>92b78930-a1df-4860-96ee-a62bfbbb3a2a</serial>
Nov 02 01:32:39 user nova-compute[74996]: </disk>
Nov 02 01:32:39 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 01:32:39 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Instance destroyed successfully.
Nov 02 01:32:39 user nova-compute[74996]: DEBUG nova.objects.instance [None req-035e5a7b-60da-4c7c-897c-b5c6a7920402 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lazy-loading 'resources' on Instance uuid 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:32:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-035e5a7b-60da-4c7c-897c-b5c6a7920402 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:29:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1230440666',display_name='tempest-AttachSCSIVolumeTestJSON-server-1230440666',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1230440666',id=6,image_ref='38584735-89a5-4264-95ed-0ada33f021d7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbga3R/IqjULzAeMX4I/gKpUltHYg4EoAdpyRT7+gJ2bkaOEq7dy80LcBUgyqfU7Wzqq+Ec95lSs3dey7EGZj/0cVTMQ6m1uk/X2fQ7CZoPdeg2lIDYkN80h7Pa0KurxA==',key_name='tempest-keypair-1396152305',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:29:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd6782fc20434d9d9d40527985ce3ad1',ramdisk_id='',reservation_id='r-04hsn70y',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='38584735-89a5-4264-95ed-0ada33f021d7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-651942675',owner_user_name='tempest-AttachSCSIVolumeTestJSON-651942675-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:29:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b16f949e8d524b4d9e90d454fece5f26',uuid=23ba82cb-ec9d-4b96-b205-3d9ac6bc8627,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ee7d00e-996e-4ba6-9a7d-642404d24f74", "address": "fa:16:3e:d4:2e:a5", "network": {"id": "d4db391d-89bd-4b81-8521-e90539933295", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-627212228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd6782fc20434d9d9d40527985ce3ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee7d00e-99", "ovs_interfaceid": "7ee7d00e-996e-4ba6-9a7d-642404d24f74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:32:39 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-035e5a7b-60da-4c7c-897c-b5c6a7920402 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Converting VIF {"id": "7ee7d00e-996e-4ba6-9a7d-642404d24f74", "address": "fa:16:3e:d4:2e:a5", "network": {"id": "d4db391d-89bd-4b81-8521-e90539933295", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-627212228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd6782fc20434d9d9d40527985ce3ad1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee7d00e-99", "ovs_interfaceid": "7ee7d00e-996e-4ba6-9a7d-642404d24f74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:32:39 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-035e5a7b-60da-4c7c-897c-b5c6a7920402 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:2e:a5,bridge_name='br-int',has_traffic_filtering=True,id=7ee7d00e-996e-4ba6-9a7d-642404d24f74,network=Network(d4db391d-89bd-4b81-8521-e90539933295),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee7d00e-99') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:32:39 user nova-compute[74996]: DEBUG os_vif [None req-035e5a7b-60da-4c7c-897c-b5c6a7920402 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:2e:a5,bridge_name='br-int',has_traffic_filtering=True,id=7ee7d00e-996e-4ba6-9a7d-642404d24f74,network=Network(d4db391d-89bd-4b81-8521-e90539933295),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee7d00e-99') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:32:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ee7d00e-99, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:32:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:32:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=150dda72-9597-40db-9df6-7439eb2afcb2) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:32:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:32:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:39 user nova-compute[74996]: INFO os_vif [None req-035e5a7b-60da-4c7c-897c-b5c6a7920402 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:2e:a5,bridge_name='br-int',has_traffic_filtering=True,id=7ee7d00e-996e-4ba6-9a7d-642404d24f74,network=Network(d4db391d-89bd-4b81-8521-e90539933295),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee7d00e-99')
Nov 02 01:32:39 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-035e5a7b-60da-4c7c-897c-b5c6a7920402 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Deleting instance files /opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627_del
Nov 02 01:32:39 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-035e5a7b-60da-4c7c-897c-b5c6a7920402 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Deletion of /opt/stack/data/nova/instances/23ba82cb-ec9d-4b96-b205-3d9ac6bc8627_del complete
Nov 02 01:32:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:32:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:32:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] No VIF found with MAC fa:16:3e:3f:49:3f, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:32:39 user nova-compute[74996]: INFO nova.compute.manager [None req-035e5a7b-60da-4c7c-897c-b5c6a7920402 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 02 01:32:39 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-035e5a7b-60da-4c7c-897c-b5c6a7920402 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:32:39 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:32:39 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:32:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e4f77e47-9ab1-4273-97e6-f9716beff18e tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lock "ff502988-e729-4509-bd2d-ff16bf9e0a08" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.189s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Acquiring lock "ff502988-e729-4509-bd2d-ff16bf9e0a08" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Lock "ff502988-e729-4509-bd2d-ff16bf9e0a08" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG os_brick.utils [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG nova.compute.manager [req-fa948bd3-e3c7-455a-accb-0d5454a42e7b req-35674b43-d650-4507-b919-a3cc2ccefe68 service nova] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Received event network-vif-plugged-7ee7d00e-996e-4ba6-9a7d-642404d24f74 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-fa948bd3-e3c7-455a-accb-0d5454a42e7b req-35674b43-d650-4507-b919-a3cc2ccefe68 service nova] Acquiring lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-fa948bd3-e3c7-455a-accb-0d5454a42e7b req-35674b43-d650-4507-b919-a3cc2ccefe68 service nova] Lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-fa948bd3-e3c7-455a-accb-0d5454a42e7b req-35674b43-d650-4507-b919-a3cc2ccefe68 service nova] Lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG nova.compute.manager [req-fa948bd3-e3c7-455a-accb-0d5454a42e7b req-35674b43-d650-4507-b919-a3cc2ccefe68 service nova] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] No waiting events found dispatching network-vif-plugged-7ee7d00e-996e-4ba6-9a7d-642404d24f74 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:32:41 user nova-compute[74996]: WARNING nova.compute.manager [req-fa948bd3-e3c7-455a-accb-0d5454a42e7b req-35674b43-d650-4507-b919-a3cc2ccefe68 service nova] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Received unexpected event network-vif-plugged-7ee7d00e-996e-4ba6-9a7d-642404d24f74 for instance with vm_state active and task_state deleting.
Nov 02 01:32:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ec7c7b-d3a3-42cd-a808-a5cbea1ce899]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ed68bb-d38e-4e31-a544-8638b3eb8ffe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d703ff-8b6e-4540-8c21-b5e05733ca73]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5ef92e-b56c-4e52-97a7-8721d0d94782]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG nova.compute.manager [req-830f3e4d-40bf-4154-8d3c-f7d39c0327ab req-6e1a78e7-184a-4451-ac57-25d692c895e0 service nova] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Received event network-vif-deleted-7ee7d00e-996e-4ba6-9a7d-642404d24f74 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:32:41 user nova-compute[74996]: INFO nova.compute.manager [req-830f3e4d-40bf-4154-8d3c-f7d39c0327ab req-6e1a78e7-184a-4451-ac57-25d692c895e0 service nova] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Neutron deleted interface 7ee7d00e-996e-4ba6-9a7d-642404d24f74; detaching it from the instance and deleting it from the info cache
Nov 02 01:32:41 user nova-compute[74996]: DEBUG nova.network.neutron [req-830f3e4d-40bf-4154-8d3c-f7d39c0327ab req-6e1a78e7-184a-4451-ac57-25d692c895e0 service nova] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:32:41 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:32:41 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf69fc8d-f776-4ffb-bd93-a49ac391b64b]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG os_brick.utils [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:32:41 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Took 1.25 seconds to deallocate network for instance.
Nov 02 01:32:41 user nova-compute[74996]: DEBUG nova.compute.manager [req-830f3e4d-40bf-4154-8d3c-f7d39c0327ab req-6e1a78e7-184a-4451-ac57-25d692c895e0 service nova] [instance: 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627] Detach interface failed, port_id=7ee7d00e-996e-4ba6-9a7d-642404d24f74, reason: Instance 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627 could not be found. {{(pid=74996) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-035e5a7b-60da-4c7c-897c-b5c6a7920402 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-035e5a7b-60da-4c7c-897c-b5c6a7920402 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:32:41 user nova-compute[74996]: INFO nova.compute.manager [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Swapping volume 92b78930-a1df-4860-96ee-a62bfbbb3a2a for 6cc31055-ae7c-40c2-ac23-825aaecc236a
Nov 02 01:32:41 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-035e5a7b-60da-4c7c-897c-b5c6a7920402 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-035e5a7b-60da-4c7c-897c-b5c6a7920402 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:32:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-035e5a7b-60da-4c7c-897c-b5c6a7920402 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:32:41 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-035e5a7b-60da-4c7c-897c-b5c6a7920402 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Deleted allocations for instance 23ba82cb-ec9d-4b96-b205-3d9ac6bc8627
Nov 02 01:32:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-035e5a7b-60da-4c7c-897c-b5c6a7920402 tempest-AttachSCSIVolumeTestJSON-651942675 tempest-AttachSCSIVolumeTestJSON-651942675-project-member] Lock "23ba82cb-ec9d-4b96-b205-3d9ac6bc8627" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.033s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:32:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:46 user nova-compute[74996]: DEBUG nova.objects.instance [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Lazy-loading 'flavor' on Instance uuid d843d91a-afc3-45f8-9a89-8bc40e81f0d0 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:32:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9ad8cc46-ba68-4e2b-8856-4d60f352003d tempest-VolumesAssistedSnapshotsTest-1086616950 tempest-VolumesAssistedSnapshotsTest-1086616950-project-admin] Lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 38.933s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:32:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Acquiring lock "4f81e089-21cf-4132-9f04-a5cf777158d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:32:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "4f81e089-21cf-4132-9f04-a5cf777158d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:32:49 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:32:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:32:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:32:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:32:50 user nova-compute[74996]: INFO nova.compute.claims [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Claim successful on node user
Nov 02 01:32:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:50 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:32:50 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:32:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:32:50 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:32:50 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:32:50 user nova-compute[74996]: DEBUG nova.network.neutron [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:32:50 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:32:50 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:32:50 user nova-compute[74996]: DEBUG nova.policy [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '369a170aab0b4d3f9de0713b52798b72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91486d1ff074f7599b5bc2e771e28d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:32:50 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:32:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:32:50 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Creating image(s)
Nov 02 01:32:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f81e089-21cf-4132-9f04-a5cf777158d8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:32:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "/opt/stack/data/nova/instances/4f81e089-21cf-4132-9f04-a5cf777158d8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:32:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "/opt/stack/data/nova/instances/4f81e089-21cf-4132-9f04-a5cf777158d8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:32:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.184s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:32:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:32:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/4f81e089-21cf-4132-9f04-a5cf777158d8/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/4f81e089-21cf-4132-9f04-a5cf777158d8/disk 1073741824" returned: 0 in 0.177s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.359s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:32:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:51 user nova-compute[74996]: DEBUG nova.network.neutron [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Successfully created port: 1442b29d-a02a-4c37-a95a-1936f024f562 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:32:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.226s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:51 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f81e089-21cf-4132-9f04-a5cf777158d8/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:32:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f81e089-21cf-4132-9f04-a5cf777158d8/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:32:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f81e089-21cf-4132-9f04-a5cf777158d8/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:32:51 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Cannot resize image /opt/stack/data/nova/instances/4f81e089-21cf-4132-9f04-a5cf777158d8/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:32:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:32:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Ensure instance console log exists: /opt/stack/data/nova/instances/4f81e089-21cf-4132-9f04-a5cf777158d8/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:32:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:32:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:32:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:32:51 user nova-compute[74996]: DEBUG nova.network.neutron [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Successfully updated port: 1442b29d-a02a-4c37-a95a-1936f024f562 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Acquiring lock "refresh_cache-4f81e089-21cf-4132-9f04-a5cf777158d8" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Acquired lock "refresh_cache-4f81e089-21cf-4132-9f04-a5cf777158d8" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.network.neutron [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.compute.manager [req-364cc2db-eca2-4d06-9ff9-a584ee918462 req-76935670-dcac-40d8-b6f1-e8692c643d7f service nova] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Received event network-changed-1442b29d-a02a-4c37-a95a-1936f024f562 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.compute.manager [req-364cc2db-eca2-4d06-9ff9-a584ee918462 req-76935670-dcac-40d8-b6f1-e8692c643d7f service nova] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Refreshing instance network info cache due to event network-changed-1442b29d-a02a-4c37-a95a-1936f024f562. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-364cc2db-eca2-4d06-9ff9-a584ee918462 req-76935670-dcac-40d8-b6f1-e8692c643d7f service nova] Acquiring lock "refresh_cache-4f81e089-21cf-4132-9f04-a5cf777158d8" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.network.neutron [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.network.neutron [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Updating instance_info_cache with network_info: [{"id": "1442b29d-a02a-4c37-a95a-1936f024f562", "address": "fa:16:3e:36:fa:46", "network": {"id": "8bca3600-c671-4a05-9913-14a9531365d1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2106930518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91486d1ff074f7599b5bc2e771e28d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1442b29d-a0", "ovs_interfaceid": "1442b29d-a02a-4c37-a95a-1936f024f562", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Releasing lock "refresh_cache-4f81e089-21cf-4132-9f04-a5cf777158d8" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Instance network_info: |[{"id": "1442b29d-a02a-4c37-a95a-1936f024f562", "address": "fa:16:3e:36:fa:46", "network": {"id": "8bca3600-c671-4a05-9913-14a9531365d1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2106930518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91486d1ff074f7599b5bc2e771e28d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1442b29d-a0", "ovs_interfaceid": "1442b29d-a02a-4c37-a95a-1936f024f562", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-364cc2db-eca2-4d06-9ff9-a584ee918462 req-76935670-dcac-40d8-b6f1-e8692c643d7f service nova] Acquired lock "refresh_cache-4f81e089-21cf-4132-9f04-a5cf777158d8" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.network.neutron [req-364cc2db-eca2-4d06-9ff9-a584ee918462 req-76935670-dcac-40d8-b6f1-e8692c643d7f service nova] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Refreshing network info cache for port 1442b29d-a02a-4c37-a95a-1936f024f562 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Start _get_guest_xml network_info=[{"id": "1442b29d-a02a-4c37-a95a-1936f024f562", "address": "fa:16:3e:36:fa:46", "network": {"id": "8bca3600-c671-4a05-9913-14a9531365d1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2106930518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91486d1ff074f7599b5bc2e771e28d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1442b29d-a0", "ovs_interfaceid": "1442b29d-a02a-4c37-a95a-1936f024f562", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:32:52 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:32:52 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:32:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-800574735',display_name='tempest-VolumesAdminNegativeTest-server-800574735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-800574735',id=10,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f91486d1ff074f7599b5bc2e771e28d9',ramdisk_id='',reservation_id='r-pgpe1jq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1150311361',owner_user_name='tempest-VolumesAdminNegativeTest-1150311361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:32:51Z,user_data=None,user_id='369a170aab0b4d3f9de0713b52798b72',uuid=4f81e089-21cf-4132-9f04-a5cf777158d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1442b29d-a02a-4c37-a95a-1936f024f562", "address": "fa:16:3e:36:fa:46", "network": {"id": "8bca3600-c671-4a05-9913-14a9531365d1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2106930518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91486d1ff074f7599b5bc2e771e28d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1442b29d-a0", "ovs_interfaceid": "1442b29d-a02a-4c37-a95a-1936f024f562", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Converting VIF {"id": "1442b29d-a02a-4c37-a95a-1936f024f562", "address": "fa:16:3e:36:fa:46", "network": {"id": "8bca3600-c671-4a05-9913-14a9531365d1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2106930518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91486d1ff074f7599b5bc2e771e28d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1442b29d-a0", "ovs_interfaceid": "1442b29d-a02a-4c37-a95a-1936f024f562", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:fa:46,bridge_name='br-int',has_traffic_filtering=True,id=1442b29d-a02a-4c37-a95a-1936f024f562,network=Network(8bca3600-c671-4a05-9913-14a9531365d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1442b29d-a0') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.objects.instance [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f81e089-21cf-4132-9f04-a5cf777158d8 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:32:52 user nova-compute[74996]:   <uuid>4f81e089-21cf-4132-9f04-a5cf777158d8</uuid>
Nov 02 01:32:52 user nova-compute[74996]:   <name>instance-0000000a</name>
Nov 02 01:32:52 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:32:52 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:32:52 user nova-compute[74996]:   <metadata>
Nov 02 01:32:52 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:32:52 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:32:52 user nova-compute[74996]:       <nova:name>tempest-VolumesAdminNegativeTest-server-800574735</nova:name>
Nov 02 01:32:52 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:32:52</nova:creationTime>
Nov 02 01:32:52 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:32:52 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:32:52 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:32:52 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:32:52 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:32:52 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:32:52 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:32:52 user nova-compute[74996]:       <nova:owner>
Nov 02 01:32:52 user nova-compute[74996]:         <nova:user uuid="369a170aab0b4d3f9de0713b52798b72">tempest-VolumesAdminNegativeTest-1150311361-project-member</nova:user>
Nov 02 01:32:52 user nova-compute[74996]:         <nova:project uuid="f91486d1ff074f7599b5bc2e771e28d9">tempest-VolumesAdminNegativeTest-1150311361</nova:project>
Nov 02 01:32:52 user nova-compute[74996]:       </nova:owner>
Nov 02 01:32:52 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:32:52 user nova-compute[74996]:       <nova:ports>
Nov 02 01:32:52 user nova-compute[74996]:         <nova:port uuid="1442b29d-a02a-4c37-a95a-1936f024f562">
Nov 02 01:32:52 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 02 01:32:52 user nova-compute[74996]:         </nova:port>
Nov 02 01:32:52 user nova-compute[74996]:       </nova:ports>
Nov 02 01:32:52 user nova-compute[74996]:     </nova:instance>
Nov 02 01:32:52 user nova-compute[74996]:   </metadata>
Nov 02 01:32:52 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:32:52 user nova-compute[74996]:     <system>
Nov 02 01:32:52 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:32:52 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:32:52 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:32:52 user nova-compute[74996]:       <entry name="serial">4f81e089-21cf-4132-9f04-a5cf777158d8</entry>
Nov 02 01:32:52 user nova-compute[74996]:       <entry name="uuid">4f81e089-21cf-4132-9f04-a5cf777158d8</entry>
Nov 02 01:32:52 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:32:52 user nova-compute[74996]:     </system>
Nov 02 01:32:52 user nova-compute[74996]:   </sysinfo>
Nov 02 01:32:52 user nova-compute[74996]:   <os>
Nov 02 01:32:52 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:32:52 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:32:52 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:32:52 user nova-compute[74996]:   </os>
Nov 02 01:32:52 user nova-compute[74996]:   <features>
Nov 02 01:32:52 user nova-compute[74996]:     <acpi/>
Nov 02 01:32:52 user nova-compute[74996]:     <apic/>
Nov 02 01:32:52 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:32:52 user nova-compute[74996]:   </features>
Nov 02 01:32:52 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:32:52 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:32:52 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:32:52 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:32:52 user nova-compute[74996]:   </clock>
Nov 02 01:32:52 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:32:52 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:32:52 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:32:52 user nova-compute[74996]:   </cpu>
Nov 02 01:32:52 user nova-compute[74996]:   <devices>
Nov 02 01:32:52 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:32:52 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:32:52 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/4f81e089-21cf-4132-9f04-a5cf777158d8/disk"/>
Nov 02 01:32:52 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:32:52 user nova-compute[74996]:     </disk>
Nov 02 01:32:52 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:32:52 user nova-compute[74996]:       <mac address="fa:16:3e:36:fa:46"/>
Nov 02 01:32:52 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:32:52 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:32:52 user nova-compute[74996]:       <target dev="tap1442b29d-a0"/>
Nov 02 01:32:52 user nova-compute[74996]:     </interface>
Nov 02 01:32:52 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:32:52 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/4f81e089-21cf-4132-9f04-a5cf777158d8/console.log" append="off"/>
Nov 02 01:32:52 user nova-compute[74996]:     </serial>
Nov 02 01:32:52 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:32:52 user nova-compute[74996]:     <video>
Nov 02 01:32:52 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:32:52 user nova-compute[74996]:     </video>
Nov 02 01:32:52 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:32:52 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:32:52 user nova-compute[74996]:     </rng>
Nov 02 01:32:52 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:32:52 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:32:52 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:32:52 user nova-compute[74996]:     </memballoon>
Nov 02 01:32:52 user nova-compute[74996]:   </devices>
Nov 02 01:32:52 user nova-compute[74996]: </domain>
Nov 02 01:32:52 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:32:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-800574735',display_name='tempest-VolumesAdminNegativeTest-server-800574735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-800574735',id=10,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f91486d1ff074f7599b5bc2e771e28d9',ramdisk_id='',reservation_id='r-pgpe1jq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1150311361',owner_user_name='tempest-VolumesAdminNegativeTest-1150311361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:32:51Z,user_data=None,user_id='369a170aab0b4d3f9de0713b52798b72',uuid=4f81e089-21cf-4132-9f04-a5cf777158d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1442b29d-a02a-4c37-a95a-1936f024f562", "address": "fa:16:3e:36:fa:46", "network": {"id": "8bca3600-c671-4a05-9913-14a9531365d1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2106930518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91486d1ff074f7599b5bc2e771e28d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1442b29d-a0", "ovs_interfaceid": "1442b29d-a02a-4c37-a95a-1936f024f562", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Converting VIF {"id": "1442b29d-a02a-4c37-a95a-1936f024f562", "address": "fa:16:3e:36:fa:46", "network": {"id": "8bca3600-c671-4a05-9913-14a9531365d1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2106930518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91486d1ff074f7599b5bc2e771e28d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1442b29d-a0", "ovs_interfaceid": "1442b29d-a02a-4c37-a95a-1936f024f562", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:fa:46,bridge_name='br-int',has_traffic_filtering=True,id=1442b29d-a02a-4c37-a95a-1936f024f562,network=Network(8bca3600-c671-4a05-9913-14a9531365d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1442b29d-a0') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG os_vif [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:fa:46,bridge_name='br-int',has_traffic_filtering=True,id=1442b29d-a02a-4c37-a95a-1936f024f562,network=Network(8bca3600-c671-4a05-9913-14a9531365d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1442b29d-a0') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a050b33c-432b-53a0-bdbd-87f5f1612763', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1442b29d-a0, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1442b29d-a0, col_values=(('qos', UUID('6d19017e-d4a8-49f7-ac97-f2a862095cd0')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1442b29d-a0, col_values=(('external_ids', {'iface-id': '1442b29d-a02a-4c37-a95a-1936f024f562', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:fa:46', 'vm-uuid': '4f81e089-21cf-4132-9f04-a5cf777158d8'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:52 user nova-compute[74996]: INFO os_vif [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:fa:46,bridge_name='br-int',has_traffic_filtering=True,id=1442b29d-a02a-4c37-a95a-1936f024f562,network=Network(8bca3600-c671-4a05-9913-14a9531365d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1442b29d-a0')
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] No VIF found with MAC fa:16:3e:36:fa:46, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.network.neutron [req-364cc2db-eca2-4d06-9ff9-a584ee918462 req-76935670-dcac-40d8-b6f1-e8692c643d7f service nova] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Updated VIF entry in instance network info cache for port 1442b29d-a02a-4c37-a95a-1936f024f562. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG nova.network.neutron [req-364cc2db-eca2-4d06-9ff9-a584ee918462 req-76935670-dcac-40d8-b6f1-e8692c643d7f service nova] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Updating instance_info_cache with network_info: [{"id": "1442b29d-a02a-4c37-a95a-1936f024f562", "address": "fa:16:3e:36:fa:46", "network": {"id": "8bca3600-c671-4a05-9913-14a9531365d1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2106930518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91486d1ff074f7599b5bc2e771e28d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1442b29d-a0", "ovs_interfaceid": "1442b29d-a02a-4c37-a95a-1936f024f562", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:32:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-364cc2db-eca2-4d06-9ff9-a584ee918462 req-76935670-dcac-40d8-b6f1-e8692c643d7f service nova] Releasing lock "refresh_cache-4f81e089-21cf-4132-9f04-a5cf777158d8" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:32:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:54 user nova-compute[74996]: DEBUG nova.compute.manager [req-d4b2b33c-ea56-4498-a59b-797bced30f7b req-c5af5ee7-0e26-4c32-bcbd-26d5a1aebcf5 service nova] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Received event network-vif-plugged-1442b29d-a02a-4c37-a95a-1936f024f562 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:32:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d4b2b33c-ea56-4498-a59b-797bced30f7b req-c5af5ee7-0e26-4c32-bcbd-26d5a1aebcf5 service nova] Acquiring lock "4f81e089-21cf-4132-9f04-a5cf777158d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:32:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d4b2b33c-ea56-4498-a59b-797bced30f7b req-c5af5ee7-0e26-4c32-bcbd-26d5a1aebcf5 service nova] Lock "4f81e089-21cf-4132-9f04-a5cf777158d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:32:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d4b2b33c-ea56-4498-a59b-797bced30f7b req-c5af5ee7-0e26-4c32-bcbd-26d5a1aebcf5 service nova] Lock "4f81e089-21cf-4132-9f04-a5cf777158d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:32:54 user nova-compute[74996]: DEBUG nova.compute.manager [req-d4b2b33c-ea56-4498-a59b-797bced30f7b req-c5af5ee7-0e26-4c32-bcbd-26d5a1aebcf5 service nova] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] No waiting events found dispatching network-vif-plugged-1442b29d-a02a-4c37-a95a-1936f024f562 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:32:54 user nova-compute[74996]: WARNING nova.compute.manager [req-d4b2b33c-ea56-4498-a59b-797bced30f7b req-c5af5ee7-0e26-4c32-bcbd-26d5a1aebcf5 service nova] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Received unexpected event network-vif-plugged-1442b29d-a02a-4c37-a95a-1936f024f562 for instance with vm_state building and task_state spawning.
Nov 02 01:32:55 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:56 user nova-compute[74996]: DEBUG nova.compute.manager [req-64ac8974-5c4a-4122-9fe6-474a02619c07 req-83dd56c9-f4b3-4d51-baa8-4e0669700b50 service nova] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Received event network-vif-plugged-1442b29d-a02a-4c37-a95a-1936f024f562 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:32:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-64ac8974-5c4a-4122-9fe6-474a02619c07 req-83dd56c9-f4b3-4d51-baa8-4e0669700b50 service nova] Acquiring lock "4f81e089-21cf-4132-9f04-a5cf777158d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:32:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-64ac8974-5c4a-4122-9fe6-474a02619c07 req-83dd56c9-f4b3-4d51-baa8-4e0669700b50 service nova] Lock "4f81e089-21cf-4132-9f04-a5cf777158d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:32:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-64ac8974-5c4a-4122-9fe6-474a02619c07 req-83dd56c9-f4b3-4d51-baa8-4e0669700b50 service nova] Lock "4f81e089-21cf-4132-9f04-a5cf777158d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:32:56 user nova-compute[74996]: DEBUG nova.compute.manager [req-64ac8974-5c4a-4122-9fe6-474a02619c07 req-83dd56c9-f4b3-4d51-baa8-4e0669700b50 service nova] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] No waiting events found dispatching network-vif-plugged-1442b29d-a02a-4c37-a95a-1936f024f562 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:32:56 user nova-compute[74996]: WARNING nova.compute.manager [req-64ac8974-5c4a-4122-9fe6-474a02619c07 req-83dd56c9-f4b3-4d51-baa8-4e0669700b50 service nova] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Received unexpected event network-vif-plugged-1442b29d-a02a-4c37-a95a-1936f024f562 for instance with vm_state building and task_state spawning.
Nov 02 01:32:56 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:32:56 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:32:56 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Instance spawned successfully.
Nov 02 01:32:56 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:32:56 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:32:56 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:32:56 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:32:56 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:32:56 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:32:56 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:32:56 user nova-compute[74996]: INFO nova.compute.manager [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Took 5.85 seconds to spawn the instance on the hypervisor.
Nov 02 01:32:56 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:32:56 user nova-compute[74996]: INFO nova.compute.manager [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Took 6.62 seconds to build instance.
Nov 02 01:32:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a4712bf1-3708-41e8-b037-bb02321912de tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "4f81e089-21cf-4132-9f04-a5cf777158d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.721s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:32:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:32:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "fa6400fb-9e90-4f94-9da7-238b91276f41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:33:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:33:01 user nova-compute[74996]: DEBUG nova.compute.manager [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:33:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:33:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:33:01 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:33:01 user nova-compute[74996]: INFO nova.compute.claims [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Claim successful on node user
Nov 02 01:33:01 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:33:01 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:33:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.543s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:33:01 user nova-compute[74996]: DEBUG nova.compute.manager [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:33:01 user nova-compute[74996]: DEBUG nova.compute.manager [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:33:01 user nova-compute[74996]: DEBUG nova.network.neutron [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:33:01 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:33:01 user nova-compute[74996]: DEBUG nova.compute.manager [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:33:01 user nova-compute[74996]: DEBUG nova.policy [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f0ac87391a0140ba83743c0a2cd193fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f462793d4eb4433c9c27d92f80518db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:33:01 user nova-compute[74996]: DEBUG nova.compute.manager [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:33:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:33:01 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Creating image(s)
Nov 02 01:33:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:33:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "/opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:33:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "/opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:33:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "eebe267c-8724-409f-97c1-4e815034e369" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:33:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "eebe267c-8724-409f-97c1-4e815034e369" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG nova.compute.manager [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: eebe267c-8724-409f-97c1-4e815034e369] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.009s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:33:02 user nova-compute[74996]: INFO nova.compute.claims [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: eebe267c-8724-409f-97c1-4e815034e369] Claim successful on node user
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "c04b39dd-3961-4e23-ad43-34a218f4a472" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.284s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG nova.objects.instance [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lazy-loading 'flavor' on Instance uuid c04b39dd-3961-4e23-ad43-34a218f4a472 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.228s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.318s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk 1073741824" returned: 0 in 0.071s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.394s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "c04b39dd-3961-4e23-ad43-34a218f4a472" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:33:02 user nova-compute[74996]: INFO nova.compute.manager [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Attaching volume 3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 to /dev/vdb
Nov 02 01:33:02 user nova-compute[74996]: DEBUG nova.network.neutron [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Successfully created port: 7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG os_brick.utils [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9c2438-71b6-4346-aa5a-99d307755c6f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.256s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d636ee79-4524-4047-9961-9ca833f97780]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e90f54-2375-4dbb-9f87-897a6d4c7428]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d8cb44-0c4e-4502-b91f-097b28c616dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:33:02 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:33:03 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:33:03 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b2cf02-ab5b-4356-a8f4-bce2dcca00bc]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG os_brick.utils [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] <== get_connector_properties: return (193ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Updating existing volume attachment record: 74ea1a1a-dc65-4c7c-8e5f-d9afc3d6509b {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.886s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.compute.manager [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: eebe267c-8724-409f-97c1-4e815034e369] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Cannot resize image /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Ensure instance console log exists: /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.compute.manager [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: eebe267c-8724-409f-97c1-4e815034e369] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.network.neutron [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: eebe267c-8724-409f-97c1-4e815034e369] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:33:03 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: eebe267c-8724-409f-97c1-4e815034e369] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.compute.manager [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: eebe267c-8724-409f-97c1-4e815034e369] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:33:03 user nova-compute[74996]: INFO nova.virt.block_device [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: eebe267c-8724-409f-97c1-4e815034e369] Booting with blank volume at /dev/vda
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.policy [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15affb427e9b4fb8873accf286510e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142161c2fae44bdea848619580195795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.network.neutron [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Successfully updated port: 7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "refresh_cache-fa6400fb-9e90-4f94-9da7-238b91276f41" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquired lock "refresh_cache-fa6400fb-9e90-4f94-9da7-238b91276f41" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.network.neutron [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.compute.manager [req-195ea4e3-f3e6-4682-906c-de115a527a52 req-533bf83d-7aeb-4fe9-bf9c-347299f1237f service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Received event network-changed-7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.compute.manager [req-195ea4e3-f3e6-4682-906c-de115a527a52 req-533bf83d-7aeb-4fe9-bf9c-347299f1237f service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Refreshing instance network info cache due to event network-changed-7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-195ea4e3-f3e6-4682-906c-de115a527a52 req-533bf83d-7aeb-4fe9-bf9c-347299f1237f service nova] Acquiring lock "refresh_cache-fa6400fb-9e90-4f94-9da7-238b91276f41" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.network.neutron [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.network.neutron [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Updating instance_info_cache with network_info: [{"id": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "address": "fa:16:3e:8e:48:16", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3ba0fb-89", "ovs_interfaceid": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Releasing lock "refresh_cache-fa6400fb-9e90-4f94-9da7-238b91276f41" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.compute.manager [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Instance network_info: |[{"id": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "address": "fa:16:3e:8e:48:16", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3ba0fb-89", "ovs_interfaceid": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-195ea4e3-f3e6-4682-906c-de115a527a52 req-533bf83d-7aeb-4fe9-bf9c-347299f1237f service nova] Acquired lock "refresh_cache-fa6400fb-9e90-4f94-9da7-238b91276f41" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.network.neutron [req-195ea4e3-f3e6-4682-906c-de115a527a52 req-533bf83d-7aeb-4fe9-bf9c-347299f1237f service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Refreshing network info cache for port 7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Start _get_guest_xml network_info=[{"id": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "address": "fa:16:3e:8e:48:16", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3ba0fb-89", "ovs_interfaceid": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:33:03 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:33:03 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2134430177',display_name='tempest-tempest.common.compute-instance-2134430177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2134430177',id=11,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNN6oJiXhFxdMwj/0co4qWNsZDCOOAm4cBGkxSrT+8SbME3yAUS7Lu3VoxNK9wQW0hSSDE/yVKt92SwOB9CarD6wWY/rtu715m22W1QHYAaorIXtxO2ABbriBx1V6vl75g==',key_name='tempest-keypair-884605409',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f462793d4eb4433c9c27d92f80518db1',ramdisk_id='',reservation_id='r-nwbxga7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-852070362',owner_user_name='tempest-ServerActionsTestOtherA-852070362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:33:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0ac87391a0140ba83743c0a2cd193fe',uuid=fa6400fb-9e90-4f94-9da7-238b91276f41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "address": "fa:16:3e:8e:48:16", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3ba0fb-89", "ovs_interfaceid": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Converting VIF {"id": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "address": "fa:16:3e:8e:48:16", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3ba0fb-89", "ovs_interfaceid": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:48:16,bridge_name='br-int',has_traffic_filtering=True,id=7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3ba0fb-89') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.objects.instance [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lazy-loading 'pci_devices' on Instance uuid fa6400fb-9e90-4f94-9da7-238b91276f41 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:33:03 user nova-compute[74996]:   <uuid>fa6400fb-9e90-4f94-9da7-238b91276f41</uuid>
Nov 02 01:33:03 user nova-compute[74996]:   <name>instance-0000000b</name>
Nov 02 01:33:03 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:33:03 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:33:03 user nova-compute[74996]:   <metadata>
Nov 02 01:33:03 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:33:03 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:33:03 user nova-compute[74996]:       <nova:name>tempest-tempest.common.compute-instance-2134430177</nova:name>
Nov 02 01:33:03 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:33:03</nova:creationTime>
Nov 02 01:33:03 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:33:03 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:33:03 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:33:03 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:33:03 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:33:03 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:33:03 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:33:03 user nova-compute[74996]:       <nova:owner>
Nov 02 01:33:03 user nova-compute[74996]:         <nova:user uuid="f0ac87391a0140ba83743c0a2cd193fe">tempest-ServerActionsTestOtherA-852070362-project-member</nova:user>
Nov 02 01:33:03 user nova-compute[74996]:         <nova:project uuid="f462793d4eb4433c9c27d92f80518db1">tempest-ServerActionsTestOtherA-852070362</nova:project>
Nov 02 01:33:03 user nova-compute[74996]:       </nova:owner>
Nov 02 01:33:03 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:33:03 user nova-compute[74996]:       <nova:ports>
Nov 02 01:33:03 user nova-compute[74996]:         <nova:port uuid="7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e">
Nov 02 01:33:03 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 01:33:03 user nova-compute[74996]:         </nova:port>
Nov 02 01:33:03 user nova-compute[74996]:       </nova:ports>
Nov 02 01:33:03 user nova-compute[74996]:     </nova:instance>
Nov 02 01:33:03 user nova-compute[74996]:   </metadata>
Nov 02 01:33:03 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:33:03 user nova-compute[74996]:     <system>
Nov 02 01:33:03 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:33:03 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:33:03 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:33:03 user nova-compute[74996]:       <entry name="serial">fa6400fb-9e90-4f94-9da7-238b91276f41</entry>
Nov 02 01:33:03 user nova-compute[74996]:       <entry name="uuid">fa6400fb-9e90-4f94-9da7-238b91276f41</entry>
Nov 02 01:33:03 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:33:03 user nova-compute[74996]:     </system>
Nov 02 01:33:03 user nova-compute[74996]:   </sysinfo>
Nov 02 01:33:03 user nova-compute[74996]:   <os>
Nov 02 01:33:03 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:33:03 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:33:03 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:33:03 user nova-compute[74996]:   </os>
Nov 02 01:33:03 user nova-compute[74996]:   <features>
Nov 02 01:33:03 user nova-compute[74996]:     <acpi/>
Nov 02 01:33:03 user nova-compute[74996]:     <apic/>
Nov 02 01:33:03 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:33:03 user nova-compute[74996]:   </features>
Nov 02 01:33:03 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:33:03 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:33:03 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:33:03 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:33:03 user nova-compute[74996]:   </clock>
Nov 02 01:33:03 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:33:03 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:33:03 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:33:03 user nova-compute[74996]:   </cpu>
Nov 02 01:33:03 user nova-compute[74996]:   <devices>
Nov 02 01:33:03 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:33:03 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:33:03 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk"/>
Nov 02 01:33:03 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:33:03 user nova-compute[74996]:     </disk>
Nov 02 01:33:03 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:33:03 user nova-compute[74996]:       <mac address="fa:16:3e:8e:48:16"/>
Nov 02 01:33:03 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:33:03 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:33:03 user nova-compute[74996]:       <target dev="tap7a3ba0fb-89"/>
Nov 02 01:33:03 user nova-compute[74996]:     </interface>
Nov 02 01:33:03 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:33:03 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/console.log" append="off"/>
Nov 02 01:33:03 user nova-compute[74996]:     </serial>
Nov 02 01:33:03 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:33:03 user nova-compute[74996]:     <video>
Nov 02 01:33:03 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:33:03 user nova-compute[74996]:     </video>
Nov 02 01:33:03 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:33:03 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:33:03 user nova-compute[74996]:     </rng>
Nov 02 01:33:03 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:33:03 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:33:03 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:33:03 user nova-compute[74996]:     </memballoon>
Nov 02 01:33:03 user nova-compute[74996]:   </devices>
Nov 02 01:33:03 user nova-compute[74996]: </domain>
Nov 02 01:33:03 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2134430177',display_name='tempest-tempest.common.compute-instance-2134430177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2134430177',id=11,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNN6oJiXhFxdMwj/0co4qWNsZDCOOAm4cBGkxSrT+8SbME3yAUS7Lu3VoxNK9wQW0hSSDE/yVKt92SwOB9CarD6wWY/rtu715m22W1QHYAaorIXtxO2ABbriBx1V6vl75g==',key_name='tempest-keypair-884605409',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f462793d4eb4433c9c27d92f80518db1',ramdisk_id='',reservation_id='r-nwbxga7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-852070362',owner_user_name='tempest-ServerActionsTestOtherA-852070362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:33:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0ac87391a0140ba83743c0a2cd193fe',uuid=fa6400fb-9e90-4f94-9da7-238b91276f41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "address": "fa:16:3e:8e:48:16", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3ba0fb-89", "ovs_interfaceid": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Converting VIF {"id": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "address": "fa:16:3e:8e:48:16", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3ba0fb-89", "ovs_interfaceid": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:48:16,bridge_name='br-int',has_traffic_filtering=True,id=7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3ba0fb-89') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG os_vif [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:48:16,bridge_name='br-int',has_traffic_filtering=True,id=7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3ba0fb-89') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd73a3b0c-f361-5973-9c87-0f8f81ef88b8', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a3ba0fb-89, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a3ba0fb-89, col_values=(('qos', UUID('c2e075f5-70f3-46cf-9768-2bba7ccdf429')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a3ba0fb-89, col_values=(('external_ids', {'iface-id': '7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:48:16', 'vm-uuid': 'fa6400fb-9e90-4f94-9da7-238b91276f41'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:33:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:04 user nova-compute[74996]: INFO os_vif [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:48:16,bridge_name='br-int',has_traffic_filtering=True,id=7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3ba0fb-89')
Nov 02 01:33:04 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:33:04 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] No VIF found with MAC fa:16:3e:8e:48:16, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:33:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:04 user nova-compute[74996]: DEBUG nova.network.neutron [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: eebe267c-8724-409f-97c1-4e815034e369] Successfully created port: 0b7892df-38c3-4ad1-97e3-8331c79b2416 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:33:04 user nova-compute[74996]: DEBUG nova.network.neutron [req-195ea4e3-f3e6-4682-906c-de115a527a52 req-533bf83d-7aeb-4fe9-bf9c-347299f1237f service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Updated VIF entry in instance network info cache for port 7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:33:04 user nova-compute[74996]: DEBUG nova.network.neutron [req-195ea4e3-f3e6-4682-906c-de115a527a52 req-533bf83d-7aeb-4fe9-bf9c-347299f1237f service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Updating instance_info_cache with network_info: [{"id": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "address": "fa:16:3e:8e:48:16", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3ba0fb-89", "ovs_interfaceid": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:33:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-195ea4e3-f3e6-4682-906c-de115a527a52 req-533bf83d-7aeb-4fe9-bf9c-347299f1237f service nova] Releasing lock "refresh_cache-fa6400fb-9e90-4f94-9da7-238b91276f41" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:33:04 user nova-compute[74996]: DEBUG nova.compute.manager [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uqkztxdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ff502988-e729-4509-bd2d-ff16bf9e0a08', 'attached_at': '', 'detached_at': '', 'volume_id': '6cc31055-ae7c-40c2-ac23-825aaecc236a', 'serial': '6cc31055-ae7c-40c2-ac23-825aaecc236a'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEYcOyzH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'ff502988-e729-4509-bd2d-ff16bf9e0a08', 'attached_at': '', 'detached_at': '', 'volume_id': '92b78930-a1df-4860-96ee-a62bfbbb3a2a', 'serial'} {{(pid=74996) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Nov 02 01:33:04 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:33:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uqkztxdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:33:04 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:33:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:33:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.007s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:33:04 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:33:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:33:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:33:04 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:33:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:04 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6400b5-c0a0-4fb2-9ec0-46adcf5bc856]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:33:04 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:33:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:04 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6c6ecb-49d5-4058-a099-e1e45f8c3627]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a] added
Nov 02 01:33:04 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:33:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5a9db4-6e61-4c7d-9309-12e1f51f31b6]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd61c65-1178-49de-828d-f0e579ac46b7]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uqkztxdZ {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uqkztxdZ" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a307e7b7-5772-40ae-b15a-1b5a07009d76]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uqkztxdZ'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da86622-4f17-4c04-af46-3eb399b962ee]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06a3ef2-d621-490b-ad7f-cc87e616dc55]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)
Nov 02 01:33:05 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)
Nov 02 01:33:05 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43f3b5b-71fe-4fcc-a699-37568439c376]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a, portal: 172.16.0.220,3260]
Nov 02 01:33:05 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a, portal: 172.16.0.220,3260] successful.
Nov 02 01:33:05 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7fb9c0-f1a7-4530-be7e-2608c3d059d1]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[080b74dc-6dad-4fab-a969-144e14935b14]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)
Nov 02 01:33:05 user nova-compute[74996]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a (non-flash)
Nov 02 01:33:05 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)
Nov 02 01:33:05 user nova-compute[74996]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a (non-flash)
Nov 02 01:33:05 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] HCTL ('34', '-', '-', 0) found on session 7 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72e28c0-1536-4dab-98ee-21bba7a07786]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Searching for a device in session 7 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uqkztxdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG nova.network.neutron [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: eebe267c-8724-409f-97c1-4e815034e369] Successfully updated port: 0b7892df-38c3-4ad1-97e3-8331c79b2416 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "refresh_cache-eebe267c-8724-409f-97c1-4e815034e369" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquired lock "refresh_cache-eebe267c-8724-409f-97c1-4e815034e369" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG nova.network.neutron [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: eebe267c-8724-409f-97c1-4e815034e369] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG nova.compute.manager [req-e0f93d6b-cdc4-4873-80bf-0c390e727882 req-7516954c-8476-4cf4-9ae9-ef0257213c54 service nova] [instance: eebe267c-8724-409f-97c1-4e815034e369] Received event network-changed-0b7892df-38c3-4ad1-97e3-8331c79b2416 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG nova.compute.manager [req-e0f93d6b-cdc4-4873-80bf-0c390e727882 req-7516954c-8476-4cf4-9ae9-ef0257213c54 service nova] [instance: eebe267c-8724-409f-97c1-4e815034e369] Refreshing instance network info cache due to event network-changed-0b7892df-38c3-4ad1-97e3-8331c79b2416. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-e0f93d6b-cdc4-4873-80bf-0c390e727882 req-7516954c-8476-4cf4-9ae9-ef0257213c54 service nova] Acquiring lock "refresh_cache-eebe267c-8724-409f-97c1-4e815034e369" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG nova.network.neutron [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: eebe267c-8724-409f-97c1-4e815034e369] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG nova.network.neutron [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: eebe267c-8724-409f-97c1-4e815034e369] Updating instance_info_cache with network_info: [{"id": "0b7892df-38c3-4ad1-97e3-8331c79b2416", "address": "fa:16:3e:ef:0a:52", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7892df-38", "ovs_interfaceid": "0b7892df-38c3-4ad1-97e3-8331c79b2416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Releasing lock "refresh_cache-eebe267c-8724-409f-97c1-4e815034e369" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG nova.compute.manager [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: eebe267c-8724-409f-97c1-4e815034e369] Instance network_info: |[{"id": "0b7892df-38c3-4ad1-97e3-8331c79b2416", "address": "fa:16:3e:ef:0a:52", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7892df-38", "ovs_interfaceid": "0b7892df-38c3-4ad1-97e3-8331c79b2416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-e0f93d6b-cdc4-4873-80bf-0c390e727882 req-7516954c-8476-4cf4-9ae9-ef0257213c54 service nova] Acquired lock "refresh_cache-eebe267c-8724-409f-97c1-4e815034e369" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:33:05 user nova-compute[74996]: DEBUG nova.network.neutron [req-e0f93d6b-cdc4-4873-80bf-0c390e727882 req-7516954c-8476-4cf4-9ae9-ef0257213c54 service nova] [instance: eebe267c-8724-409f-97c1-4e815034e369] Refreshing network info cache for port 0b7892df-38c3-4ad1-97e3-8331c79b2416 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:33:06 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:33:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:33:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '26430303963616565', 'path': '/dev/sdc'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:33:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430303963616565', 'path': '/dev/sdc'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:33:06 user nova-compute[74996]: DEBUG nova.objects.instance [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Lazy-loading 'flavor' on Instance uuid ff502988-e729-4509-bd2d-ff16bf9e0a08 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:33:06 user nova-compute[74996]: DEBUG nova.network.neutron [req-e0f93d6b-cdc4-4873-80bf-0c390e727882 req-7516954c-8476-4cf4-9ae9-ef0257213c54 service nova] [instance: eebe267c-8724-409f-97c1-4e815034e369] Updated VIF entry in instance network info cache for port 0b7892df-38c3-4ad1-97e3-8331c79b2416. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:33:06 user nova-compute[74996]: DEBUG nova.network.neutron [req-e0f93d6b-cdc4-4873-80bf-0c390e727882 req-7516954c-8476-4cf4-9ae9-ef0257213c54 service nova] [instance: eebe267c-8724-409f-97c1-4e815034e369] Updating instance_info_cache with network_info: [{"id": "0b7892df-38c3-4ad1-97e3-8331c79b2416", "address": "fa:16:3e:ef:0a:52", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7892df-38", "ovs_interfaceid": "0b7892df-38c3-4ad1-97e3-8331c79b2416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:33:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-e0f93d6b-cdc4-4873-80bf-0c390e727882 req-7516954c-8476-4cf4-9ae9-ef0257213c54 service nova] Releasing lock "refresh_cache-eebe267c-8724-409f-97c1-4e815034e369" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:33:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74996) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 01:33:07 user nova-compute[74996]: DEBUG nova.compute.manager [req-38c77952-9eb7-4df0-9044-9c91fc3fc8cc req-e0dca7fb-9fef-4803-9688-498e8c1621e0 service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Received event network-vif-plugged-7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:33:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-38c77952-9eb7-4df0-9044-9c91fc3fc8cc req-e0dca7fb-9fef-4803-9688-498e8c1621e0 service nova] Acquiring lock "fa6400fb-9e90-4f94-9da7-238b91276f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:33:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-38c77952-9eb7-4df0-9044-9c91fc3fc8cc req-e0dca7fb-9fef-4803-9688-498e8c1621e0 service nova] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:33:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-38c77952-9eb7-4df0-9044-9c91fc3fc8cc req-e0dca7fb-9fef-4803-9688-498e8c1621e0 service nova] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:33:07 user nova-compute[74996]: DEBUG nova.compute.manager [req-38c77952-9eb7-4df0-9044-9c91fc3fc8cc req-e0dca7fb-9fef-4803-9688-498e8c1621e0 service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] No waiting events found dispatching network-vif-plugged-7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:33:07 user nova-compute[74996]: WARNING nova.compute.manager [req-38c77952-9eb7-4df0-9044-9c91fc3fc8cc req-e0dca7fb-9fef-4803-9688-498e8c1621e0 service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Received unexpected event network-vif-plugged-7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e for instance with vm_state building and task_state spawning.
Nov 02 01:33:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] COPY block job progress, current cursor: 109051904 final cursor: 1073741824 {{(pid=74996) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 01:33:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:08 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] COPY block job progress, current cursor: 226492416 final cursor: 1073741824 {{(pid=74996) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 01:33:08 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:33:08 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:33:08 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] COPY block job progress, current cursor: 390070272 final cursor: 1073741824 {{(pid=74996) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 01:33:08 user nova-compute[74996]: DEBUG nova.compute.manager [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:33:08 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:33:08 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Instance spawned successfully.
Nov 02 01:33:08 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:33:08 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:33:08 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:33:08 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:33:08 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:33:08 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:33:08 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:33:08 user nova-compute[74996]: INFO nova.compute.manager [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Took 7.04 seconds to spawn the instance on the hypervisor.
Nov 02 01:33:08 user nova-compute[74996]: DEBUG nova.compute.manager [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:33:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:09 user nova-compute[74996]: INFO nova.compute.manager [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Took 7.94 seconds to build instance.
Nov 02 01:33:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4f876d76-06f4-49f9-9eba-5a587709b949 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.087s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:33:09 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:33:09 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:33:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] COPY block job progress, current cursor: 528482304 final cursor: 1073741824 {{(pid=74996) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 01:33:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:33:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:33:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:33:09 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:33:09 user nova-compute[74996]: DEBUG nova.compute.manager [req-4c6dac15-0c20-4071-93f3-9bb6f6b633ee req-75d12c2b-db9e-4814-9a1d-015b47746d9d service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Received event network-vif-plugged-7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:33:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4c6dac15-0c20-4071-93f3-9bb6f6b633ee req-75d12c2b-db9e-4814-9a1d-015b47746d9d service nova] Acquiring lock "fa6400fb-9e90-4f94-9da7-238b91276f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:33:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4c6dac15-0c20-4071-93f3-9bb6f6b633ee req-75d12c2b-db9e-4814-9a1d-015b47746d9d service nova] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:33:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4c6dac15-0c20-4071-93f3-9bb6f6b633ee req-75d12c2b-db9e-4814-9a1d-015b47746d9d service nova] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:33:09 user nova-compute[74996]: DEBUG nova.compute.manager [req-4c6dac15-0c20-4071-93f3-9bb6f6b633ee req-75d12c2b-db9e-4814-9a1d-015b47746d9d service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] No waiting events found dispatching network-vif-plugged-7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:33:09 user nova-compute[74996]: WARNING nova.compute.manager [req-4c6dac15-0c20-4071-93f3-9bb6f6b633ee req-75d12c2b-db9e-4814-9a1d-015b47746d9d service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Received unexpected event network-vif-plugged-7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e for instance with vm_state active and task_state None.
Nov 02 01:33:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] COPY block job progress, current cursor: 693108736 final cursor: 1073741824 {{(pid=74996) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 01:33:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:10 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] COPY block job progress, current cursor: 823132160 final cursor: 1073741824 {{(pid=74996) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 01:33:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:10 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] COPY block job progress, current cursor: 979369984 final cursor: 1073741824 {{(pid=74996) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 01:33:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74996) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEYcOyzH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:33:11 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:33:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09e0ecf-e4ff-4876-beb3-4614894054a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:33:11 user nova-compute[74996]: No targets found.
Nov 02 01:33:11 user nova-compute[74996]: iSNS:
Nov 02 01:33:11 user nova-compute[74996]: No targets found.
Nov 02 01:33:11 user nova-compute[74996]: STATIC:
Nov 02 01:33:11 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a
Nov 02 01:33:11 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:33:11 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:33:11 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a
Nov 02 01:33:11 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:33:11 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:33:11 user nova-compute[74996]: FIRMWARE:
Nov 02 01:33:11 user nova-compute[74996]: No targets found.
Nov 02 01:33:11 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:33:11 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:33:11 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4231b2-97ce-45c4-99ce-5553800129c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.080s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2b9e38-15b1-4aa2-9983-8a411a4a9c8a]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)
Nov 02 01:33:11 user nova-compute[74996]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a (non-flash)
Nov 02 01:33:11 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)
Nov 02 01:33:11 user nova-compute[74996]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a (non-flash)
Nov 02 01:33:11 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830c571510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a'): ({'sdb'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Removing single pathed devices sdb {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a5a6df-578f-404e-91b2-2c6722d50b79]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98ea199-bd4a-4766-8adf-ed8d550fe8bd]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Flushing IO for device /dev/sdb {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.068s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d8c5fe-d39b-4bbf-8fd1-0d6e6840ff40]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[916e0876-4194-4bec-9da3-031cc1e20632]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.061s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[579fbc98-2630-449c-be9a-49a4b674d193]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08/disk --force-share --output=json" returned: 0 in 0.314s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11120b6-9e22-4dd0-9408-e07cdd773f8e]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a, portal: 172.16.0.220,3260]
Nov 02 01:33:12 user nova-compute[74996]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a, portal: 172.16.0.220,3260] successful.
Nov 02 01:33:12 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:33:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd8d465-2dab-4740-88d0-4b827b0a813f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:33:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.620s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:33:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] <== disconnect_volume: return (624ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:33:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:33:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:33:12 user nova-compute[74996]: DEBUG nova.compute.manager [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uqkztxdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'ff502988-e729-4509-bd2d-ff16bf9e0a08', 'attached_at': '', 'detached_at': '', 'volume_id': '6cc31055-ae7c-40c2-ac23-825aaecc236a', 'serial'} {{(pid=74996) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Nov 02 01:33:12 user nova-compute[74996]: DEBUG nova.compute.manager [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] swap_volume: removing Cinder connection for volume 92b78930-a1df-4860-96ee-a62bfbbb3a2a {{(pid=74996) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Nov 02 01:33:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f81e089-21cf-4132-9f04-a5cf777158d8/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f81e089-21cf-4132-9f04-a5cf777158d8/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f81e089-21cf-4132-9f04-a5cf777158d8/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f81e089-21cf-4132-9f04-a5cf777158d8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:14 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:33:14 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:33:14 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=7936MB free_disk=25.359996795654297GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance c04b39dd-3961-4e23-ad43-34a218f4a472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance fea802b7-64d9-4c77-87a7-eaba1dce5c22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7307f3a3-1ad1-43f7-be49-9cd03a626cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 2621c5a2-acff-4055-9746-1b2f5829b39d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance d843d91a-afc3-45f8-9a89-8bc40e81f0d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance ff502988-e729-4509-bd2d-ff16bf9e0a08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 4f81e089-21cf-4132-9f04-a5cf777158d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance fa6400fb-9e90-4f94-9da7-238b91276f41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance eebe267c-8724-409f-97c1-4e815034e369 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.523s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG os_brick.utils [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f680d04-fff0-4773-b1dd-07bee70d8b7a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fd748a-d84b-46aa-b5e0-34ff90aa2708]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb8c809-8bc2-4229-a738-1144586ca25e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1478f2e-25ba-40d9-b984-560df7f807ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:33:14 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:33:14 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f34c42-d70a-41dc-aac9-f0b029fe2c8d]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG os_brick.utils [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:33:14 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: eebe267c-8724-409f-97c1-4e815034e369] Updating existing volume attachment record: 9a95bd49-576e-4323-9849-6f57841a8698 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:33:15 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:33:15 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:33:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-7307f3a3-1ad1-43f7-be49-9cd03a626cd7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:33:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-7307f3a3-1ad1-43f7-be49-9cd03a626cd7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:33:15 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 01:33:16 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Updating instance_info_cache with network_info: [{"id": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "address": "fa:16:3e:97:27:02", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb645a26c-6f", "ovs_interfaceid": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:33:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-7307f3a3-1ad1-43f7-be49-9cd03a626cd7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:33:16 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 01:33:16 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:33:16 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:33:16 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:33:16 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:33:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:18 user nova-compute[74996]: DEBUG nova.compute.manager [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] swap_volume: Updating volume 92b78930-a1df-4860-96ee-a62bfbbb3a2a BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "uqkztxdZ", "auth_password": "QSuF3okgTLw7aU", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "6cc31055-ae7c-40c2-ac23-825aaecc236a"}, "status": "reserved", "instance": "ff502988-e729-4509-bd2d-ff16bf9e0a08", "attached_at": "", "detached_at": "", "volume_id": "6cc31055-ae7c-40c2-ac23-825aaecc236a", "serial": "6cc31055-ae7c-40c2-ac23-825aaecc236a"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '6cc31055-ae7c-40c2-ac23-825aaecc236a', 'no_device': None, 'attachment_id': '0a47e48c-729c-4125-89ba-987ef0bd1cd7'} {{(pid=74996) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Nov 02 01:33:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e10fd0ae-89ee-4849-9dea-4221d486fc09 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Lock "ff502988-e729-4509-bd2d-ff16bf9e0a08" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 37.756s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:33:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Acquiring lock "ff502988-e729-4509-bd2d-ff16bf9e0a08" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:33:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Lock "ff502988-e729-4509-bd2d-ff16bf9e0a08" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:33:19 user nova-compute[74996]: DEBUG os_brick.utils [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:33:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:19 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3415eb2c-fe63-4652-a96b-482d0c69fccc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:19 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5715e519-c5bb-4362-8939-91613cf83652]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:19 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d910b572-917b-4d97-b743-9f33e91f1346]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:19 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3735c3c3-2c4e-450a-a40d-89958b52b792]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:33:20 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:33:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:33:20 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:33:20 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53d4072-bc78-48d8-a95b-6f1d13a9ee99]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:20 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:33:20 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:33:20 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:33:20 user nova-compute[74996]: DEBUG os_brick.utils [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:33:20 user nova-compute[74996]: INFO nova.compute.manager [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Swapping volume 6cc31055-ae7c-40c2-ac23-825aaecc236a for 92b78930-a1df-4860-96ee-a62bfbbb3a2a
Nov 02 01:33:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEYcOyzH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ff502988-e729-4509-bd2d-ff16bf9e0a08', 'attached_at': '', 'detached_at': '', 'volume_id': '92b78930-a1df-4860-96ee-a62bfbbb3a2a', 'serial': '92b78930-a1df-4860-96ee-a62bfbbb3a2a'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uqkztxdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '6cc31055-ae7c-40c2-ac23-825aaecc236a'}, 'status': 'reserved', 'instance': 'ff502988-e729-4509-bd2d-ff16bf9e0a08', 'attached_at': '', 'detached_at': '', 'volume_id': '6cc31055-ae7c-40c2-ac23-825aaecc236a', 'serial'} {{(pid=74996) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEYcOyzH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:33:40 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:33:40 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:33:40 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:33:40 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:33:40 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a1e67c-66d5-4886-878e-6c6efac2b542]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:33:40 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f38785-7cd6-4acc-a5a0-da23cd1c6fa9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a] added
Nov 02 01:33:40 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e68fea-1439-4e99-8fb4-159aa84d7c89]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f1d512-24f0-493f-bbc9-d5c57eda5605]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JEYcOyzH {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JEYcOyzH" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba28af1d-ff64-4c82-8693-d597f04ebdce]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JEYcOyzH'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b35902a-a918-4f7c-8b4a-a2d632845025]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a40f5b-713c-4a6f-a8fb-d7362636dbac]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a (non-flash)
Nov 02 01:33:40 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a (non-flash)
Nov 02 01:33:40 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[07708220-3640-4b6a-a126-4134f6615c94]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a, portal: 172.16.0.220,3260]
Nov 02 01:33:40 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a, portal: 172.16.0.220,3260] successful.
Nov 02 01:33:40 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e1bc79-bf2e-479c-9e62-6a5713d30807]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2196d4bb-8ca9-4f36-a468-d8e9cb89dc1e]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a (non-flash)
Nov 02 01:33:40 user nova-compute[74996]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)
Nov 02 01:33:40 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a (non-flash)
Nov 02 01:33:40 user nova-compute[74996]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)
Nov 02 01:33:40 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] HCTL ('33', '-', '-', 0) found on session 8 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3530565-3534-4095-b006-9eb75b9078eb]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Searching for a device in session 8 and hctl ['33', '*', '*', 0] yield: None {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a6cba21a-cb2c-4ad1-b37c-6c4a51792a17 tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Acquiring lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a6cba21a-cb2c-4ad1-b37c-6c4a51792a17 tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a6cba21a-cb2c-4ad1-b37c-6c4a51792a17 tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Acquiring lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a6cba21a-cb2c-4ad1-b37c-6c4a51792a17 tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a6cba21a-cb2c-4ad1-b37c-6c4a51792a17 tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:33:40 user nova-compute[74996]: INFO nova.compute.manager [None req-a6cba21a-cb2c-4ad1-b37c-6c4a51792a17 tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Terminating instance
Nov 02 01:33:40 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a6cba21a-cb2c-4ad1-b37c-6c4a51792a17 tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:41 user nova-compute[74996]: DEBUG nova.compute.manager [req-4ae90660-5111-4c0e-883c-dac988793fa2 req-97834dbd-1d64-43aa-9ccc-62e94af772bf service nova] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Received event network-vif-unplugged-88b99660-8af7-4f3a-95fc-a797a886a253 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:33:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4ae90660-5111-4c0e-883c-dac988793fa2 req-97834dbd-1d64-43aa-9ccc-62e94af772bf service nova] Acquiring lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:33:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4ae90660-5111-4c0e-883c-dac988793fa2 req-97834dbd-1d64-43aa-9ccc-62e94af772bf service nova] Lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:33:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4ae90660-5111-4c0e-883c-dac988793fa2 req-97834dbd-1d64-43aa-9ccc-62e94af772bf service nova] Lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:33:41 user nova-compute[74996]: DEBUG nova.compute.manager [req-4ae90660-5111-4c0e-883c-dac988793fa2 req-97834dbd-1d64-43aa-9ccc-62e94af772bf service nova] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] No waiting events found dispatching network-vif-unplugged-88b99660-8af7-4f3a-95fc-a797a886a253 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:33:41 user nova-compute[74996]: DEBUG nova.compute.manager [req-4ae90660-5111-4c0e-883c-dac988793fa2 req-97834dbd-1d64-43aa-9ccc-62e94af772bf service nova] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Received event network-vif-unplugged-88b99660-8af7-4f3a-95fc-a797a886a253 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:33:41 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Instance destroyed successfully.
Nov 02 01:33:41 user nova-compute[74996]: DEBUG nova.objects.instance [None req-a6cba21a-cb2c-4ad1-b37c-6c4a51792a17 tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Lazy-loading 'resources' on Instance uuid d843d91a-afc3-45f8-9a89-8bc40e81f0d0 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:33:41 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-a6cba21a-cb2c-4ad1-b37c-6c4a51792a17 tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:29:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-653293421',display_name='tempest-VolumesAssistedSnapshotsTest-server-653293421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-653293421',id=7,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEwsD6PyQpzu5botVkuWYUcZ3sAmeLDdqDVC1rASHY9lb/uxy7MzqB/AAWZtS8b+zANnHIoifK6DjKLsHImx2NLFr+MorBhsXbwuZ1su0DMPDS3N5vVv21r882u5CBfJg==',key_name='tempest-keypair-1860474834',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:29:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc357c4550694aefaf63faf246b9eef9',ramdisk_id='',reservation_id='r-5pu60mhh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-100316394',owner_user_name='tempest-VolumesAssistedSnapshotsTest-100316394-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:29:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='105cb894b7204a69b0401665b9e9dd0e',uuid=d843d91a-afc3-45f8-9a89-8bc40e81f0d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88b99660-8af7-4f3a-95fc-a797a886a253", "address": "fa:16:3e:50:c2:14", "network": {"id": "e87c8aa5-2cd6-40da-8b68-dd408a09f642", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1821225633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc357c4550694aefaf63faf246b9eef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b99660-8a", "ovs_interfaceid": "88b99660-8af7-4f3a-95fc-a797a886a253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:33:41 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-a6cba21a-cb2c-4ad1-b37c-6c4a51792a17 tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Converting VIF {"id": "88b99660-8af7-4f3a-95fc-a797a886a253", "address": "fa:16:3e:50:c2:14", "network": {"id": "e87c8aa5-2cd6-40da-8b68-dd408a09f642", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1821225633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc357c4550694aefaf63faf246b9eef9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b99660-8a", "ovs_interfaceid": "88b99660-8af7-4f3a-95fc-a797a886a253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:33:41 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-a6cba21a-cb2c-4ad1-b37c-6c4a51792a17 tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:c2:14,bridge_name='br-int',has_traffic_filtering=True,id=88b99660-8af7-4f3a-95fc-a797a886a253,network=Network(e87c8aa5-2cd6-40da-8b68-dd408a09f642),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88b99660-8a') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:33:41 user nova-compute[74996]: DEBUG os_vif [None req-a6cba21a-cb2c-4ad1-b37c-6c4a51792a17 tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:c2:14,bridge_name='br-int',has_traffic_filtering=True,id=88b99660-8af7-4f3a-95fc-a797a886a253,network=Network(e87c8aa5-2cd6-40da-8b68-dd408a09f642),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88b99660-8a') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:33:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88b99660-8a, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:33:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c0349f2f-f818-4720-8b2b-6742aee55bd6) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:33:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:41 user nova-compute[74996]: INFO os_vif [None req-a6cba21a-cb2c-4ad1-b37c-6c4a51792a17 tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:c2:14,bridge_name='br-int',has_traffic_filtering=True,id=88b99660-8af7-4f3a-95fc-a797a886a253,network=Network(e87c8aa5-2cd6-40da-8b68-dd408a09f642),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88b99660-8a')
Nov 02 01:33:41 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-a6cba21a-cb2c-4ad1-b37c-6c4a51792a17 tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Deleting instance files /opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0_del
Nov 02 01:33:41 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-a6cba21a-cb2c-4ad1-b37c-6c4a51792a17 tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Deletion of /opt/stack/data/nova/instances/d843d91a-afc3-45f8-9a89-8bc40e81f0d0_del complete
Nov 02 01:33:41 user nova-compute[74996]: INFO nova.compute.manager [None req-a6cba21a-cb2c-4ad1-b37c-6c4a51792a17 tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 02 01:33:41 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-a6cba21a-cb2c-4ad1-b37c-6c4a51792a17 tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:33:41 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:33:41 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:33:41 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Searching for a device in session 8 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:33:41 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEYcOyzH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:33:41 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:33:41 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26463313333313665', 'path': '/dev/sdb'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:33:41 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463313333313665', 'path': '/dev/sdb'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:33:41 user nova-compute[74996]: DEBUG nova.objects.instance [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Lazy-loading 'flavor' on Instance uuid ff502988-e729-4509-bd2d-ff16bf9e0a08 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:33:42 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] COPY block job progress, current cursor: 3145728 final cursor: 1073741824 {{(pid=74996) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 01:33:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:42 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] COPY block job progress, current cursor: 143654912 final cursor: 1073741824 {{(pid=74996) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 01:33:43 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:33:43 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Took 1.42 seconds to deallocate network for instance.
Nov 02 01:33:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-8fe533b7-db17-4465-82d3-bccf7fcc1a4e req-394467e6-3d4b-4783-b3ee-4ef43505dc4b service nova] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Received event network-vif-deleted-88b99660-8af7-4f3a-95fc-a797a886a253 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:33:43 user nova-compute[74996]: INFO nova.compute.manager [req-8fe533b7-db17-4465-82d3-bccf7fcc1a4e req-394467e6-3d4b-4783-b3ee-4ef43505dc4b service nova] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Neutron deleted interface 88b99660-8af7-4f3a-95fc-a797a886a253; detaching it from the instance and deleting it from the info cache
Nov 02 01:33:43 user nova-compute[74996]: DEBUG nova.network.neutron [req-8fe533b7-db17-4465-82d3-bccf7fcc1a4e req-394467e6-3d4b-4783-b3ee-4ef43505dc4b service nova] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:33:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-8fe533b7-db17-4465-82d3-bccf7fcc1a4e req-394467e6-3d4b-4783-b3ee-4ef43505dc4b service nova] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Detach interface failed, port_id=88b99660-8af7-4f3a-95fc-a797a886a253, reason: Instance d843d91a-afc3-45f8-9a89-8bc40e81f0d0 could not be found. {{(pid=74996) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 01:33:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a6cba21a-cb2c-4ad1-b37c-6c4a51792a17 tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:33:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a6cba21a-cb2c-4ad1-b37c-6c4a51792a17 tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:33:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] COPY block job progress, current cursor: 288358400 final cursor: 1073741824 {{(pid=74996) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 01:33:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-67281c0b-3c15-4e8c-b481-843ad416dcd6 req-d7ba7859-2c6a-4a32-a950-13b3ea0924e4 service nova] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Received event network-vif-plugged-88b99660-8af7-4f3a-95fc-a797a886a253 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:33:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-67281c0b-3c15-4e8c-b481-843ad416dcd6 req-d7ba7859-2c6a-4a32-a950-13b3ea0924e4 service nova] Acquiring lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:33:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-67281c0b-3c15-4e8c-b481-843ad416dcd6 req-d7ba7859-2c6a-4a32-a950-13b3ea0924e4 service nova] Lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:33:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-67281c0b-3c15-4e8c-b481-843ad416dcd6 req-d7ba7859-2c6a-4a32-a950-13b3ea0924e4 service nova] Lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:33:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-67281c0b-3c15-4e8c-b481-843ad416dcd6 req-d7ba7859-2c6a-4a32-a950-13b3ea0924e4 service nova] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] No waiting events found dispatching network-vif-plugged-88b99660-8af7-4f3a-95fc-a797a886a253 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:33:43 user nova-compute[74996]: WARNING nova.compute.manager [req-67281c0b-3c15-4e8c-b481-843ad416dcd6 req-d7ba7859-2c6a-4a32-a950-13b3ea0924e4 service nova] [instance: d843d91a-afc3-45f8-9a89-8bc40e81f0d0] Received unexpected event network-vif-plugged-88b99660-8af7-4f3a-95fc-a797a886a253 for instance with vm_state deleted and task_state None.
Nov 02 01:33:43 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-a6cba21a-cb2c-4ad1-b37c-6c4a51792a17 tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:33:43 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-a6cba21a-cb2c-4ad1-b37c-6c4a51792a17 tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:33:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a6cba21a-cb2c-4ad1-b37c-6c4a51792a17 tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.463s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:33:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] COPY block job progress, current cursor: 425721856 final cursor: 1073741824 {{(pid=74996) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 01:33:43 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-a6cba21a-cb2c-4ad1-b37c-6c4a51792a17 tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Deleted allocations for instance d843d91a-afc3-45f8-9a89-8bc40e81f0d0
Nov 02 01:33:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a6cba21a-cb2c-4ad1-b37c-6c4a51792a17 tempest-VolumesAssistedSnapshotsTest-100316394 tempest-VolumesAssistedSnapshotsTest-100316394-project-member] Lock "d843d91a-afc3-45f8-9a89-8bc40e81f0d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.145s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:33:44 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] COPY block job progress, current cursor: 579862528 final cursor: 1073741824 {{(pid=74996) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 01:33:44 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] COPY block job progress, current cursor: 701497344 final cursor: 1073741824 {{(pid=74996) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 01:33:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] COPY block job progress, current cursor: 818937856 final cursor: 1073741824 {{(pid=74996) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 01:33:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] COPY block job progress, current cursor: 959447040 final cursor: 1073741824 {{(pid=74996) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74996) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uqkztxdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '6cc31055-ae7c-40c2-ac23-825aaecc236a'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:33:46 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:33:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a5e4b3-375e-4a2b-9c0d-82c84c458624]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:33:46 user nova-compute[74996]: No targets found.
Nov 02 01:33:46 user nova-compute[74996]: iSNS:
Nov 02 01:33:46 user nova-compute[74996]: No targets found.
Nov 02 01:33:46 user nova-compute[74996]: STATIC:
Nov 02 01:33:46 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a
Nov 02 01:33:46 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:33:46 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:33:46 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a
Nov 02 01:33:46 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:33:46 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:33:46 user nova-compute[74996]: FIRMWARE:
Nov 02 01:33:46 user nova-compute[74996]: No targets found.
Nov 02 01:33:46 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:33:46 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:33:46 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e95373-d972-4246-8031-8443a6ce8f8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7648b479-ec94-4291-b1c3-953cd6ff9490]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a (non-flash)
Nov 02 01:33:46 user nova-compute[74996]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)
Nov 02 01:33:46 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a (non-flash)
Nov 02 01:33:46 user nova-compute[74996]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)
Nov 02 01:33:46 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830c7c04c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a'): ({'sdc'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Removing single pathed devices sdc {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[731285e7-7f51-4e68-b913-492d03fb4130]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c8c232-b9ab-4fdd-8c9c-55873a90281c]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Flushing IO for device /dev/sdc {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bca6838-2cd7-40f5-bc02-96022f67ee54]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a648c9-25f4-4ab7-8ba7-9b039efc059c]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a8e95e-8164-41ef-b765-9a89d7ba3503]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec22cc7-e2c1-4303-a49b-089509b6a880]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a, portal: 172.16.0.220,3260]
Nov 02 01:33:46 user nova-compute[74996]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a, portal: 172.16.0.220,3260] successful.
Nov 02 01:33:46 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cc31055-ae7c-40c2-ac23-825aaecc236a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9079b2b9-10b9-4223-ad07-c1fd229d8150]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] <== disconnect_volume: return (341ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEYcOyzH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'ff502988-e729-4509-bd2d-ff16bf9e0a08', 'attached_at': '', 'detached_at': '', 'volume_id': '92b78930-a1df-4860-96ee-a62bfbbb3a2a', 'serial'} {{(pid=74996) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Nov 02 01:33:46 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] swap_volume: removing Cinder connection for volume 6cc31055-ae7c-40c2-ac23-825aaecc236a {{(pid=74996) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Nov 02 01:33:50 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] swap_volume: Updating volume 6cc31055-ae7c-40c2-ac23-825aaecc236a BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "JEYcOyzH", "auth_password": "xQWHK5ezwuCJ3A", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "92b78930-a1df-4860-96ee-a62bfbbb3a2a"}, "status": "reserved", "instance": "ff502988-e729-4509-bd2d-ff16bf9e0a08", "attached_at": "", "detached_at": "", "volume_id": "92b78930-a1df-4860-96ee-a62bfbbb3a2a", "serial": "92b78930-a1df-4860-96ee-a62bfbbb3a2a"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '92b78930-a1df-4860-96ee-a62bfbbb3a2a', 'no_device': None, 'attachment_id': 'eef03459-785c-4a56-a25e-943d126356b2'} {{(pid=74996) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Nov 02 01:33:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a49e33ec-5652-4049-94e5-2e83df526908 tempest-TestVolumeSwap-82971666 tempest-TestVolumeSwap-82971666-project-admin] Lock "ff502988-e729-4509-bd2d-ff16bf9e0a08" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 30.670s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.volume.cinder [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Update attachment failed for attachment 9a95bd49-576e-4323-9849-6f57841a8698. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2783029c-c138-4220-bf66-a31894e13fec) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2783029c-c138-4220-bf66-a31894e13fec)
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: eebe267c-8724-409f-97c1-4e815034e369] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2783029c-c138-4220-bf66-a31894e13fec)
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369] Traceback (most recent call last):
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]     driver_block_device.attach_block_devices(
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]     _log_and_attach(device)
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]     bdm.attach(*attach_args, **attach_kwargs)
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]   File "/opt/stack/nova/nova/virt/block_device.py", line 852, in attach
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]     super(DriverVolBlankBlockDevice, self).attach(
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]     ret_val = method(obj, context, *args, **kwargs)
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]     self._do_attach(context, instance, volume, volume_api,
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]     self._volume_attach(context, volume, connector, instance,
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]     connection_info = volume_api.attachment_update(
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]     res = method(self, ctx, *args, **kwargs)
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]     with excutils.save_and_reraise_exception():
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]     self.force_reraise()
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]     raise self.value
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]     context, '3.44', skip_version_check=True).attachments.update(
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]     return method.func(obj, *args, **kwargs)
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]     resp = self._update('/attachments/%s' % id, body)
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]     return self._cs_request(url, 'PUT', **kwargs)
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]     return self.request(url, method, **kwargs)
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369]     raise exceptions.from_response(resp, body)
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2783029c-c138-4220-bf66-a31894e13fec)
Nov 02 01:33:50 user nova-compute[74996]: ERROR nova.compute.manager [instance: eebe267c-8724-409f-97c1-4e815034e369] 
Nov 02 01:33:50 user nova-compute[74996]: DEBUG nova.compute.claims [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: eebe267c-8724-409f-97c1-4e815034e369] Aborting claim: <nova.compute.claims.Claim object at 0x7f82e86066b0> {{(pid=74996) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 02 01:33:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:33:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:33:51 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:33:51 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:33:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.541s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:33:51 user nova-compute[74996]: DEBUG nova.compute.manager [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: eebe267c-8724-409f-97c1-4e815034e369] Build of instance eebe267c-8724-409f-97c1-4e815034e369 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2783029c-c138-4220-bf66-a31894e13fec) {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 02 01:33:51 user nova-compute[74996]: DEBUG nova.compute.utils [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: eebe267c-8724-409f-97c1-4e815034e369] Build of instance eebe267c-8724-409f-97c1-4e815034e369 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=74996) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 02 01:33:51 user nova-compute[74996]: ERROR nova.compute.manager [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: eebe267c-8724-409f-97c1-4e815034e369] Build of instance eebe267c-8724-409f-97c1-4e815034e369 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2783029c-c138-4220-bf66-a31894e13fec): nova.exception.BuildAbortException: Build of instance eebe267c-8724-409f-97c1-4e815034e369 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2783029c-c138-4220-bf66-a31894e13fec)
Nov 02 01:33:51 user nova-compute[74996]: DEBUG nova.compute.manager [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: eebe267c-8724-409f-97c1-4e815034e369] Unplugging VIFs for instance {{(pid=74996) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 02 01:33:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:33:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2091592973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2091592973',id=12,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='142161c2fae44bdea848619580195795',ramdisk_id='',reservation_id='r-510xg3xi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1294190560',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:33:03Z,user_data=None,user_id='15affb427e9b4fb8873accf286510e14',uuid=eebe267c-8724-409f-97c1-4e815034e369,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b7892df-38c3-4ad1-97e3-8331c79b2416", "address": "fa:16:3e:ef:0a:52", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7892df-38", "ovs_interfaceid": "0b7892df-38c3-4ad1-97e3-8331c79b2416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:33:51 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Converting VIF {"id": "0b7892df-38c3-4ad1-97e3-8331c79b2416", "address": "fa:16:3e:ef:0a:52", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7892df-38", "ovs_interfaceid": "0b7892df-38c3-4ad1-97e3-8331c79b2416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:33:51 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:0a:52,bridge_name='br-int',has_traffic_filtering=True,id=0b7892df-38c3-4ad1-97e3-8331c79b2416,network=Network(b5218514-0348-4dcc-8ecf-4595a87e204a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7892df-38') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:33:51 user nova-compute[74996]: DEBUG os_vif [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:0a:52,bridge_name='br-int',has_traffic_filtering=True,id=0b7892df-38c3-4ad1-97e3-8331c79b2416,network=Network(b5218514-0348-4dcc-8ecf-4595a87e204a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7892df-38') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:33:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b7892df-38, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:33:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:33:51 user nova-compute[74996]: INFO os_vif [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:0a:52,bridge_name='br-int',has_traffic_filtering=True,id=0b7892df-38c3-4ad1-97e3-8331c79b2416,network=Network(b5218514-0348-4dcc-8ecf-4595a87e204a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7892df-38')
Nov 02 01:33:51 user nova-compute[74996]: DEBUG nova.compute.manager [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: eebe267c-8724-409f-97c1-4e815034e369] Unplugged VIFs for instance {{(pid=74996) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 02 01:33:51 user nova-compute[74996]: DEBUG nova.compute.manager [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: eebe267c-8724-409f-97c1-4e815034e369] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:33:51 user nova-compute[74996]: DEBUG nova.network.neutron [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: eebe267c-8724-409f-97c1-4e815034e369] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:33:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Acquiring lock "ff502988-e729-4509-bd2d-ff16bf9e0a08" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:33:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lock "ff502988-e729-4509-bd2d-ff16bf9e0a08" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:33:51 user nova-compute[74996]: INFO nova.compute.manager [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Detaching volume 92b78930-a1df-4860-96ee-a62bfbbb3a2a
Nov 02 01:33:51 user nova-compute[74996]: INFO nova.virt.block_device [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Attempting to driver detach volume 92b78930-a1df-4860-96ee-a62bfbbb3a2a from mountpoint /dev/vdb
Nov 02 01:33:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Attempting to detach device vdb from instance ff502988-e729-4509-bd2d-ff16bf9e0a08 from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 01:33:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 01:33:51 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:33:51 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 01:33:51 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:33:51 user nova-compute[74996]:   <serial>92b78930-a1df-4860-96ee-a62bfbbb3a2a</serial>
Nov 02 01:33:51 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 01:33:51 user nova-compute[74996]: </disk>
Nov 02 01:33:51 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:33:51 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Successfully detached device vdb from instance ff502988-e729-4509-bd2d-ff16bf9e0a08 from the persistent domain config.
Nov 02 01:33:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ff502988-e729-4509-bd2d-ff16bf9e0a08 from the live domain config. {{(pid=74996) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 01:33:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 01:33:51 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:33:51 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 01:33:51 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:33:51 user nova-compute[74996]:   <serial>92b78930-a1df-4860-96ee-a62bfbbb3a2a</serial>
Nov 02 01:33:51 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 01:33:51 user nova-compute[74996]: </disk>
Nov 02 01:33:51 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:33:52 user nova-compute[74996]: DEBUG nova.network.neutron [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: eebe267c-8724-409f-97c1-4e815034e369] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:33:52 user nova-compute[74996]: INFO nova.compute.manager [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: eebe267c-8724-409f-97c1-4e815034e369] Took 0.68 seconds to deallocate network for instance.
Nov 02 01:33:52 user nova-compute[74996]: DEBUG nova.compute.manager [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: eebe267c-8724-409f-97c1-4e815034e369] Detaching volume: 1b3b68ca-d309-4ad0-aa71-e82bd500a9ed {{(pid=74996) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 02 01:33:52 user nova-compute[74996]: INFO nova.compute.manager [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: eebe267c-8724-409f-97c1-4e815034e369] Detaching volume 1b3b68ca-d309-4ad0-aa71-e82bd500a9ed
Nov 02 01:33:52 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: eebe267c-8724-409f-97c1-4e815034e369] Skipping driver_detach during remote rebuild. {{(pid=74996) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 02 01:33:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ff502988-e729-4509-bd2d-ff16bf9e0a08 {{(pid=74996) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 01:33:52 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Deleted allocations for instance eebe267c-8724-409f-97c1-4e815034e369
Nov 02 01:33:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-33ace382-a2dc-4acf-8ebb-2c881f36d996 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "eebe267c-8724-409f-97c1-4e815034e369" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 50.693s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:33:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:33:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EvZlqADN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:34:01 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:34:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:34:01 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:34:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:34:01 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24b0df7-b971-471e-ae27-b9c72dabeb88]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:34:01 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[01419a57-f7cd-4804-98da-2a9024d872e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84] added
Nov 02 01:34:01 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[585c8ccc-5901-434e-8b23-231e95db3302]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f318ab5-ed45-4ba8-828d-6e883979b19a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EvZlqADN {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EvZlqADN" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[31278739-40f0-456c-abcb-d29f8649dbb6]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EvZlqADN'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[56beacab-917d-417d-aac7-904d262e2aff]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74f723a-544a-4928-8b20-cebd6089e808]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)
Nov 02 01:34:01 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)
Nov 02 01:34:01 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf6b514-899a-4465-a959-36da2cdc5d5b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84, portal: 172.16.0.220,3260]
Nov 02 01:34:01 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84, portal: 172.16.0.220,3260] successful.
Nov 02 01:34:01 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06dc71f-e717-431c-a480-cdcc09d948bd]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a684b2-212d-4c8a-8ed3-7638b3b36f34]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)
Nov 02 01:34:01 user nova-compute[74996]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:34:01 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)
Nov 02 01:34:01 user nova-compute[74996]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:34:01 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] HCTL ('34', '-', '-', 0) found on session 9 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b61d25-f0fa-4486-9743-fc5cb107ed0c]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:01 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Searching for a device in session 9 and hctl ['34', '*', '*', 0] yield: None {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:34:02 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Searching for a device in session 9 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:34:02 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EvZlqADN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:34:02 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:34:02 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23665623864653766', 'path': '/dev/sdc'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:34:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665623864653766', 'path': '/dev/sdc'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:34:02 user nova-compute[74996]: DEBUG nova.objects.instance [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lazy-loading 'flavor' on Instance uuid c04b39dd-3961-4e23-ad43-34a218f4a472 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:34:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 01:34:02 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:34:02 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 01:34:02 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:34:02 user nova-compute[74996]:   <serial>3b7eafb5-e19a-44f4-ba2b-38684fd2aa84</serial>
Nov 02 01:34:02 user nova-compute[74996]: </disk>
Nov 02 01:34:02 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 01:34:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:34:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:34:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] No VIF found with MAC fa:16:3e:75:a5:8a, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:34:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9cffdefa-4c54-49cb-84fd-6bb3ce4106fb tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 60.775s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:06 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:34:06 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:34:06 user nova-compute[74996]: DEBUG nova.compute.manager [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Stashing vm_state: active {{(pid=74996) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Nov 02 01:34:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:06 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:34:06 user nova-compute[74996]: INFO nova.compute.claims [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Claim successful on node user
Nov 02 01:34:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:06 user nova-compute[74996]: INFO nova.compute.resource_tracker [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Updating resource usage from migration 837180ea-faaf-4ca9-a3de-4fd9b7db0a50
Nov 02 01:34:06 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:34:07 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:34:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.391s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:07 user nova-compute[74996]: INFO nova.compute.manager [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Migrating
Nov 02 01:34:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:34:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:34:07 user nova-compute[74996]: INFO nova.compute.rpcapi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 02 01:34:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:34:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "refresh_cache-c04b39dd-3961-4e23-ad43-34a218f4a472" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:34:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquired lock "refresh_cache-c04b39dd-3961-4e23-ad43-34a218f4a472" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:34:07 user nova-compute[74996]: DEBUG nova.network.neutron [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:34:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:07 user nova-compute[74996]: DEBUG nova.network.neutron [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Updating instance_info_cache with network_info: [{"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:34:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Releasing lock "refresh_cache-c04b39dd-3961-4e23-ad43-34a218f4a472" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Starting migrate_disk_and_power_off {{(pid=74996) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG nova.compute.manager [req-d73635c7-2a6b-48f5-8186-647dddcaa17e req-e369b0e5-af8c-4b34-9226-27d46deb8cf9 service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Received event network-vif-unplugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d73635c7-2a6b-48f5-8186-647dddcaa17e req-e369b0e5-af8c-4b34-9226-27d46deb8cf9 service nova] Acquiring lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d73635c7-2a6b-48f5-8186-647dddcaa17e req-e369b0e5-af8c-4b34-9226-27d46deb8cf9 service nova] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d73635c7-2a6b-48f5-8186-647dddcaa17e req-e369b0e5-af8c-4b34-9226-27d46deb8cf9 service nova] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG nova.compute.manager [req-d73635c7-2a6b-48f5-8186-647dddcaa17e req-e369b0e5-af8c-4b34-9226-27d46deb8cf9 service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] No waiting events found dispatching network-vif-unplugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:34:08 user nova-compute[74996]: WARNING nova.compute.manager [req-d73635c7-2a6b-48f5-8186-647dddcaa17e req-e369b0e5-af8c-4b34-9226-27d46deb8cf9 service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Received unexpected event network-vif-unplugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad for instance with vm_state active and task_state resize_migrating.
Nov 02 01:34:08 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Instance destroyed successfully.
Nov 02 01:34:08 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-83700266',display_name='tempest-ServerActionsTestOtherB-server-83700266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-83700266',id=2,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+Qz/HK0D2SWfSjBSFTRJ1B5PKDz0As2T6IrqSYMkdjVvyXlNOPr+4jggbHQf8/h9wUb6gFXAyyFyjYzXEE9DdDVU1SAq0i/8zGeoZyzalitAxQC04YuAZwWq1fcoAvuw==',key_name='tempest-keypair-912688440',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:29:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='28fc6b23ac2b4c7e82fd2a473ddc69c7',ramdisk_id='',reservation_id='r-8s5rn1jj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-539262669',owner_user_name='tempest-ServerActionsTestOtherB-539262669-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbb633ea13724161916c7a7b0ca2c392',uuid=c04b39dd-3961-4e23-ad43-34a218f4a472,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-545485614-network", "vif_mac": "fa:16:3e:75:a5:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Converting VIF {"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-545485614-network", "vif_mac": "fa:16:3e:75:a5:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:a5:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a0d9417-e8c0-4392-ba9b-f1e27712adad,network=Network(fb067344-da99-4071-93f6-a4f844b74341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0d9417-e8') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG os_vif [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:a5:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a0d9417-e8c0-4392-ba9b-f1e27712adad,network=Network(fb067344-da99-4071-93f6-a4f844b74341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0d9417-e8') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a0d9417-e8, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ec074b7-83be-4855-be6d-97cefd65e76f) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:08 user nova-compute[74996]: INFO os_vif [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:a5:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a0d9417-e8c0-4392-ba9b-f1e27712adad,network=Network(fb067344-da99-4071-93f6-a4f844b74341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0d9417-e8')
Nov 02 01:34:08 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EvZlqADN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:34:08 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:34:08 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3156f0-20d4-4142-ae83-a872c4aa7eda]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:34:08 user nova-compute[74996]: No targets found.
Nov 02 01:34:08 user nova-compute[74996]: iSNS:
Nov 02 01:34:08 user nova-compute[74996]: No targets found.
Nov 02 01:34:08 user nova-compute[74996]: STATIC:
Nov 02 01:34:08 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a
Nov 02 01:34:08 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:34:08 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:34:08 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84
Nov 02 01:34:08 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:34:08 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:34:08 user nova-compute[74996]: FIRMWARE:
Nov 02 01:34:08 user nova-compute[74996]: No targets found.
Nov 02 01:34:08 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:34:08 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:34:08 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe6a528-b2ab-4383-9e8d-b0d9a79fe97f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbad6f9e-cae6-4e3e-a329-ad69ddffb896]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)
Nov 02 01:34:08 user nova-compute[74996]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:34:08 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)
Nov 02 01:34:08 user nova-compute[74996]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:34:08 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830c4692d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84'): ({'sdc'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Removing single pathed devices sdc {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:34:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[60137a3b-d58b-4787-8a9c-680e9533c24e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dea494-5344-47eb-85a8-579eb4f5d78e]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Flushing IO for device /dev/sdc {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a11e58e-435c-4d04-b07a-3200b975e4e2]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ebe1c6-4d67-4a5f-befd-da7d1fc178e2]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1ba609-de63-4f8f-a52e-a09ebc0132dd]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6d3e3f-c66d-4aba-9275-017ac0ed00d5]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84, portal: 172.16.0.220,3260]
Nov 02 01:34:09 user nova-compute[74996]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84, portal: 172.16.0.220,3260] successful.
Nov 02 01:34:09 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[391e748c-4c7a-4cf3-b4e6-b59837c1cd8a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] <== disconnect_volume: return (298ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472_resize/disk /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] CMD "cp -r /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472_resize/disk /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk" returned: 0 in 0.391s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472_resize/disk.info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk.info {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] CMD "cp -r /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472_resize/disk.info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk.info" returned: 0 in 0.032s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:10 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:34:10 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:34:10 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-2621c5a2-acff-4055-9746-1b2f5829b39d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:34:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-2621c5a2-acff-4055-9746-1b2f5829b39d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:34:10 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 01:34:10 user nova-compute[74996]: DEBUG nova.compute.manager [req-3f0ed40f-feb6-4bfa-a98f-4c78fc343109 req-d62db537-f5a6-4d5e-8da9-e71e6a69afb9 service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Received event network-vif-plugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:34:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3f0ed40f-feb6-4bfa-a98f-4c78fc343109 req-d62db537-f5a6-4d5e-8da9-e71e6a69afb9 service nova] Acquiring lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3f0ed40f-feb6-4bfa-a98f-4c78fc343109 req-d62db537-f5a6-4d5e-8da9-e71e6a69afb9 service nova] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3f0ed40f-feb6-4bfa-a98f-4c78fc343109 req-d62db537-f5a6-4d5e-8da9-e71e6a69afb9 service nova] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:10 user nova-compute[74996]: DEBUG nova.compute.manager [req-3f0ed40f-feb6-4bfa-a98f-4c78fc343109 req-d62db537-f5a6-4d5e-8da9-e71e6a69afb9 service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] No waiting events found dispatching network-vif-plugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:34:10 user nova-compute[74996]: WARNING nova.compute.manager [req-3f0ed40f-feb6-4bfa-a98f-4c78fc343109 req-d62db537-f5a6-4d5e-8da9-e71e6a69afb9 service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Received unexpected event network-vif-plugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad for instance with vm_state active and task_state resize_migrating.
Nov 02 01:34:10 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Updating instance_info_cache with network_info: [{"id": "c117844a-dde1-4486-940f-56b671a79d69", "address": "fa:16:3e:90:c7:2d", "network": {"id": "8bca3600-c671-4a05-9913-14a9531365d1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2106930518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91486d1ff074f7599b5bc2e771e28d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc117844a-dd", "ovs_interfaceid": "c117844a-dde1-4486-940f-56b671a79d69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:34:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-2621c5a2-acff-4055-9746-1b2f5829b39d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:34:10 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 01:34:10 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:34:10 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:34:10 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:34:10 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:34:11 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:34:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:11 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:34:11 user nova-compute[74996]: DEBUG nova.network.neutron [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Port 0a0d9417-e8c0-4392-ba9b-f1e27712adad binding to destination host user is already ACTIVE {{(pid=74996) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 02 01:34:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "refresh_cache-c04b39dd-3961-4e23-ad43-34a218f4a472" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:34:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquired lock "refresh_cache-c04b39dd-3961-4e23-ad43-34a218f4a472" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:34:11 user nova-compute[74996]: DEBUG nova.network.neutron [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:34:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG nova.network.neutron [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Updating instance_info_cache with network_info: [{"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Releasing lock "refresh_cache-c04b39dd-3961-4e23-ad43-34a218f4a472" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG os_brick.utils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f170d2d-4fd8-45d4-8f70-d8d40451a8d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:12 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ff502988-e729-4509-bd2d-ff16bf9e0a08 is timed out.
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:12 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Successfully detached device vdb from instance ff502988-e729-4509-bd2d-ff16bf9e0a08 from the live domain config.
Nov 02 01:34:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEYcOyzH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '92b78930-a1df-4860-96ee-a62bfbbb3a2a'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:34:12 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:34:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c148b79-bd70-4f5a-867b-1b89e322bb50]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b9ab9f-fcdf-4e6c-8a40-eeb1622834f9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:34:12 user nova-compute[74996]: No targets found.
Nov 02 01:34:12 user nova-compute[74996]: iSNS:
Nov 02 01:34:12 user nova-compute[74996]: No targets found.
Nov 02 01:34:12 user nova-compute[74996]: STATIC:
Nov 02 01:34:12 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a
Nov 02 01:34:12 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:34:12 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:34:12 user nova-compute[74996]: FIRMWARE:
Nov 02 01:34:12 user nova-compute[74996]: No targets found.
Nov 02 01:34:12 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:34:12 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:34:12 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[940ed9e6-d608-46ca-a57a-76f726248b89]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b577ea-c726-4629-8454-61de70551311]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb85bab4-af71-4c35-ad6e-6e95b1fc2e0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:34:12 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bd8a01-3e02-4ac9-9fce-05bafeb823a1]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG os_brick.utils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0698e51-0d9b-455b-998c-03adbc906002]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)
Nov 02 01:34:12 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a (non-flash)
Nov 02 01:34:12 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e87e4a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a'): ({'sdb'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Removing single pathed devices sdb {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e9fbfc-4cee-42f7-bdcc-42f94c9844b7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[29929209-7ed3-43e2-afc6-9db26ffed419]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Flushing IO for device /dev/sdb {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f9774e-a74d-4154-a549-6140f328a81b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd7f6eb-b787-4f55-b1db-f1b1ac451646]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f120683-91f8-4754-8d31-17c17425f332]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcaf35f-086b-496c-b5c1-a2848ff259b9]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a, portal: 172.16.0.220,3260]
Nov 02 01:34:12 user nova-compute[74996]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a, portal: 172.16.0.220,3260] successful.
Nov 02 01:34:12 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92b78930-a1df-4860-96ee-a62bfbbb3a2a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96de4c3-0906-4799-b57b-f74607e8878e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] <== disconnect_volume: return (411ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:34:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:34:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f81e089-21cf-4132-9f04-a5cf777158d8/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f81e089-21cf-4132-9f04-a5cf777158d8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f81e089-21cf-4132-9f04-a5cf777158d8/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f81e089-21cf-4132-9f04-a5cf777158d8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "6b79aa2f-02c7-492e-b27e-7481e41f8d2c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "6b79aa2f-02c7-492e-b27e-7481e41f8d2c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:14 user nova-compute[74996]: DEBUG nova.compute.manager [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:34:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:14 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:34:14 user nova-compute[74996]: INFO nova.compute.claims [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Claim successful on node user
Nov 02 01:34:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:14 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:34:14 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:34:14 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8087MB free_disk=25.350692749023438GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:34:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:14 user nova-compute[74996]: DEBUG nova.compute.manager [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:34:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.806s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG nova.compute.manager [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.312s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG nova.compute.manager [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG nova.network.neutron [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Applying migration context for instance c04b39dd-3961-4e23-ad43-34a218f4a472 as it has an incoming, in-progress migration 837180ea-faaf-4ca9-a3de-4fd9b7db0a50. Migration status is post-migrating {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 02 01:34:15 user nova-compute[74996]: INFO nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Updating resource usage from migration 837180ea-faaf-4ca9-a3de-4fd9b7db0a50
Nov 02 01:34:15 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:34:15 user nova-compute[74996]: DEBUG nova.compute.manager [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance fea802b7-64d9-4c77-87a7-eaba1dce5c22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7307f3a3-1ad1-43f7-be49-9cd03a626cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 2621c5a2-acff-4055-9746-1b2f5829b39d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance ff502988-e729-4509-bd2d-ff16bf9e0a08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 4f81e089-21cf-4132-9f04-a5cf777158d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance fa6400fb-9e90-4f94-9da7-238b91276f41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Migration 837180ea-faaf-4ca9-a3de-4fd9b7db0a50 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance c04b39dd-3961-4e23-ad43-34a218f4a472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 6b79aa2f-02c7-492e-b27e-7481e41f8d2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG nova.policy [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '700d6c84a40547e99f3e364d6447ad4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6b2c4a38374459b73fa76b8dde9db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG nova.compute.manager [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:34:15 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Creating image(s)
Nov 02 01:34:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "/opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "/opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.024s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.198s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.647s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.868s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:34:15 user nova-compute[74996]: INFO nova.compute.claims [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Claim successful on node user
Nov 02 01:34:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.188s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk 1073741824" returned: 0 in 0.051s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG nova.network.neutron [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Successfully created port: eed60db2-70ab-4fd5-aa15-91c391740d1d {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.185s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:34:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:16 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Cannot resize image /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:34:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:34:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Ensure instance console log exists: /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:34:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:16 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:34:16 user nova-compute[74996]: DEBUG nova.objects.instance [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lazy-loading 'flavor' on Instance uuid ff502988-e729-4509-bd2d-ff16bf9e0a08 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:34:16 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:34:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d140ecaa-4367-4025-b73d-873c9205a5b8 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lock "ff502988-e729-4509-bd2d-ff16bf9e0a08" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.451s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.565s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:16 user nova-compute[74996]: DEBUG nova.compute.manager [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:34:16 user nova-compute[74996]: DEBUG nova.compute.manager [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:34:16 user nova-compute[74996]: DEBUG nova.network.neutron [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:34:16 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:34:16 user nova-compute[74996]: DEBUG nova.compute.manager [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:34:16 user nova-compute[74996]: DEBUG nova.policy [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be6bf504c3a649898e8c83399f6fee8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31965b482eb243a69112a49bf1302779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:34:16 user nova-compute[74996]: INFO nova.virt.block_device [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Booting with volume snapshot f4eff33c-dcbb-42c4-8cf7-de6433bb8c2d at /dev/vda
Nov 02 01:34:16 user nova-compute[74996]: DEBUG nova.network.neutron [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Successfully updated port: eed60db2-70ab-4fd5-aa15-91c391740d1d {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:34:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "refresh_cache-6b79aa2f-02c7-492e-b27e-7481e41f8d2c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:34:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquired lock "refresh_cache-6b79aa2f-02c7-492e-b27e-7481e41f8d2c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:34:16 user nova-compute[74996]: DEBUG nova.network.neutron [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:34:16 user nova-compute[74996]: DEBUG nova.compute.manager [req-106812bc-496d-4cf2-ac04-22b942ae4526 req-196b07e3-7713-4220-a514-053e717f9e65 service nova] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Received event network-changed-eed60db2-70ab-4fd5-aa15-91c391740d1d {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:34:16 user nova-compute[74996]: DEBUG nova.compute.manager [req-106812bc-496d-4cf2-ac04-22b942ae4526 req-196b07e3-7713-4220-a514-053e717f9e65 service nova] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Refreshing instance network info cache due to event network-changed-eed60db2-70ab-4fd5-aa15-91c391740d1d. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:34:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-106812bc-496d-4cf2-ac04-22b942ae4526 req-196b07e3-7713-4220-a514-053e717f9e65 service nova] Acquiring lock "refresh_cache-6b79aa2f-02c7-492e-b27e-7481e41f8d2c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:34:16 user nova-compute[74996]: DEBUG nova.network.neutron [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.network.neutron [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Updating instance_info_cache with network_info: [{"id": "eed60db2-70ab-4fd5-aa15-91c391740d1d", "address": "fa:16:3e:16:c6:b4", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed60db2-70", "ovs_interfaceid": "eed60db2-70ab-4fd5-aa15-91c391740d1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Releasing lock "refresh_cache-6b79aa2f-02c7-492e-b27e-7481e41f8d2c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.compute.manager [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Instance network_info: |[{"id": "eed60db2-70ab-4fd5-aa15-91c391740d1d", "address": "fa:16:3e:16:c6:b4", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed60db2-70", "ovs_interfaceid": "eed60db2-70ab-4fd5-aa15-91c391740d1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-106812bc-496d-4cf2-ac04-22b942ae4526 req-196b07e3-7713-4220-a514-053e717f9e65 service nova] Acquired lock "refresh_cache-6b79aa2f-02c7-492e-b27e-7481e41f8d2c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.network.neutron [req-106812bc-496d-4cf2-ac04-22b942ae4526 req-196b07e3-7713-4220-a514-053e717f9e65 service nova] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Refreshing network info cache for port eed60db2-70ab-4fd5-aa15-91c391740d1d {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Start _get_guest_xml network_info=[{"id": "eed60db2-70ab-4fd5-aa15-91c391740d1d", "address": "fa:16:3e:16:c6:b4", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed60db2-70", "ovs_interfaceid": "eed60db2-70ab-4fd5-aa15-91c391740d1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:34:17 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:34:17 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.network.neutron [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Successfully created port: 0881efe5-be2c-456a-abb9-a923b83c0f3e {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:34:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1815344306',display_name='tempest-AttachVolumeNegativeTest-server-1815344306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1815344306',id=13,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrpZWG4nOYTSLSUhU3pnNIr1LyK1MTKi3nNDiAjRCbp01rFzM+gqyUZoDGf8eHvyP7m0hpX7Ua/m6xcBvZ8oWAqIPU6ouLWb5U64a4B0P+Fux7I+UisdXLd4qL0xJ0aAQ==',key_name='tempest-keypair-570593061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b6b2c4a38374459b73fa76b8dde9db4',ramdisk_id='',reservation_id='r-63dnctsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1395123327',owner_user_name='tempest-AttachVolumeNegativeTest-1395123327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:34:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='700d6c84a40547e99f3e364d6447ad4e',uuid=6b79aa2f-02c7-492e-b27e-7481e41f8d2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eed60db2-70ab-4fd5-aa15-91c391740d1d", "address": "fa:16:3e:16:c6:b4", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed60db2-70", "ovs_interfaceid": "eed60db2-70ab-4fd5-aa15-91c391740d1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Converting VIF {"id": "eed60db2-70ab-4fd5-aa15-91c391740d1d", "address": "fa:16:3e:16:c6:b4", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed60db2-70", "ovs_interfaceid": "eed60db2-70ab-4fd5-aa15-91c391740d1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:c6:b4,bridge_name='br-int',has_traffic_filtering=True,id=eed60db2-70ab-4fd5-aa15-91c391740d1d,network=Network(d18bfd38-1454-4665-a175-2c7d0e2002ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeed60db2-70') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.objects.instance [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b79aa2f-02c7-492e-b27e-7481e41f8d2c {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:34:17 user nova-compute[74996]:   <uuid>6b79aa2f-02c7-492e-b27e-7481e41f8d2c</uuid>
Nov 02 01:34:17 user nova-compute[74996]:   <name>instance-0000000d</name>
Nov 02 01:34:17 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:34:17 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:34:17 user nova-compute[74996]:   <metadata>
Nov 02 01:34:17 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:34:17 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:34:17 user nova-compute[74996]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1815344306</nova:name>
Nov 02 01:34:17 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:34:17</nova:creationTime>
Nov 02 01:34:17 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:34:17 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:34:17 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:34:17 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:34:17 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:34:17 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:34:17 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:34:17 user nova-compute[74996]:       <nova:owner>
Nov 02 01:34:17 user nova-compute[74996]:         <nova:user uuid="700d6c84a40547e99f3e364d6447ad4e">tempest-AttachVolumeNegativeTest-1395123327-project-member</nova:user>
Nov 02 01:34:17 user nova-compute[74996]:         <nova:project uuid="9b6b2c4a38374459b73fa76b8dde9db4">tempest-AttachVolumeNegativeTest-1395123327</nova:project>
Nov 02 01:34:17 user nova-compute[74996]:       </nova:owner>
Nov 02 01:34:17 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:34:17 user nova-compute[74996]:       <nova:ports>
Nov 02 01:34:17 user nova-compute[74996]:         <nova:port uuid="eed60db2-70ab-4fd5-aa15-91c391740d1d">
Nov 02 01:34:17 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 02 01:34:17 user nova-compute[74996]:         </nova:port>
Nov 02 01:34:17 user nova-compute[74996]:       </nova:ports>
Nov 02 01:34:17 user nova-compute[74996]:     </nova:instance>
Nov 02 01:34:17 user nova-compute[74996]:   </metadata>
Nov 02 01:34:17 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:34:17 user nova-compute[74996]:     <system>
Nov 02 01:34:17 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:34:17 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:34:17 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:34:17 user nova-compute[74996]:       <entry name="serial">6b79aa2f-02c7-492e-b27e-7481e41f8d2c</entry>
Nov 02 01:34:17 user nova-compute[74996]:       <entry name="uuid">6b79aa2f-02c7-492e-b27e-7481e41f8d2c</entry>
Nov 02 01:34:17 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:34:17 user nova-compute[74996]:     </system>
Nov 02 01:34:17 user nova-compute[74996]:   </sysinfo>
Nov 02 01:34:17 user nova-compute[74996]:   <os>
Nov 02 01:34:17 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:34:17 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:34:17 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:34:17 user nova-compute[74996]:   </os>
Nov 02 01:34:17 user nova-compute[74996]:   <features>
Nov 02 01:34:17 user nova-compute[74996]:     <acpi/>
Nov 02 01:34:17 user nova-compute[74996]:     <apic/>
Nov 02 01:34:17 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:34:17 user nova-compute[74996]:   </features>
Nov 02 01:34:17 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:34:17 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:34:17 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:34:17 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:34:17 user nova-compute[74996]:   </clock>
Nov 02 01:34:17 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:34:17 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:34:17 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:34:17 user nova-compute[74996]:   </cpu>
Nov 02 01:34:17 user nova-compute[74996]:   <devices>
Nov 02 01:34:17 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:34:17 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:34:17 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk"/>
Nov 02 01:34:17 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:34:17 user nova-compute[74996]:     </disk>
Nov 02 01:34:17 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:34:17 user nova-compute[74996]:       <mac address="fa:16:3e:16:c6:b4"/>
Nov 02 01:34:17 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:34:17 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:34:17 user nova-compute[74996]:       <target dev="tapeed60db2-70"/>
Nov 02 01:34:17 user nova-compute[74996]:     </interface>
Nov 02 01:34:17 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:34:17 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/console.log" append="off"/>
Nov 02 01:34:17 user nova-compute[74996]:     </serial>
Nov 02 01:34:17 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:34:17 user nova-compute[74996]:     <video>
Nov 02 01:34:17 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:34:17 user nova-compute[74996]:     </video>
Nov 02 01:34:17 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:34:17 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:34:17 user nova-compute[74996]:     </rng>
Nov 02 01:34:17 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:34:17 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:34:17 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:34:17 user nova-compute[74996]:     </memballoon>
Nov 02 01:34:17 user nova-compute[74996]:   </devices>
Nov 02 01:34:17 user nova-compute[74996]: </domain>
Nov 02 01:34:17 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:34:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1815344306',display_name='tempest-AttachVolumeNegativeTest-server-1815344306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1815344306',id=13,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrpZWG4nOYTSLSUhU3pnNIr1LyK1MTKi3nNDiAjRCbp01rFzM+gqyUZoDGf8eHvyP7m0hpX7Ua/m6xcBvZ8oWAqIPU6ouLWb5U64a4B0P+Fux7I+UisdXLd4qL0xJ0aAQ==',key_name='tempest-keypair-570593061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b6b2c4a38374459b73fa76b8dde9db4',ramdisk_id='',reservation_id='r-63dnctsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1395123327',owner_user_name='tempest-AttachVolumeNegativeTest-1395123327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:34:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='700d6c84a40547e99f3e364d6447ad4e',uuid=6b79aa2f-02c7-492e-b27e-7481e41f8d2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eed60db2-70ab-4fd5-aa15-91c391740d1d", "address": "fa:16:3e:16:c6:b4", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed60db2-70", "ovs_interfaceid": "eed60db2-70ab-4fd5-aa15-91c391740d1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Converting VIF {"id": "eed60db2-70ab-4fd5-aa15-91c391740d1d", "address": "fa:16:3e:16:c6:b4", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed60db2-70", "ovs_interfaceid": "eed60db2-70ab-4fd5-aa15-91c391740d1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:c6:b4,bridge_name='br-int',has_traffic_filtering=True,id=eed60db2-70ab-4fd5-aa15-91c391740d1d,network=Network(d18bfd38-1454-4665-a175-2c7d0e2002ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeed60db2-70') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG os_vif [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:c6:b4,bridge_name='br-int',has_traffic_filtering=True,id=eed60db2-70ab-4fd5-aa15-91c391740d1d,network=Network(d18bfd38-1454-4665-a175-2c7d0e2002ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeed60db2-70') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67afe7b6-fe07-5a3c-83f6-87c2d50533f8', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeed60db2-70, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeed60db2-70, col_values=(('qos', UUID('513fd3a4-a7e3-469a-a763-d170eddf15b5')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeed60db2-70, col_values=(('external_ids', {'iface-id': 'eed60db2-70ab-4fd5-aa15-91c391740d1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:c6:b4', 'vm-uuid': '6b79aa2f-02c7-492e-b27e-7481e41f8d2c'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:17 user nova-compute[74996]: INFO os_vif [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:c6:b4,bridge_name='br-int',has_traffic_filtering=True,id=eed60db2-70ab-4fd5-aa15-91c391740d1d,network=Network(d18bfd38-1454-4665-a175-2c7d0e2002ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeed60db2-70')
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] No VIF found with MAC fa:16:3e:16:c6:b4, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.network.neutron [req-106812bc-496d-4cf2-ac04-22b942ae4526 req-196b07e3-7713-4220-a514-053e717f9e65 service nova] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Updated VIF entry in instance network info cache for port eed60db2-70ab-4fd5-aa15-91c391740d1d. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.network.neutron [req-106812bc-496d-4cf2-ac04-22b942ae4526 req-196b07e3-7713-4220-a514-053e717f9e65 service nova] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Updating instance_info_cache with network_info: [{"id": "eed60db2-70ab-4fd5-aa15-91c391740d1d", "address": "fa:16:3e:16:c6:b4", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed60db2-70", "ovs_interfaceid": "eed60db2-70ab-4fd5-aa15-91c391740d1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-106812bc-496d-4cf2-ac04-22b942ae4526 req-196b07e3-7713-4220-a514-053e717f9e65 service nova] Releasing lock "refresh_cache-6b79aa2f-02c7-492e-b27e-7481e41f8d2c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.network.neutron [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Successfully updated port: 0881efe5-be2c-456a-abb9-a923b83c0f3e {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "refresh_cache-12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquired lock "refresh_cache-12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.network.neutron [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.compute.manager [req-3b67c912-569a-46cf-8159-8b787cf4b2e1 req-5cd6e010-3c77-4511-a1fd-da853074da3f service nova] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Received event network-changed-0881efe5-be2c-456a-abb9-a923b83c0f3e {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.compute.manager [req-3b67c912-569a-46cf-8159-8b787cf4b2e1 req-5cd6e010-3c77-4511-a1fd-da853074da3f service nova] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Refreshing instance network info cache due to event network-changed-0881efe5-be2c-456a-abb9-a923b83c0f3e. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3b67c912-569a-46cf-8159-8b787cf4b2e1 req-5cd6e010-3c77-4511-a1fd-da853074da3f service nova] Acquiring lock "refresh_cache-12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:34:17 user nova-compute[74996]: DEBUG nova.network.neutron [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:34:18 user nova-compute[74996]: DEBUG nova.network.neutron [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Updating instance_info_cache with network_info: [{"id": "0881efe5-be2c-456a-abb9-a923b83c0f3e", "address": "fa:16:3e:97:b6:d5", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0881efe5-be", "ovs_interfaceid": "0881efe5-be2c-456a-abb9-a923b83c0f3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:34:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Releasing lock "refresh_cache-12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:34:18 user nova-compute[74996]: DEBUG nova.compute.manager [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Instance network_info: |[{"id": "0881efe5-be2c-456a-abb9-a923b83c0f3e", "address": "fa:16:3e:97:b6:d5", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0881efe5-be", "ovs_interfaceid": "0881efe5-be2c-456a-abb9-a923b83c0f3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:34:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3b67c912-569a-46cf-8159-8b787cf4b2e1 req-5cd6e010-3c77-4511-a1fd-da853074da3f service nova] Acquired lock "refresh_cache-12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:34:18 user nova-compute[74996]: DEBUG nova.network.neutron [req-3b67c912-569a-46cf-8159-8b787cf4b2e1 req-5cd6e010-3c77-4511-a1fd-da853074da3f service nova] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Refreshing network info cache for port 0881efe5-be2c-456a-abb9-a923b83c0f3e {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:34:18 user nova-compute[74996]: DEBUG nova.network.neutron [req-3b67c912-569a-46cf-8159-8b787cf4b2e1 req-5cd6e010-3c77-4511-a1fd-da853074da3f service nova] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Updated VIF entry in instance network info cache for port 0881efe5-be2c-456a-abb9-a923b83c0f3e. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:34:18 user nova-compute[74996]: DEBUG nova.network.neutron [req-3b67c912-569a-46cf-8159-8b787cf4b2e1 req-5cd6e010-3c77-4511-a1fd-da853074da3f service nova] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Updating instance_info_cache with network_info: [{"id": "0881efe5-be2c-456a-abb9-a923b83c0f3e", "address": "fa:16:3e:97:b6:d5", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0881efe5-be", "ovs_interfaceid": "0881efe5-be2c-456a-abb9-a923b83c0f3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:34:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3b67c912-569a-46cf-8159-8b787cf4b2e1 req-5cd6e010-3c77-4511-a1fd-da853074da3f service nova] Releasing lock "refresh_cache-12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:34:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:18 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:34:18 user nova-compute[74996]: DEBUG nova.compute.manager [req-ab5dda8d-5e8e-4dfe-8ff0-95a54bc4c1b2 req-54f64a07-6014-44e3-a2ab-bad2f7d73196 service nova] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Received event network-vif-plugged-eed60db2-70ab-4fd5-aa15-91c391740d1d {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:34:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ab5dda8d-5e8e-4dfe-8ff0-95a54bc4c1b2 req-54f64a07-6014-44e3-a2ab-bad2f7d73196 service nova] Acquiring lock "6b79aa2f-02c7-492e-b27e-7481e41f8d2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ab5dda8d-5e8e-4dfe-8ff0-95a54bc4c1b2 req-54f64a07-6014-44e3-a2ab-bad2f7d73196 service nova] Lock "6b79aa2f-02c7-492e-b27e-7481e41f8d2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ab5dda8d-5e8e-4dfe-8ff0-95a54bc4c1b2 req-54f64a07-6014-44e3-a2ab-bad2f7d73196 service nova] Lock "6b79aa2f-02c7-492e-b27e-7481e41f8d2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:18 user nova-compute[74996]: DEBUG nova.compute.manager [req-ab5dda8d-5e8e-4dfe-8ff0-95a54bc4c1b2 req-54f64a07-6014-44e3-a2ab-bad2f7d73196 service nova] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] No waiting events found dispatching network-vif-plugged-eed60db2-70ab-4fd5-aa15-91c391740d1d {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:34:18 user nova-compute[74996]: WARNING nova.compute.manager [req-ab5dda8d-5e8e-4dfe-8ff0-95a54bc4c1b2 req-54f64a07-6014-44e3-a2ab-bad2f7d73196 service nova] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Received unexpected event network-vif-plugged-eed60db2-70ab-4fd5-aa15-91c391740d1d for instance with vm_state building and task_state spawning.
Nov 02 01:34:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:20 user nova-compute[74996]: DEBUG nova.compute.manager [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:34:20 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:34:20 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Instance spawned successfully.
Nov 02 01:34:20 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:34:20 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:34:20 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:34:20 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:34:20 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:34:20 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:34:20 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:34:20 user nova-compute[74996]: INFO nova.compute.manager [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Took 5.65 seconds to spawn the instance on the hypervisor.
Nov 02 01:34:20 user nova-compute[74996]: DEBUG nova.compute.manager [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:34:20 user nova-compute[74996]: DEBUG nova.compute.manager [req-582d4be3-bc51-4f01-bf17-adc0e146178f req-8faa1873-e208-49cd-b2fb-0c2746f5dc9e service nova] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Received event network-vif-plugged-eed60db2-70ab-4fd5-aa15-91c391740d1d {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:34:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-582d4be3-bc51-4f01-bf17-adc0e146178f req-8faa1873-e208-49cd-b2fb-0c2746f5dc9e service nova] Acquiring lock "6b79aa2f-02c7-492e-b27e-7481e41f8d2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-582d4be3-bc51-4f01-bf17-adc0e146178f req-8faa1873-e208-49cd-b2fb-0c2746f5dc9e service nova] Lock "6b79aa2f-02c7-492e-b27e-7481e41f8d2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-582d4be3-bc51-4f01-bf17-adc0e146178f req-8faa1873-e208-49cd-b2fb-0c2746f5dc9e service nova] Lock "6b79aa2f-02c7-492e-b27e-7481e41f8d2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:20 user nova-compute[74996]: DEBUG nova.compute.manager [req-582d4be3-bc51-4f01-bf17-adc0e146178f req-8faa1873-e208-49cd-b2fb-0c2746f5dc9e service nova] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] No waiting events found dispatching network-vif-plugged-eed60db2-70ab-4fd5-aa15-91c391740d1d {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:34:20 user nova-compute[74996]: WARNING nova.compute.manager [req-582d4be3-bc51-4f01-bf17-adc0e146178f req-8faa1873-e208-49cd-b2fb-0c2746f5dc9e service nova] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Received unexpected event network-vif-plugged-eed60db2-70ab-4fd5-aa15-91c391740d1d for instance with vm_state building and task_state spawning.
Nov 02 01:34:21 user nova-compute[74996]: INFO nova.compute.manager [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Took 6.82 seconds to build instance.
Nov 02 01:34:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-f0f3fed4-140e-4a9d-97ea-8ffab41b9366 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "6b79aa2f-02c7-492e-b27e-7481e41f8d2c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.971s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:22 user nova-compute[74996]: DEBUG os_brick.utils [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:34:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec5bb3d-cebe-4c24-baa3-446126628cc7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb61fd3-adcb-4f34-bf7e-2b7c063c3d5f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74d2c5f-b932-4f93-bead-26c4d3f0243f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[443d8542-9d78-46ea-8146-28518a1aac74]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:34:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:34:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:34:22 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:34:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[55dcae50-8539-4ecc-a01d-3d2aa696928d]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:34:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:34:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:34:22 user nova-compute[74996]: DEBUG os_brick.utils [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:34:22 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Updating existing volume attachment record: 4347b3ea-e108-42b6-ae93-89b6ab265fd2 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:34:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:34:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:34:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 01:34:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:34:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Starting finish_migration {{(pid=74996) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Instance directory exists: not creating {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 01:34:33 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Creating image(s)
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.214s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk. size=21474836480 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk 21474836480 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk 21474836480" returned: 0 in 0.048s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Did not create local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Ensure instance console log exists: /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Start _get_guest_xml network_info=[{"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-545485614-network", "vif_mac": "fa:16:3e:75:a5:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '1365bf4e-634c-4cc2-ba89-e105bf4e737f', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EvZlqADN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c04b39dd-3961-4e23-ad43-34a218f4a472', 'attached_at': '2023-11-02T01:34:33.000000', 'detached_at': '', 'volume_id': '3b7eafb5-e19a-44f4-ba2b-38684fd2aa84', 'serial': '3b7eafb5-e19a-44f4-ba2b-38684fd2aa84'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:34:33 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:34:33 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:34:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EvZlqADN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:34:33 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:34:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:34:33 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:34:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:34:33 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[99574274-4552-4a07-a854-58de34467250]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:34:33 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebc34c1-5c80-4b3b-a218-9a674235030c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84] added
Nov 02 01:34:33 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7afb277-c951-40d3-a29d-33552cf74dfa]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8498c9-e7e4-4138-a92f-0889f39b84b6]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EvZlqADN {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EvZlqADN" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[251491b6-07ac-4817-84e8-2e940fbadb75]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EvZlqADN'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6280aa1-8c9c-466b-8073-6b676b9b749b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f3d5f4-9641-43f5-9d6c-3f48187e8e08]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 01:34:33 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 01:34:33 user nova-compute[74996]:  {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:34:33 user nova-compute[74996]: WARNING os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 01:34:33 user nova-compute[74996]: 
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e70f58-e3e2-437a-a9ef-8268fe75dad7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84, portal: 172.16.0.220,3260]
Nov 02 01:34:33 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84, portal: 172.16.0.220,3260] successful.
Nov 02 01:34:33 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e6a11b-e106-480d-ba2b-fbefea299df6]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d29eb9-65a8-4adb-81ad-c6d8a7c0d6f0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:34:33 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:34:33 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8612d17-a2a4-414b-a1b7-f1b450e6eab3]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:34:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EvZlqADN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:34:34 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:34:34 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23665623864653766', 'path': '/dev/sdb'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:34:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665623864653766', 'path': '/dev/sdb'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:34:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-83700266',display_name='tempest-ServerActionsTestOtherB-server-83700266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-83700266',id=2,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+Qz/HK0D2SWfSjBSFTRJ1B5PKDz0As2T6IrqSYMkdjVvyXlNOPr+4jggbHQf8/h9wUb6gFXAyyFyjYzXEE9DdDVU1SAq0i/8zGeoZyzalitAxQC04YuAZwWq1fcoAvuw==',key_name='tempest-keypair-912688440',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:29:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='28fc6b23ac2b4c7e82fd2a473ddc69c7',ramdisk_id='',reservation_id='r-8s5rn1jj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-539262669',owner_user_name='tempest-ServerActionsTestOtherB-539262669-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:34:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbb633ea13724161916c7a7b0ca2c392',uuid=c04b39dd-3961-4e23-ad43-34a218f4a472,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-545485614-network", "vif_mac": "fa:16:3e:75:a5:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:34:34 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Converting VIF {"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-545485614-network", "vif_mac": "fa:16:3e:75:a5:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:34:34 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:a5:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a0d9417-e8c0-4392-ba9b-f1e27712adad,network=Network(fb067344-da99-4071-93f6-a4f844b74341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0d9417-e8') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:34:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:34:34 user nova-compute[74996]:   <uuid>c04b39dd-3961-4e23-ad43-34a218f4a472</uuid>
Nov 02 01:34:34 user nova-compute[74996]:   <name>instance-00000002</name>
Nov 02 01:34:34 user nova-compute[74996]:   <memory>2097152</memory>
Nov 02 01:34:34 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:34:34 user nova-compute[74996]:   <metadata>
Nov 02 01:34:34 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:34:34 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:34:34 user nova-compute[74996]:       <nova:name>tempest-ServerActionsTestOtherB-server-83700266</nova:name>
Nov 02 01:34:34 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:34:33</nova:creationTime>
Nov 02 01:34:34 user nova-compute[74996]:       <nova:flavor name="m1.small">
Nov 02 01:34:34 user nova-compute[74996]:         <nova:memory>2048</nova:memory>
Nov 02 01:34:34 user nova-compute[74996]:         <nova:disk>20</nova:disk>
Nov 02 01:34:34 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:34:34 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:34:34 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:34:34 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:34:34 user nova-compute[74996]:       <nova:owner>
Nov 02 01:34:34 user nova-compute[74996]:         <nova:user uuid="fbb633ea13724161916c7a7b0ca2c392">tempest-ServerActionsTestOtherB-539262669-project-member</nova:user>
Nov 02 01:34:34 user nova-compute[74996]:         <nova:project uuid="28fc6b23ac2b4c7e82fd2a473ddc69c7">tempest-ServerActionsTestOtherB-539262669</nova:project>
Nov 02 01:34:34 user nova-compute[74996]:       </nova:owner>
Nov 02 01:34:34 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:34:34 user nova-compute[74996]:       <nova:ports>
Nov 02 01:34:34 user nova-compute[74996]:         <nova:port uuid="0a0d9417-e8c0-4392-ba9b-f1e27712adad">
Nov 02 01:34:34 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 02 01:34:34 user nova-compute[74996]:         </nova:port>
Nov 02 01:34:34 user nova-compute[74996]:       </nova:ports>
Nov 02 01:34:34 user nova-compute[74996]:     </nova:instance>
Nov 02 01:34:34 user nova-compute[74996]:   </metadata>
Nov 02 01:34:34 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:34:34 user nova-compute[74996]:     <system>
Nov 02 01:34:34 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:34:34 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:34:34 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:34:34 user nova-compute[74996]:       <entry name="serial">c04b39dd-3961-4e23-ad43-34a218f4a472</entry>
Nov 02 01:34:34 user nova-compute[74996]:       <entry name="uuid">c04b39dd-3961-4e23-ad43-34a218f4a472</entry>
Nov 02 01:34:34 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:34:34 user nova-compute[74996]:     </system>
Nov 02 01:34:34 user nova-compute[74996]:   </sysinfo>
Nov 02 01:34:34 user nova-compute[74996]:   <os>
Nov 02 01:34:34 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:34:34 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:34:34 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:34:34 user nova-compute[74996]:   </os>
Nov 02 01:34:34 user nova-compute[74996]:   <features>
Nov 02 01:34:34 user nova-compute[74996]:     <acpi/>
Nov 02 01:34:34 user nova-compute[74996]:     <apic/>
Nov 02 01:34:34 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:34:34 user nova-compute[74996]:   </features>
Nov 02 01:34:34 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:34:34 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:34:34 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:34:34 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:34:34 user nova-compute[74996]:   </clock>
Nov 02 01:34:34 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:34:34 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:34:34 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:34:34 user nova-compute[74996]:   </cpu>
Nov 02 01:34:34 user nova-compute[74996]:   <devices>
Nov 02 01:34:34 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:34:34 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:34:34 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk"/>
Nov 02 01:34:34 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:34:34 user nova-compute[74996]:     </disk>
Nov 02 01:34:34 user nova-compute[74996]:     <disk type="block" device="disk">
Nov 02 01:34:34 user nova-compute[74996]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:34:34 user nova-compute[74996]:       <source dev="/dev/sdb"/>
Nov 02 01:34:34 user nova-compute[74996]:       <target dev="vdb" bus="virtio"/>
Nov 02 01:34:34 user nova-compute[74996]:       <serial>3b7eafb5-e19a-44f4-ba2b-38684fd2aa84</serial>
Nov 02 01:34:34 user nova-compute[74996]:     </disk>
Nov 02 01:34:34 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:34:34 user nova-compute[74996]:       <mac address="fa:16:3e:75:a5:8a"/>
Nov 02 01:34:34 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:34:34 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:34:34 user nova-compute[74996]:       <target dev="tap0a0d9417-e8"/>
Nov 02 01:34:34 user nova-compute[74996]:     </interface>
Nov 02 01:34:34 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:34:34 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/console.log" append="off"/>
Nov 02 01:34:34 user nova-compute[74996]:     </serial>
Nov 02 01:34:34 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:34:34 user nova-compute[74996]:     <video>
Nov 02 01:34:34 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:34:34 user nova-compute[74996]:     </video>
Nov 02 01:34:34 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:34:34 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:34:34 user nova-compute[74996]:     </rng>
Nov 02 01:34:34 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:34:34 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:34:34 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:34:34 user nova-compute[74996]:     </memballoon>
Nov 02 01:34:34 user nova-compute[74996]:   </devices>
Nov 02 01:34:34 user nova-compute[74996]: </domain>
Nov 02 01:34:34 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:34:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-83700266',display_name='tempest-ServerActionsTestOtherB-server-83700266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-83700266',id=2,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+Qz/HK0D2SWfSjBSFTRJ1B5PKDz0As2T6IrqSYMkdjVvyXlNOPr+4jggbHQf8/h9wUb6gFXAyyFyjYzXEE9DdDVU1SAq0i/8zGeoZyzalitAxQC04YuAZwWq1fcoAvuw==',key_name='tempest-keypair-912688440',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:29:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='28fc6b23ac2b4c7e82fd2a473ddc69c7',ramdisk_id='',reservation_id='r-8s5rn1jj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-539262669',owner_user_name='tempest-ServerActionsTestOtherB-539262669-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:34:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbb633ea13724161916c7a7b0ca2c392',uuid=c04b39dd-3961-4e23-ad43-34a218f4a472,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-545485614-network", "vif_mac": "fa:16:3e:75:a5:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:34:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Converting VIF {"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-545485614-network", "vif_mac": "fa:16:3e:75:a5:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:34:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:a5:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a0d9417-e8c0-4392-ba9b-f1e27712adad,network=Network(fb067344-da99-4071-93f6-a4f844b74341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0d9417-e8') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:34:35 user nova-compute[74996]: DEBUG os_vif [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:a5:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a0d9417-e8c0-4392-ba9b-f1e27712adad,network=Network(fb067344-da99-4071-93f6-a4f844b74341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0d9417-e8') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:34:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:34:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:34:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '07e76245-23b1-5e9a-b4a7-4b3c9e8b4691', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:34:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:34:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a0d9417-e8, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:34:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a0d9417-e8, col_values=(('qos', UUID('82683be9-fe64-42c5-a750-bead6e30ee0c')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:34:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a0d9417-e8, col_values=(('external_ids', {'iface-id': '0a0d9417-e8c0-4392-ba9b-f1e27712adad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:a5:8a', 'vm-uuid': 'c04b39dd-3961-4e23-ad43-34a218f4a472'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:34:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:34:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:35 user nova-compute[74996]: INFO os_vif [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:a5:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a0d9417-e8c0-4392-ba9b-f1e27712adad,network=Network(fb067344-da99-4071-93f6-a4f844b74341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0d9417-e8')
Nov 02 01:34:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:34:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:34:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] No VIF found with MAC fa:16:3e:75:a5:8a, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:34:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-59d12c88-eff5-4ee7-91d8-f2ff373fe543 req-0c8a80bf-9d9d-49e2-b5cb-5e621fe69868 service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Received event network-vif-plugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:34:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-59d12c88-eff5-4ee7-91d8-f2ff373fe543 req-0c8a80bf-9d9d-49e2-b5cb-5e621fe69868 service nova] Acquiring lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-59d12c88-eff5-4ee7-91d8-f2ff373fe543 req-0c8a80bf-9d9d-49e2-b5cb-5e621fe69868 service nova] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-59d12c88-eff5-4ee7-91d8-f2ff373fe543 req-0c8a80bf-9d9d-49e2-b5cb-5e621fe69868 service nova] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-59d12c88-eff5-4ee7-91d8-f2ff373fe543 req-0c8a80bf-9d9d-49e2-b5cb-5e621fe69868 service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] No waiting events found dispatching network-vif-plugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:34:36 user nova-compute[74996]: WARNING nova.compute.manager [req-59d12c88-eff5-4ee7-91d8-f2ff373fe543 req-0c8a80bf-9d9d-49e2-b5cb-5e621fe69868 service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Received unexpected event network-vif-plugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad for instance with vm_state active and task_state resize_finish.
Nov 02 01:34:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:38 user nova-compute[74996]: DEBUG nova.compute.manager [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:34:38 user nova-compute[74996]: DEBUG nova.compute.manager [req-b8eeceff-ef01-4ad8-b14c-4e4eefdac91a req-a515ffb0-95b4-4311-8605-bc8948f753ad service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Received event network-vif-plugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:34:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b8eeceff-ef01-4ad8-b14c-4e4eefdac91a req-a515ffb0-95b4-4311-8605-bc8948f753ad service nova] Acquiring lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b8eeceff-ef01-4ad8-b14c-4e4eefdac91a req-a515ffb0-95b4-4311-8605-bc8948f753ad service nova] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b8eeceff-ef01-4ad8-b14c-4e4eefdac91a req-a515ffb0-95b4-4311-8605-bc8948f753ad service nova] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:38 user nova-compute[74996]: DEBUG nova.compute.manager [req-b8eeceff-ef01-4ad8-b14c-4e4eefdac91a req-a515ffb0-95b4-4311-8605-bc8948f753ad service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] No waiting events found dispatching network-vif-plugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:34:38 user nova-compute[74996]: WARNING nova.compute.manager [req-b8eeceff-ef01-4ad8-b14c-4e4eefdac91a req-a515ffb0-95b4-4311-8605-bc8948f753ad service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Received unexpected event network-vif-plugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad for instance with vm_state active and task_state resize_finish.
Nov 02 01:34:38 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Instance running successfully.
Nov 02 01:34:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Failed to set time: agent not configured {{(pid=74996) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 02 01:34:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6ef1459c-e9a9-45f9-a974-2ceb208306ae tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] finish_migration finished successfully. {{(pid=74996) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 02 01:34:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ad4373b2-9a03-49f4-a503-a6df38c1edd5 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Acquiring lock "ff502988-e729-4509-bd2d-ff16bf9e0a08" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ad4373b2-9a03-49f4-a503-a6df38c1edd5 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lock "ff502988-e729-4509-bd2d-ff16bf9e0a08" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ad4373b2-9a03-49f4-a503-a6df38c1edd5 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Acquiring lock "ff502988-e729-4509-bd2d-ff16bf9e0a08-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ad4373b2-9a03-49f4-a503-a6df38c1edd5 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lock "ff502988-e729-4509-bd2d-ff16bf9e0a08-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ad4373b2-9a03-49f4-a503-a6df38c1edd5 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lock "ff502988-e729-4509-bd2d-ff16bf9e0a08-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:42 user nova-compute[74996]: INFO nova.compute.manager [None req-ad4373b2-9a03-49f4-a503-a6df38c1edd5 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Terminating instance
Nov 02 01:34:42 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ad4373b2-9a03-49f4-a503-a6df38c1edd5 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:34:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-3456def5-a97d-479c-9ca8-944cecce14c0 req-407b9d53-e249-4863-8580-b45680b275da service nova] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Received event network-vif-unplugged-a7987061-7da2-417b-a279-9ed0d87f5488 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:34:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3456def5-a97d-479c-9ca8-944cecce14c0 req-407b9d53-e249-4863-8580-b45680b275da service nova] Acquiring lock "ff502988-e729-4509-bd2d-ff16bf9e0a08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3456def5-a97d-479c-9ca8-944cecce14c0 req-407b9d53-e249-4863-8580-b45680b275da service nova] Lock "ff502988-e729-4509-bd2d-ff16bf9e0a08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3456def5-a97d-479c-9ca8-944cecce14c0 req-407b9d53-e249-4863-8580-b45680b275da service nova] Lock "ff502988-e729-4509-bd2d-ff16bf9e0a08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-3456def5-a97d-479c-9ca8-944cecce14c0 req-407b9d53-e249-4863-8580-b45680b275da service nova] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] No waiting events found dispatching network-vif-unplugged-a7987061-7da2-417b-a279-9ed0d87f5488 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:34:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-3456def5-a97d-479c-9ca8-944cecce14c0 req-407b9d53-e249-4863-8580-b45680b275da service nova] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Received event network-vif-unplugged-a7987061-7da2-417b-a279-9ed0d87f5488 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:34:43 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Instance destroyed successfully.
Nov 02 01:34:43 user nova-compute[74996]: DEBUG nova.objects.instance [None req-ad4373b2-9a03-49f4-a503-a6df38c1edd5 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lazy-loading 'resources' on Instance uuid ff502988-e729-4509-bd2d-ff16bf9e0a08 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:34:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-ad4373b2-9a03-49f4-a503-a6df38c1edd5 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:30:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2140949878',display_name='tempest-TestVolumeSwap-server-2140949878',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2140949878',id=9,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJUKTLJZRxcaxbUDr7Ir9AqhEUMIG+xsuaJ57NEbkfTz6qcXkQglur9HjDvrmPA9V7A/22aD8pCZ8PLurqwp5klC0yBHGcsOCkxOhyTHErP8RU24mU91pwuvFsIjLDwMw==',key_name='tempest-keypair-829203099',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:30:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8ece99d67094759b97f5209450d3ac7',ramdisk_id='',reservation_id='r-340d0ev1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-208204034',owner_user_name='tempest-TestVolumeSwap-208204034-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:30:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60c00f8021b9408ebc66dffbb8c3ff5c',uuid=ff502988-e729-4509-bd2d-ff16bf9e0a08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7987061-7da2-417b-a279-9ed0d87f5488", "address": "fa:16:3e:3f:49:3f", "network": {"id": "2a0924da-5d99-47ea-be8c-887374c16253", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2096520879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8ece99d67094759b97f5209450d3ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7987061-7d", "ovs_interfaceid": "a7987061-7da2-417b-a279-9ed0d87f5488", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:34:43 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-ad4373b2-9a03-49f4-a503-a6df38c1edd5 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Converting VIF {"id": "a7987061-7da2-417b-a279-9ed0d87f5488", "address": "fa:16:3e:3f:49:3f", "network": {"id": "2a0924da-5d99-47ea-be8c-887374c16253", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2096520879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8ece99d67094759b97f5209450d3ac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7987061-7d", "ovs_interfaceid": "a7987061-7da2-417b-a279-9ed0d87f5488", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:34:43 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-ad4373b2-9a03-49f4-a503-a6df38c1edd5 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:49:3f,bridge_name='br-int',has_traffic_filtering=True,id=a7987061-7da2-417b-a279-9ed0d87f5488,network=Network(2a0924da-5d99-47ea-be8c-887374c16253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7987061-7d') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:34:43 user nova-compute[74996]: DEBUG os_vif [None req-ad4373b2-9a03-49f4-a503-a6df38c1edd5 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:49:3f,bridge_name='br-int',has_traffic_filtering=True,id=a7987061-7da2-417b-a279-9ed0d87f5488,network=Network(2a0924da-5d99-47ea-be8c-887374c16253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7987061-7d') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:34:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7987061-7d, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:34:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:34:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f157dccb-31c4-469b-b292-35b2a27344d4) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:34:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:34:43 user nova-compute[74996]: INFO os_vif [None req-ad4373b2-9a03-49f4-a503-a6df38c1edd5 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:49:3f,bridge_name='br-int',has_traffic_filtering=True,id=a7987061-7da2-417b-a279-9ed0d87f5488,network=Network(2a0924da-5d99-47ea-be8c-887374c16253),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7987061-7d')
Nov 02 01:34:43 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-ad4373b2-9a03-49f4-a503-a6df38c1edd5 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Deleting instance files /opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08_del
Nov 02 01:34:43 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-ad4373b2-9a03-49f4-a503-a6df38c1edd5 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Deletion of /opt/stack/data/nova/instances/ff502988-e729-4509-bd2d-ff16bf9e0a08_del complete
Nov 02 01:34:43 user nova-compute[74996]: INFO nova.compute.manager [None req-ad4373b2-9a03-49f4-a503-a6df38c1edd5 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 02 01:34:43 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-ad4373b2-9a03-49f4-a503-a6df38c1edd5 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:34:43 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:34:43 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:34:44 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:34:45 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Took 1.07 seconds to deallocate network for instance.
Nov 02 01:34:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ad4373b2-9a03-49f4-a503-a6df38c1edd5 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ad4373b2-9a03-49f4-a503-a6df38c1edd5 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "d8f51f7d-c9de-4914-883e-7a875d3d73ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "d8f51f7d-c9de-4914-883e-7a875d3d73ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:45 user nova-compute[74996]: DEBUG nova.compute.manager [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:34:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-cf6ae067-e75d-46c7-96c6-3cd56e7da16f req-53e03bb1-d403-4af1-87ed-e654c9c7d9d8 service nova] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Received event network-vif-plugged-a7987061-7da2-417b-a279-9ed0d87f5488 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:34:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cf6ae067-e75d-46c7-96c6-3cd56e7da16f req-53e03bb1-d403-4af1-87ed-e654c9c7d9d8 service nova] Acquiring lock "ff502988-e729-4509-bd2d-ff16bf9e0a08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cf6ae067-e75d-46c7-96c6-3cd56e7da16f req-53e03bb1-d403-4af1-87ed-e654c9c7d9d8 service nova] Lock "ff502988-e729-4509-bd2d-ff16bf9e0a08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cf6ae067-e75d-46c7-96c6-3cd56e7da16f req-53e03bb1-d403-4af1-87ed-e654c9c7d9d8 service nova] Lock "ff502988-e729-4509-bd2d-ff16bf9e0a08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-cf6ae067-e75d-46c7-96c6-3cd56e7da16f req-53e03bb1-d403-4af1-87ed-e654c9c7d9d8 service nova] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] No waiting events found dispatching network-vif-plugged-a7987061-7da2-417b-a279-9ed0d87f5488 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:34:45 user nova-compute[74996]: WARNING nova.compute.manager [req-cf6ae067-e75d-46c7-96c6-3cd56e7da16f req-53e03bb1-d403-4af1-87ed-e654c9c7d9d8 service nova] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Received unexpected event network-vif-plugged-a7987061-7da2-417b-a279-9ed0d87f5488 for instance with vm_state deleted and task_state None.
Nov 02 01:34:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-cf6ae067-e75d-46c7-96c6-3cd56e7da16f req-53e03bb1-d403-4af1-87ed-e654c9c7d9d8 service nova] [instance: ff502988-e729-4509-bd2d-ff16bf9e0a08] Received event network-vif-deleted-a7987061-7da2-417b-a279-9ed0d87f5488 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:34:45 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-ad4373b2-9a03-49f4-a503-a6df38c1edd5 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:34:45 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-ad4373b2-9a03-49f4-a503-a6df38c1edd5 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:34:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ad4373b2-9a03-49f4-a503-a6df38c1edd5 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:45 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:34:45 user nova-compute[74996]: INFO nova.compute.claims [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Claim successful on node user
Nov 02 01:34:45 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-ad4373b2-9a03-49f4-a503-a6df38c1edd5 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Deleted allocations for instance ff502988-e729-4509-bd2d-ff16bf9e0a08
Nov 02 01:34:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ad4373b2-9a03-49f4-a503-a6df38c1edd5 tempest-TestVolumeSwap-208204034 tempest-TestVolumeSwap-208204034-project-member] Lock "ff502988-e729-4509-bd2d-ff16bf9e0a08" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.848s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:45 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:34:45 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:34:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:46 user nova-compute[74996]: DEBUG nova.compute.manager [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:34:46 user nova-compute[74996]: DEBUG nova.compute.manager [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:34:46 user nova-compute[74996]: DEBUG nova.network.neutron [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:34:46 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:34:46 user nova-compute[74996]: DEBUG nova.compute.manager [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:34:46 user nova-compute[74996]: DEBUG nova.policy [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15affb427e9b4fb8873accf286510e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142161c2fae44bdea848619580195795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:34:46 user nova-compute[74996]: DEBUG nova.compute.manager [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:34:46 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:34:46 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Creating image(s)
Nov 02 01:34:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "/opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "/opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "/opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.196s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.226s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk 1073741824" returned: 0 in 0.066s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:46 user nova-compute[74996]: DEBUG nova.network.neutron [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Successfully created port: d0ea7655-29c6-450a-b2df-f2554925c3a5 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:34:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.247s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:47 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:34:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:47 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Cannot resize image /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:34:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:34:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Ensure instance console log exists: /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:34:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:47 user nova-compute[74996]: DEBUG nova.network.neutron [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Successfully updated port: d0ea7655-29c6-450a-b2df-f2554925c3a5 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:34:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "refresh_cache-d8f51f7d-c9de-4914-883e-7a875d3d73ad" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:34:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquired lock "refresh_cache-d8f51f7d-c9de-4914-883e-7a875d3d73ad" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:34:47 user nova-compute[74996]: DEBUG nova.network.neutron [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:34:47 user nova-compute[74996]: DEBUG nova.compute.manager [req-a30d9999-c77e-464c-8248-24b779290b26 req-c41ce76f-1f00-4312-9857-8fa3c1839c69 service nova] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Received event network-changed-d0ea7655-29c6-450a-b2df-f2554925c3a5 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:34:47 user nova-compute[74996]: DEBUG nova.compute.manager [req-a30d9999-c77e-464c-8248-24b779290b26 req-c41ce76f-1f00-4312-9857-8fa3c1839c69 service nova] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Refreshing instance network info cache due to event network-changed-d0ea7655-29c6-450a-b2df-f2554925c3a5. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:34:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a30d9999-c77e-464c-8248-24b779290b26 req-c41ce76f-1f00-4312-9857-8fa3c1839c69 service nova] Acquiring lock "refresh_cache-d8f51f7d-c9de-4914-883e-7a875d3d73ad" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:34:47 user nova-compute[74996]: DEBUG nova.network.neutron [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.network.neutron [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Updating instance_info_cache with network_info: [{"id": "d0ea7655-29c6-450a-b2df-f2554925c3a5", "address": "fa:16:3e:0d:f1:d9", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7655-29", "ovs_interfaceid": "d0ea7655-29c6-450a-b2df-f2554925c3a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Releasing lock "refresh_cache-d8f51f7d-c9de-4914-883e-7a875d3d73ad" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.compute.manager [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Instance network_info: |[{"id": "d0ea7655-29c6-450a-b2df-f2554925c3a5", "address": "fa:16:3e:0d:f1:d9", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7655-29", "ovs_interfaceid": "d0ea7655-29c6-450a-b2df-f2554925c3a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a30d9999-c77e-464c-8248-24b779290b26 req-c41ce76f-1f00-4312-9857-8fa3c1839c69 service nova] Acquired lock "refresh_cache-d8f51f7d-c9de-4914-883e-7a875d3d73ad" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.network.neutron [req-a30d9999-c77e-464c-8248-24b779290b26 req-c41ce76f-1f00-4312-9857-8fa3c1839c69 service nova] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Refreshing network info cache for port d0ea7655-29c6-450a-b2df-f2554925c3a5 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Start _get_guest_xml network_info=[{"id": "d0ea7655-29c6-450a-b2df-f2554925c3a5", "address": "fa:16:3e:0d:f1:d9", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7655-29", "ovs_interfaceid": "d0ea7655-29c6-450a-b2df-f2554925c3a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:34:48 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:34:48 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:34:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-748637036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-748637036',id=15,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='142161c2fae44bdea848619580195795',ramdisk_id='',reservation_id='r-p2zeajdk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1294190560',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:34:46Z,user_data=None,user_id='15affb427e9b4fb8873accf286510e14',uuid=d8f51f7d-c9de-4914-883e-7a875d3d73ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0ea7655-29c6-450a-b2df-f2554925c3a5", "address": "fa:16:3e:0d:f1:d9", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7655-29", "ovs_interfaceid": "d0ea7655-29c6-450a-b2df-f2554925c3a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Converting VIF {"id": "d0ea7655-29c6-450a-b2df-f2554925c3a5", "address": "fa:16:3e:0d:f1:d9", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7655-29", "ovs_interfaceid": "d0ea7655-29c6-450a-b2df-f2554925c3a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f1:d9,bridge_name='br-int',has_traffic_filtering=True,id=d0ea7655-29c6-450a-b2df-f2554925c3a5,network=Network(b5218514-0348-4dcc-8ecf-4595a87e204a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ea7655-29') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.objects.instance [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lazy-loading 'pci_devices' on Instance uuid d8f51f7d-c9de-4914-883e-7a875d3d73ad {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:34:48 user nova-compute[74996]:   <uuid>d8f51f7d-c9de-4914-883e-7a875d3d73ad</uuid>
Nov 02 01:34:48 user nova-compute[74996]:   <name>instance-0000000f</name>
Nov 02 01:34:48 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:34:48 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:34:48 user nova-compute[74996]:   <metadata>
Nov 02 01:34:48 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:34:48 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:34:48 user nova-compute[74996]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-748637036</nova:name>
Nov 02 01:34:48 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:34:48</nova:creationTime>
Nov 02 01:34:48 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:34:48 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:34:48 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:34:48 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:34:48 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:34:48 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:34:48 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:34:48 user nova-compute[74996]:       <nova:owner>
Nov 02 01:34:48 user nova-compute[74996]:         <nova:user uuid="15affb427e9b4fb8873accf286510e14">tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member</nova:user>
Nov 02 01:34:48 user nova-compute[74996]:         <nova:project uuid="142161c2fae44bdea848619580195795">tempest-ServerBootFromVolumeStableRescueTest-1294190560</nova:project>
Nov 02 01:34:48 user nova-compute[74996]:       </nova:owner>
Nov 02 01:34:48 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:34:48 user nova-compute[74996]:       <nova:ports>
Nov 02 01:34:48 user nova-compute[74996]:         <nova:port uuid="d0ea7655-29c6-450a-b2df-f2554925c3a5">
Nov 02 01:34:48 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 01:34:48 user nova-compute[74996]:         </nova:port>
Nov 02 01:34:48 user nova-compute[74996]:       </nova:ports>
Nov 02 01:34:48 user nova-compute[74996]:     </nova:instance>
Nov 02 01:34:48 user nova-compute[74996]:   </metadata>
Nov 02 01:34:48 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:34:48 user nova-compute[74996]:     <system>
Nov 02 01:34:48 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:34:48 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:34:48 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:34:48 user nova-compute[74996]:       <entry name="serial">d8f51f7d-c9de-4914-883e-7a875d3d73ad</entry>
Nov 02 01:34:48 user nova-compute[74996]:       <entry name="uuid">d8f51f7d-c9de-4914-883e-7a875d3d73ad</entry>
Nov 02 01:34:48 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:34:48 user nova-compute[74996]:     </system>
Nov 02 01:34:48 user nova-compute[74996]:   </sysinfo>
Nov 02 01:34:48 user nova-compute[74996]:   <os>
Nov 02 01:34:48 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:34:48 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:34:48 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:34:48 user nova-compute[74996]:   </os>
Nov 02 01:34:48 user nova-compute[74996]:   <features>
Nov 02 01:34:48 user nova-compute[74996]:     <acpi/>
Nov 02 01:34:48 user nova-compute[74996]:     <apic/>
Nov 02 01:34:48 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:34:48 user nova-compute[74996]:   </features>
Nov 02 01:34:48 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:34:48 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:34:48 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:34:48 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:34:48 user nova-compute[74996]:   </clock>
Nov 02 01:34:48 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:34:48 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:34:48 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:34:48 user nova-compute[74996]:   </cpu>
Nov 02 01:34:48 user nova-compute[74996]:   <devices>
Nov 02 01:34:48 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:34:48 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:34:48 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk"/>
Nov 02 01:34:48 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:34:48 user nova-compute[74996]:     </disk>
Nov 02 01:34:48 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:34:48 user nova-compute[74996]:       <mac address="fa:16:3e:0d:f1:d9"/>
Nov 02 01:34:48 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:34:48 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:34:48 user nova-compute[74996]:       <target dev="tapd0ea7655-29"/>
Nov 02 01:34:48 user nova-compute[74996]:     </interface>
Nov 02 01:34:48 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:34:48 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/console.log" append="off"/>
Nov 02 01:34:48 user nova-compute[74996]:     </serial>
Nov 02 01:34:48 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:34:48 user nova-compute[74996]:     <video>
Nov 02 01:34:48 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:34:48 user nova-compute[74996]:     </video>
Nov 02 01:34:48 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:34:48 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:34:48 user nova-compute[74996]:     </rng>
Nov 02 01:34:48 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:34:48 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:34:48 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:34:48 user nova-compute[74996]:     </memballoon>
Nov 02 01:34:48 user nova-compute[74996]:   </devices>
Nov 02 01:34:48 user nova-compute[74996]: </domain>
Nov 02 01:34:48 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:34:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-748637036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-748637036',id=15,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='142161c2fae44bdea848619580195795',ramdisk_id='',reservation_id='r-p2zeajdk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1294190560',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:34:46Z,user_data=None,user_id='15affb427e9b4fb8873accf286510e14',uuid=d8f51f7d-c9de-4914-883e-7a875d3d73ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0ea7655-29c6-450a-b2df-f2554925c3a5", "address": "fa:16:3e:0d:f1:d9", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7655-29", "ovs_interfaceid": "d0ea7655-29c6-450a-b2df-f2554925c3a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Converting VIF {"id": "d0ea7655-29c6-450a-b2df-f2554925c3a5", "address": "fa:16:3e:0d:f1:d9", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7655-29", "ovs_interfaceid": "d0ea7655-29c6-450a-b2df-f2554925c3a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f1:d9,bridge_name='br-int',has_traffic_filtering=True,id=d0ea7655-29c6-450a-b2df-f2554925c3a5,network=Network(b5218514-0348-4dcc-8ecf-4595a87e204a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ea7655-29') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG os_vif [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f1:d9,bridge_name='br-int',has_traffic_filtering=True,id=d0ea7655-29c6-450a-b2df-f2554925c3a5,network=Network(b5218514-0348-4dcc-8ecf-4595a87e204a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ea7655-29') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '90da1936-2248-55ba-80dc-b3e45ea68504', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0ea7655-29, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0ea7655-29, col_values=(('qos', UUID('6ea5e245-8d21-413f-8bb4-e542c5c94b9d')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0ea7655-29, col_values=(('external_ids', {'iface-id': 'd0ea7655-29c6-450a-b2df-f2554925c3a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:f1:d9', 'vm-uuid': 'd8f51f7d-c9de-4914-883e-7a875d3d73ad'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:48 user nova-compute[74996]: INFO os_vif [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f1:d9,bridge_name='br-int',has_traffic_filtering=True,id=d0ea7655-29c6-450a-b2df-f2554925c3a5,network=Network(b5218514-0348-4dcc-8ecf-4595a87e204a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ea7655-29')
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] No VIF found with MAC fa:16:3e:0d:f1:d9, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.network.neutron [req-a30d9999-c77e-464c-8248-24b779290b26 req-c41ce76f-1f00-4312-9857-8fa3c1839c69 service nova] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Updated VIF entry in instance network info cache for port d0ea7655-29c6-450a-b2df-f2554925c3a5. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG nova.network.neutron [req-a30d9999-c77e-464c-8248-24b779290b26 req-c41ce76f-1f00-4312-9857-8fa3c1839c69 service nova] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Updating instance_info_cache with network_info: [{"id": "d0ea7655-29c6-450a-b2df-f2554925c3a5", "address": "fa:16:3e:0d:f1:d9", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7655-29", "ovs_interfaceid": "d0ea7655-29c6-450a-b2df-f2554925c3a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:34:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a30d9999-c77e-464c-8248-24b779290b26 req-c41ce76f-1f00-4312-9857-8fa3c1839c69 service nova] Releasing lock "refresh_cache-d8f51f7d-c9de-4914-883e-7a875d3d73ad" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:34:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:50 user nova-compute[74996]: DEBUG nova.compute.manager [req-fb93b503-ceac-4f09-a812-3dd0713a9852 req-1b08b8e6-a217-4557-922e-284eaf7081be service nova] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Received event network-vif-plugged-d0ea7655-29c6-450a-b2df-f2554925c3a5 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:34:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-fb93b503-ceac-4f09-a812-3dd0713a9852 req-1b08b8e6-a217-4557-922e-284eaf7081be service nova] Acquiring lock "d8f51f7d-c9de-4914-883e-7a875d3d73ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-fb93b503-ceac-4f09-a812-3dd0713a9852 req-1b08b8e6-a217-4557-922e-284eaf7081be service nova] Lock "d8f51f7d-c9de-4914-883e-7a875d3d73ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-fb93b503-ceac-4f09-a812-3dd0713a9852 req-1b08b8e6-a217-4557-922e-284eaf7081be service nova] Lock "d8f51f7d-c9de-4914-883e-7a875d3d73ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:50 user nova-compute[74996]: DEBUG nova.compute.manager [req-fb93b503-ceac-4f09-a812-3dd0713a9852 req-1b08b8e6-a217-4557-922e-284eaf7081be service nova] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] No waiting events found dispatching network-vif-plugged-d0ea7655-29c6-450a-b2df-f2554925c3a5 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:34:50 user nova-compute[74996]: WARNING nova.compute.manager [req-fb93b503-ceac-4f09-a812-3dd0713a9852 req-1b08b8e6-a217-4557-922e-284eaf7081be service nova] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Received unexpected event network-vif-plugged-d0ea7655-29c6-450a-b2df-f2554925c3a5 for instance with vm_state building and task_state spawning.
Nov 02 01:34:52 user nova-compute[74996]: DEBUG nova.compute.manager [req-0d1d4d33-8d9b-4a49-8942-d20e2413da3d req-24ba25eb-2603-481c-b87c-7f665c90deac service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Received event network-changed-7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:34:52 user nova-compute[74996]: DEBUG nova.compute.manager [req-0d1d4d33-8d9b-4a49-8942-d20e2413da3d req-24ba25eb-2603-481c-b87c-7f665c90deac service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Refreshing instance network info cache due to event network-changed-7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:34:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0d1d4d33-8d9b-4a49-8942-d20e2413da3d req-24ba25eb-2603-481c-b87c-7f665c90deac service nova] Acquiring lock "refresh_cache-fa6400fb-9e90-4f94-9da7-238b91276f41" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:34:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0d1d4d33-8d9b-4a49-8942-d20e2413da3d req-24ba25eb-2603-481c-b87c-7f665c90deac service nova] Acquired lock "refresh_cache-fa6400fb-9e90-4f94-9da7-238b91276f41" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:34:52 user nova-compute[74996]: DEBUG nova.network.neutron [req-0d1d4d33-8d9b-4a49-8942-d20e2413da3d req-24ba25eb-2603-481c-b87c-7f665c90deac service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Refreshing network info cache for port 7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:34:52 user nova-compute[74996]: DEBUG nova.compute.manager [req-cf054780-64a2-4102-a32f-67c2bc714a79 req-dd938733-623b-4a52-92e7-78f0aba54a92 service nova] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Received event network-vif-plugged-d0ea7655-29c6-450a-b2df-f2554925c3a5 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:34:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cf054780-64a2-4102-a32f-67c2bc714a79 req-dd938733-623b-4a52-92e7-78f0aba54a92 service nova] Acquiring lock "d8f51f7d-c9de-4914-883e-7a875d3d73ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cf054780-64a2-4102-a32f-67c2bc714a79 req-dd938733-623b-4a52-92e7-78f0aba54a92 service nova] Lock "d8f51f7d-c9de-4914-883e-7a875d3d73ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cf054780-64a2-4102-a32f-67c2bc714a79 req-dd938733-623b-4a52-92e7-78f0aba54a92 service nova] Lock "d8f51f7d-c9de-4914-883e-7a875d3d73ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:52 user nova-compute[74996]: DEBUG nova.compute.manager [req-cf054780-64a2-4102-a32f-67c2bc714a79 req-dd938733-623b-4a52-92e7-78f0aba54a92 service nova] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] No waiting events found dispatching network-vif-plugged-d0ea7655-29c6-450a-b2df-f2554925c3a5 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:34:52 user nova-compute[74996]: WARNING nova.compute.manager [req-cf054780-64a2-4102-a32f-67c2bc714a79 req-dd938733-623b-4a52-92e7-78f0aba54a92 service nova] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Received unexpected event network-vif-plugged-d0ea7655-29c6-450a-b2df-f2554925c3a5 for instance with vm_state building and task_state spawning.
Nov 02 01:34:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:52 user nova-compute[74996]: DEBUG nova.compute.manager [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:34:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:34:52 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Instance spawned successfully.
Nov 02 01:34:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:34:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:34:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:34:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:34:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:34:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:34:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:34:52 user nova-compute[74996]: INFO nova.compute.manager [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Took 6.36 seconds to spawn the instance on the hypervisor.
Nov 02 01:34:52 user nova-compute[74996]: DEBUG nova.compute.manager [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:34:52 user nova-compute[74996]: INFO nova.compute.manager [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Took 7.38 seconds to build instance.
Nov 02 01:34:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3430c314-9a41-461d-85e7-dcce519b67a9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "d8f51f7d-c9de-4914-883e-7a875d3d73ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.532s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "fa6400fb-9e90-4f94-9da7-238b91276f41" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:52 user nova-compute[74996]: DEBUG nova.objects.instance [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lazy-loading 'flavor' on Instance uuid fa6400fb-9e90-4f94-9da7-238b91276f41 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:34:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "fa6400fb-9e90-4f94-9da7-238b91276f41" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:53 user nova-compute[74996]: INFO nova.compute.manager [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Attaching volume a249585d-899f-41ad-ab90-28d47b08fcf1 to /dev/vdb
Nov 02 01:34:53 user nova-compute[74996]: DEBUG os_brick.utils [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:34:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e038c004-bfdd-4b0e-85e3-37699b126ed0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ecc444-373b-49f5-a866-de113c4830cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fa5b3a-227f-43f8-ab71-c7848a695b72]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2576e5cd-b6b0-4e5b-9687-19b42e86cc4e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:34:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:34:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:34:53 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:34:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[529d685c-59ab-4c82-bc03-487c4120cce3]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:34:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:34:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:34:53 user nova-compute[74996]: DEBUG os_brick.utils [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:34:53 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Updating existing volume attachment record: c34d8966-8147-403a-aa1c-0580169b5e0f {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:34:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:54 user nova-compute[74996]: DEBUG nova.network.neutron [req-0d1d4d33-8d9b-4a49-8942-d20e2413da3d req-24ba25eb-2603-481c-b87c-7f665c90deac service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Updated VIF entry in instance network info cache for port 7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:34:54 user nova-compute[74996]: DEBUG nova.network.neutron [req-0d1d4d33-8d9b-4a49-8942-d20e2413da3d req-24ba25eb-2603-481c-b87c-7f665c90deac service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Updating instance_info_cache with network_info: [{"id": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "address": "fa:16:3e:8e:48:16", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3ba0fb-89", "ovs_interfaceid": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:34:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0d1d4d33-8d9b-4a49-8942-d20e2413da3d req-24ba25eb-2603-481c-b87c-7f665c90deac service nova] Releasing lock "refresh_cache-fa6400fb-9e90-4f94-9da7-238b91276f41" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:34:55 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:57 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:34:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:34:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:34:58 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:34:58 user nova-compute[74996]: INFO nova.compute.claims [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Claim successful on node user
Nov 02 01:34:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:34:58 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:34:58 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:34:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.851s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:34:58 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:34:59 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:34:59 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:34:59 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:34:59 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:34:59 user nova-compute[74996]: INFO nova.virt.block_device [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Booting with volume d40ffcc9-49b2-4ea4-b422-5b07631491e0 at /dev/vda
Nov 02 01:34:59 user nova-compute[74996]: DEBUG nova.policy [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a47029fcd5f04869ab686e226867793c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98a3a508c5c4966806cb9352c4b9090', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:34:59 user nova-compute[74996]: DEBUG os_brick.utils [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:34:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9af3057-3c38-439e-8ad1-1783cac0407d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7c9530-f615-424d-af7b-6cf443f9f3f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:34:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[441c6eaf-a385-4a77-8082-872ea53d2d52]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6503f798-3694-4f20-8e7a-acc5d9032000]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:34:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:34:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:34:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:34:59 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:34:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b3f0bc-c7ee-45cb-a8b6-06d54b32e36d]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:34:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:34:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:34:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:34:59 user nova-compute[74996]: DEBUG os_brick.utils [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:34:59 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Updating existing volume attachment record: 644bdb9a-ccb8-4882-a7ae-15b582530b55 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:35:00 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Successfully created port: 863ea8b0-7e3d-459a-bfb7-435e3e5001bf {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:35:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:00 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Successfully created port: 37104018-4ea0-4b2f-b507-8887a4f7348a {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:35:01 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Successfully created port: 3ade5deb-e2db-4310-b1a6-df399639eb00 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:35:02 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Successfully created port: 9042d944-67c5-4e39-9232-72ff23c6f1e0 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:35:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:03 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Successfully created port: 87bf8398-6ede-4465-9555-1000f74e75ff {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:35:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:04 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Successfully updated port: 863ea8b0-7e3d-459a-bfb7-435e3e5001bf {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:35:04 user nova-compute[74996]: DEBUG nova.compute.manager [req-8f46e4aa-cbdc-41f0-b1c5-a8bc696164ed req-b23c5ac5-f90e-47de-9663-072ad779ea55 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-changed-863ea8b0-7e3d-459a-bfb7-435e3e5001bf {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:35:04 user nova-compute[74996]: DEBUG nova.compute.manager [req-8f46e4aa-cbdc-41f0-b1c5-a8bc696164ed req-b23c5ac5-f90e-47de-9663-072ad779ea55 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Refreshing instance network info cache due to event network-changed-863ea8b0-7e3d-459a-bfb7-435e3e5001bf. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:35:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8f46e4aa-cbdc-41f0-b1c5-a8bc696164ed req-b23c5ac5-f90e-47de-9663-072ad779ea55 service nova] Acquiring lock "refresh_cache-adfc9441-d607-4b9f-8008-95e42f1ac51e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:35:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8f46e4aa-cbdc-41f0-b1c5-a8bc696164ed req-b23c5ac5-f90e-47de-9663-072ad779ea55 service nova] Acquired lock "refresh_cache-adfc9441-d607-4b9f-8008-95e42f1ac51e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:35:04 user nova-compute[74996]: DEBUG nova.network.neutron [req-8f46e4aa-cbdc-41f0-b1c5-a8bc696164ed req-b23c5ac5-f90e-47de-9663-072ad779ea55 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Refreshing network info cache for port 863ea8b0-7e3d-459a-bfb7-435e3e5001bf {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:35:04 user nova-compute[74996]: DEBUG nova.network.neutron [req-8f46e4aa-cbdc-41f0-b1c5-a8bc696164ed req-b23c5ac5-f90e-47de-9663-072ad779ea55 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:35:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:04 user nova-compute[74996]: DEBUG nova.network.neutron [req-8f46e4aa-cbdc-41f0-b1c5-a8bc696164ed req-b23c5ac5-f90e-47de-9663-072ad779ea55 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:35:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8f46e4aa-cbdc-41f0-b1c5-a8bc696164ed req-b23c5ac5-f90e-47de-9663-072ad779ea55 service nova] Releasing lock "refresh_cache-adfc9441-d607-4b9f-8008-95e42f1ac51e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:35:05 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Successfully updated port: 62492819-8da0-4a9f-9f78-facaaa194017 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:35:06 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Successfully updated port: 019034ca-6f89-400f-b47a-61e1157f860f {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:35:06 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:35:06 user nova-compute[74996]: DEBUG nova.compute.manager [req-8dbcce29-0bd6-41bb-8185-3778bac294f2 req-ed49122c-5433-403b-9985-15dfcd0f350d service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-changed-62492819-8da0-4a9f-9f78-facaaa194017 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:35:06 user nova-compute[74996]: DEBUG nova.compute.manager [req-8dbcce29-0bd6-41bb-8185-3778bac294f2 req-ed49122c-5433-403b-9985-15dfcd0f350d service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Refreshing instance network info cache due to event network-changed-62492819-8da0-4a9f-9f78-facaaa194017. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:35:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8dbcce29-0bd6-41bb-8185-3778bac294f2 req-ed49122c-5433-403b-9985-15dfcd0f350d service nova] Acquiring lock "refresh_cache-adfc9441-d607-4b9f-8008-95e42f1ac51e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:35:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8dbcce29-0bd6-41bb-8185-3778bac294f2 req-ed49122c-5433-403b-9985-15dfcd0f350d service nova] Acquired lock "refresh_cache-adfc9441-d607-4b9f-8008-95e42f1ac51e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:35:06 user nova-compute[74996]: DEBUG nova.network.neutron [req-8dbcce29-0bd6-41bb-8185-3778bac294f2 req-ed49122c-5433-403b-9985-15dfcd0f350d service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Refreshing network info cache for port 62492819-8da0-4a9f-9f78-facaaa194017 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:35:06 user nova-compute[74996]: DEBUG nova.network.neutron [req-8dbcce29-0bd6-41bb-8185-3778bac294f2 req-ed49122c-5433-403b-9985-15dfcd0f350d service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:35:06 user nova-compute[74996]: DEBUG nova.network.neutron [req-8dbcce29-0bd6-41bb-8185-3778bac294f2 req-ed49122c-5433-403b-9985-15dfcd0f350d service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:35:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8dbcce29-0bd6-41bb-8185-3778bac294f2 req-ed49122c-5433-403b-9985-15dfcd0f350d service nova] Releasing lock "refresh_cache-adfc9441-d607-4b9f-8008-95e42f1ac51e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:35:06 user nova-compute[74996]: DEBUG nova.compute.manager [req-8dbcce29-0bd6-41bb-8185-3778bac294f2 req-ed49122c-5433-403b-9985-15dfcd0f350d service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-changed-019034ca-6f89-400f-b47a-61e1157f860f {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:35:06 user nova-compute[74996]: DEBUG nova.compute.manager [req-8dbcce29-0bd6-41bb-8185-3778bac294f2 req-ed49122c-5433-403b-9985-15dfcd0f350d service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Refreshing instance network info cache due to event network-changed-019034ca-6f89-400f-b47a-61e1157f860f. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:35:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8dbcce29-0bd6-41bb-8185-3778bac294f2 req-ed49122c-5433-403b-9985-15dfcd0f350d service nova] Acquiring lock "refresh_cache-adfc9441-d607-4b9f-8008-95e42f1ac51e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:35:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8dbcce29-0bd6-41bb-8185-3778bac294f2 req-ed49122c-5433-403b-9985-15dfcd0f350d service nova] Acquired lock "refresh_cache-adfc9441-d607-4b9f-8008-95e42f1ac51e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:35:06 user nova-compute[74996]: DEBUG nova.network.neutron [req-8dbcce29-0bd6-41bb-8185-3778bac294f2 req-ed49122c-5433-403b-9985-15dfcd0f350d service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Refreshing network info cache for port 019034ca-6f89-400f-b47a-61e1157f860f {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:35:06 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Successfully updated port: 37104018-4ea0-4b2f-b507-8887a4f7348a {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:35:06 user nova-compute[74996]: DEBUG nova.network.neutron [req-8dbcce29-0bd6-41bb-8185-3778bac294f2 req-ed49122c-5433-403b-9985-15dfcd0f350d service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:35:07 user nova-compute[74996]: DEBUG nova.network.neutron [req-8dbcce29-0bd6-41bb-8185-3778bac294f2 req-ed49122c-5433-403b-9985-15dfcd0f350d service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:35:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8dbcce29-0bd6-41bb-8185-3778bac294f2 req-ed49122c-5433-403b-9985-15dfcd0f350d service nova] Releasing lock "refresh_cache-adfc9441-d607-4b9f-8008-95e42f1ac51e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:35:07 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:35:07 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:35:07 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Successfully updated port: 3ade5deb-e2db-4310-b1a6-df399639eb00 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:35:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:08 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Successfully updated port: 9042d944-67c5-4e39-9232-72ff23c6f1e0 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:35:08 user nova-compute[74996]: DEBUG nova.compute.manager [req-762e9fd6-7a56-43a3-a836-b6e86bcbf9a6 req-ca195505-f9d2-44e8-982c-e5df984503cf service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-changed-37104018-4ea0-4b2f-b507-8887a4f7348a {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:35:08 user nova-compute[74996]: DEBUG nova.compute.manager [req-762e9fd6-7a56-43a3-a836-b6e86bcbf9a6 req-ca195505-f9d2-44e8-982c-e5df984503cf service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Refreshing instance network info cache due to event network-changed-37104018-4ea0-4b2f-b507-8887a4f7348a. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:35:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-762e9fd6-7a56-43a3-a836-b6e86bcbf9a6 req-ca195505-f9d2-44e8-982c-e5df984503cf service nova] Acquiring lock "refresh_cache-adfc9441-d607-4b9f-8008-95e42f1ac51e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:35:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-762e9fd6-7a56-43a3-a836-b6e86bcbf9a6 req-ca195505-f9d2-44e8-982c-e5df984503cf service nova] Acquired lock "refresh_cache-adfc9441-d607-4b9f-8008-95e42f1ac51e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:35:08 user nova-compute[74996]: DEBUG nova.network.neutron [req-762e9fd6-7a56-43a3-a836-b6e86bcbf9a6 req-ca195505-f9d2-44e8-982c-e5df984503cf service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Refreshing network info cache for port 37104018-4ea0-4b2f-b507-8887a4f7348a {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:35:08 user nova-compute[74996]: DEBUG nova.network.neutron [req-762e9fd6-7a56-43a3-a836-b6e86bcbf9a6 req-ca195505-f9d2-44e8-982c-e5df984503cf service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:35:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:08 user nova-compute[74996]: DEBUG nova.network.neutron [req-762e9fd6-7a56-43a3-a836-b6e86bcbf9a6 req-ca195505-f9d2-44e8-982c-e5df984503cf service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:35:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-762e9fd6-7a56-43a3-a836-b6e86bcbf9a6 req-ca195505-f9d2-44e8-982c-e5df984503cf service nova] Releasing lock "refresh_cache-adfc9441-d607-4b9f-8008-95e42f1ac51e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:35:08 user nova-compute[74996]: DEBUG nova.compute.manager [req-762e9fd6-7a56-43a3-a836-b6e86bcbf9a6 req-ca195505-f9d2-44e8-982c-e5df984503cf service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-changed-3ade5deb-e2db-4310-b1a6-df399639eb00 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:35:08 user nova-compute[74996]: DEBUG nova.compute.manager [req-762e9fd6-7a56-43a3-a836-b6e86bcbf9a6 req-ca195505-f9d2-44e8-982c-e5df984503cf service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Refreshing instance network info cache due to event network-changed-3ade5deb-e2db-4310-b1a6-df399639eb00. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:35:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-762e9fd6-7a56-43a3-a836-b6e86bcbf9a6 req-ca195505-f9d2-44e8-982c-e5df984503cf service nova] Acquiring lock "refresh_cache-adfc9441-d607-4b9f-8008-95e42f1ac51e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:35:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-762e9fd6-7a56-43a3-a836-b6e86bcbf9a6 req-ca195505-f9d2-44e8-982c-e5df984503cf service nova] Acquired lock "refresh_cache-adfc9441-d607-4b9f-8008-95e42f1ac51e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:35:08 user nova-compute[74996]: DEBUG nova.network.neutron [req-762e9fd6-7a56-43a3-a836-b6e86bcbf9a6 req-ca195505-f9d2-44e8-982c-e5df984503cf service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Refreshing network info cache for port 3ade5deb-e2db-4310-b1a6-df399639eb00 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:35:08 user nova-compute[74996]: DEBUG nova.network.neutron [req-762e9fd6-7a56-43a3-a836-b6e86bcbf9a6 req-ca195505-f9d2-44e8-982c-e5df984503cf service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:35:08 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Successfully updated port: 87bf8398-6ede-4465-9555-1000f74e75ff {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:35:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Acquiring lock "refresh_cache-adfc9441-d607-4b9f-8008-95e42f1ac51e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:35:08 user nova-compute[74996]: DEBUG nova.network.neutron [req-762e9fd6-7a56-43a3-a836-b6e86bcbf9a6 req-ca195505-f9d2-44e8-982c-e5df984503cf service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:35:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-762e9fd6-7a56-43a3-a836-b6e86bcbf9a6 req-ca195505-f9d2-44e8-982c-e5df984503cf service nova] Releasing lock "refresh_cache-adfc9441-d607-4b9f-8008-95e42f1ac51e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:35:09 user nova-compute[74996]: DEBUG nova.compute.manager [req-762e9fd6-7a56-43a3-a836-b6e86bcbf9a6 req-ca195505-f9d2-44e8-982c-e5df984503cf service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-changed-9042d944-67c5-4e39-9232-72ff23c6f1e0 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:35:09 user nova-compute[74996]: DEBUG nova.compute.manager [req-762e9fd6-7a56-43a3-a836-b6e86bcbf9a6 req-ca195505-f9d2-44e8-982c-e5df984503cf service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Refreshing instance network info cache due to event network-changed-9042d944-67c5-4e39-9232-72ff23c6f1e0. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:35:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-762e9fd6-7a56-43a3-a836-b6e86bcbf9a6 req-ca195505-f9d2-44e8-982c-e5df984503cf service nova] Acquiring lock "refresh_cache-adfc9441-d607-4b9f-8008-95e42f1ac51e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:35:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-762e9fd6-7a56-43a3-a836-b6e86bcbf9a6 req-ca195505-f9d2-44e8-982c-e5df984503cf service nova] Acquired lock "refresh_cache-adfc9441-d607-4b9f-8008-95e42f1ac51e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:35:09 user nova-compute[74996]: DEBUG nova.network.neutron [req-762e9fd6-7a56-43a3-a836-b6e86bcbf9a6 req-ca195505-f9d2-44e8-982c-e5df984503cf service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Refreshing network info cache for port 9042d944-67c5-4e39-9232-72ff23c6f1e0 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:35:09 user nova-compute[74996]: DEBUG nova.network.neutron [req-762e9fd6-7a56-43a3-a836-b6e86bcbf9a6 req-ca195505-f9d2-44e8-982c-e5df984503cf service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:35:09 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:35:09 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Cleaning up deleted instances {{(pid=74996) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 01:35:09 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] There are 0 instances to clean {{(pid=74996) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 01:35:09 user nova-compute[74996]: DEBUG nova.network.neutron [req-762e9fd6-7a56-43a3-a836-b6e86bcbf9a6 req-ca195505-f9d2-44e8-982c-e5df984503cf service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:35:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-762e9fd6-7a56-43a3-a836-b6e86bcbf9a6 req-ca195505-f9d2-44e8-982c-e5df984503cf service nova] Releasing lock "refresh_cache-adfc9441-d607-4b9f-8008-95e42f1ac51e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:35:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Acquired lock "refresh_cache-adfc9441-d607-4b9f-8008-95e42f1ac51e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:35:09 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:35:09 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:35:10 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:35:10 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:35:10 user nova-compute[74996]: DEBUG nova.compute.manager [req-572432c8-5c9f-4fdd-a7af-4ec87159b2ff req-34febd94-2aac-44dd-ac31-878641250c58 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-changed-87bf8398-6ede-4465-9555-1000f74e75ff {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:35:10 user nova-compute[74996]: DEBUG nova.compute.manager [req-572432c8-5c9f-4fdd-a7af-4ec87159b2ff req-34febd94-2aac-44dd-ac31-878641250c58 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Refreshing instance network info cache due to event network-changed-87bf8398-6ede-4465-9555-1000f74e75ff. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:35:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-572432c8-5c9f-4fdd-a7af-4ec87159b2ff req-34febd94-2aac-44dd-ac31-878641250c58 service nova] Acquiring lock "refresh_cache-adfc9441-d607-4b9f-8008-95e42f1ac51e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:35:11 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:35:11 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:35:11 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Didn't find any instances for network info cache update. {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 01:35:11 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:35:11 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:35:11 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:35:11 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74996) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 01:35:11 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Updating instance_info_cache with network_info: [{"id": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "address": "fa:16:3e:17:b8:62", "network": {"id": "45d38091-67e6-414b-9989-e308ebdcf57d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1896108595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap863ea8b0-7e", "ovs_interfaceid": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62492819-8da0-4a9f-9f78-facaaa194017", "address": "fa:16:3e:ac:91:39", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62492819-8d", "ovs_interfaceid": "62492819-8da0-4a9f-9f78-facaaa194017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "019034ca-6f89-400f-b47a-61e1157f860f", "address": "fa:16:3e:7f:67:62", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap019034ca-6f", "ovs_interfaceid": "019034ca-6f89-400f-b47a-61e1157f860f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37104018-4ea0-4b2f-b507-8887a4f7348a", "address": "fa:16:3e:8a:b6:d9", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37104018-4e", "ovs_interfaceid": "37104018-4ea0-4b2f-b507-8887a4f7348a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ade5deb-e2db-4310-b1a6-df399639eb00", "address": "fa:16:3e:22:42:a5", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ade5deb-e2", "ovs_interfaceid": "3ade5deb-e2db-4310-b1a6-df399639eb00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9042d944-67c5-4e39-9232-72ff23c6f1e0", "address": "fa:16:3e:05:b8:e8", "network": {"id": "9778b912-7b91-4a57-a5d6-fa3e8fd1016c", "bridge": "br-int", "label": "tempest-device-tagging-net2-519483991", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9042d944-67", "ovs_interfaceid": "9042d944-67c5-4e39-9232-72ff23c6f1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87bf8398-6ede-4465-9555-1000f74e75ff", "address": "fa:16:3e:67:28:a7", "network": {"id": "9778b912-7b91-4a57-a5d6-fa3e8fd1016c", "bridge": "br-int", "label": "tempest-device-tagging-net2-519483991", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87bf8398-6e", "ovs_interfaceid": "87bf8398-6ede-4465-9555-1000f74e75ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:35:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Releasing lock "refresh_cache-adfc9441-d607-4b9f-8008-95e42f1ac51e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:35:11 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Instance network_info: |[{"id": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "address": "fa:16:3e:17:b8:62", "network": {"id": "45d38091-67e6-414b-9989-e308ebdcf57d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1896108595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap863ea8b0-7e", "ovs_interfaceid": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62492819-8da0-4a9f-9f78-facaaa194017", "address": "fa:16:3e:ac:91:39", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62492819-8d", "ovs_interfaceid": "62492819-8da0-4a9f-9f78-facaaa194017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "019034ca-6f89-400f-b47a-61e1157f860f", "address": "fa:16:3e:7f:67:62", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap019034ca-6f", "ovs_interfaceid": "019034ca-6f89-400f-b47a-61e1157f860f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37104018-4ea0-4b2f-b507-8887a4f7348a", "address": "fa:16:3e:8a:b6:d9", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37104018-4e", "ovs_interfaceid": "37104018-4ea0-4b2f-b507-8887a4f7348a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ade5deb-e2db-4310-b1a6-df399639eb00", "address": "fa:16:3e:22:42:a5", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ade5deb-e2", "ovs_interfaceid": "3ade5deb-e2db-4310-b1a6-df399639eb00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9042d944-67c5-4e39-9232-72ff23c6f1e0", "address": "fa:16:3e:05:b8:e8", "network": {"id": "9778b912-7b91-4a57-a5d6-fa3e8fd1016c", "bridge": "br-int", "label": "tempest-device-tagging-net2-519483991", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9042d944-67", "ovs_interfaceid": "9042d944-67c5-4e39-9232-72ff23c6f1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87bf8398-6ede-4465-9555-1000f74e75ff", "address": "fa:16:3e:67:28:a7", "network": {"id": "9778b912-7b91-4a57-a5d6-fa3e8fd1016c", "bridge": "br-int", "label": "tempest-device-tagging-net2-519483991", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87bf8398-6e", "ovs_interfaceid": "87bf8398-6ede-4465-9555-1000f74e75ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:35:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-572432c8-5c9f-4fdd-a7af-4ec87159b2ff req-34febd94-2aac-44dd-ac31-878641250c58 service nova] Acquired lock "refresh_cache-adfc9441-d607-4b9f-8008-95e42f1ac51e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:35:11 user nova-compute[74996]: DEBUG nova.network.neutron [req-572432c8-5c9f-4fdd-a7af-4ec87159b2ff req-34febd94-2aac-44dd-ac31-878641250c58 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Refreshing network info cache for port 87bf8398-6ede-4465-9555-1000f74e75ff {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:35:11 user nova-compute[74996]: DEBUG nova.network.neutron [req-572432c8-5c9f-4fdd-a7af-4ec87159b2ff req-34febd94-2aac-44dd-ac31-878641250c58 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Updated VIF entry in instance network info cache for port 87bf8398-6ede-4465-9555-1000f74e75ff. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:35:11 user nova-compute[74996]: DEBUG nova.network.neutron [req-572432c8-5c9f-4fdd-a7af-4ec87159b2ff req-34febd94-2aac-44dd-ac31-878641250c58 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Updating instance_info_cache with network_info: [{"id": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "address": "fa:16:3e:17:b8:62", "network": {"id": "45d38091-67e6-414b-9989-e308ebdcf57d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1896108595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap863ea8b0-7e", "ovs_interfaceid": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62492819-8da0-4a9f-9f78-facaaa194017", "address": "fa:16:3e:ac:91:39", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62492819-8d", "ovs_interfaceid": "62492819-8da0-4a9f-9f78-facaaa194017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "019034ca-6f89-400f-b47a-61e1157f860f", "address": "fa:16:3e:7f:67:62", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap019034ca-6f", "ovs_interfaceid": "019034ca-6f89-400f-b47a-61e1157f860f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37104018-4ea0-4b2f-b507-8887a4f7348a", "address": "fa:16:3e:8a:b6:d9", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37104018-4e", "ovs_interfaceid": "37104018-4ea0-4b2f-b507-8887a4f7348a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ade5deb-e2db-4310-b1a6-df399639eb00", "address": "fa:16:3e:22:42:a5", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ade5deb-e2", "ovs_interfaceid": "3ade5deb-e2db-4310-b1a6-df399639eb00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9042d944-67c5-4e39-9232-72ff23c6f1e0", "address": "fa:16:3e:05:b8:e8", "network": {"id": "9778b912-7b91-4a57-a5d6-fa3e8fd1016c", "bridge": "br-int", "label": "tempest-device-tagging-net2-519483991", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9042d944-67", "ovs_interfaceid": "9042d944-67c5-4e39-9232-72ff23c6f1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87bf8398-6ede-4465-9555-1000f74e75ff", "address": "fa:16:3e:67:28:a7", "network": {"id": "9778b912-7b91-4a57-a5d6-fa3e8fd1016c", "bridge": "br-int", "label": "tempest-device-tagging-net2-519483991", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87bf8398-6e", "ovs_interfaceid": "87bf8398-6ede-4465-9555-1000f74e75ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:35:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-572432c8-5c9f-4fdd-a7af-4ec87159b2ff req-34febd94-2aac-44dd-ac31-878641250c58 service nova] Releasing lock "refresh_cache-adfc9441-d607-4b9f-8008-95e42f1ac51e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:35:12 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:35:12 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:35:12 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:35:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:12 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:35:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:35:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f81e089-21cf-4132-9f04-a5cf777158d8/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f81e089-21cf-4132-9f04-a5cf777158d8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f81e089-21cf-4132-9f04-a5cf777158d8/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f81e089-21cf-4132-9f04-a5cf777158d8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:15 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:35:15 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:35:15 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=7706MB free_disk=25.29909896850586GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:35:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:15 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Applying migration context for instance c04b39dd-3961-4e23-ad43-34a218f4a472 as it has an incoming, in-progress migration 837180ea-faaf-4ca9-a3de-4fd9b7db0a50. Migration status is finished {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 02 01:35:15 user nova-compute[74996]: INFO nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Updating resource usage from migration 837180ea-faaf-4ca9-a3de-4fd9b7db0a50
Nov 02 01:35:16 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance fea802b7-64d9-4c77-87a7-eaba1dce5c22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7307f3a3-1ad1-43f7-be49-9cd03a626cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 2621c5a2-acff-4055-9746-1b2f5829b39d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 4f81e089-21cf-4132-9f04-a5cf777158d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance fa6400fb-9e90-4f94-9da7-238b91276f41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Migration 837180ea-faaf-4ca9-a3de-4fd9b7db0a50 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance c04b39dd-3961-4e23-ad43-34a218f4a472 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 6b79aa2f-02c7-492e-b27e-7481e41f8d2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance d8f51f7d-c9de-4914-883e-7a875d3d73ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance adfc9441-d607-4b9f-8008-95e42f1ac51e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.673s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMBCqxAQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:35:16 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:35:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:35:16 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:35:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:35:16 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e49a1c-1dca-40e2-8fc6-71b9e812acbe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:35:16 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[284994b6-61e9-4877-9739-f59c574c0fc4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1] added
Nov 02 01:35:16 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[947a2950-201c-4d9e-a881-9f1eecd6b8e3]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28d23a3-c145-4d15-97ef-b02c4a311a7e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jMBCqxAQ {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jMBCqxAQ" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[09022db0-7bef-46d6-9042-56835aea1390]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jMBCqxAQ'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e31131-1fb0-48d8-8a54-1f98b1ec5904]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[809d80c4-ca86-463a-ab15-dc657e4ec0a2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:35:16 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:35:16 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:16 user nova-compute[74996]: WARNING nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] While synchronizing instance power states, found 10 instances in the database and 8 instances on the hypervisor.
Nov 02 01:35:16 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid c04b39dd-3961-4e23-ad43-34a218f4a472 {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid fea802b7-64d9-4c77-87a7-eaba1dce5c22 {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid 7307f3a3-1ad1-43f7-be49-9cd03a626cd7 {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid 2621c5a2-acff-4055-9746-1b2f5829b39d {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid 4f81e089-21cf-4132-9f04-a5cf777158d8 {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid fa6400fb-9e90-4f94-9da7-238b91276f41 {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid 6b79aa2f-02c7-492e-b27e-7481e41f8d2c {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid d8f51f7d-c9de-4914-883e-7a875d3d73ad {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid adfc9441-d607-4b9f-8008-95e42f1ac51e {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "c04b39dd-3961-4e23-ad43-34a218f4a472" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "fea802b7-64d9-4c77-87a7-eaba1dce5c22" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "fea802b7-64d9-4c77-87a7-eaba1dce5c22" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "7307f3a3-1ad1-43f7-be49-9cd03a626cd7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "7307f3a3-1ad1-43f7-be49-9cd03a626cd7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "2621c5a2-acff-4055-9746-1b2f5829b39d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "2621c5a2-acff-4055-9746-1b2f5829b39d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "4f81e089-21cf-4132-9f04-a5cf777158d8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "4f81e089-21cf-4132-9f04-a5cf777158d8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "fa6400fb-9e90-4f94-9da7-238b91276f41" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "6b79aa2f-02c7-492e-b27e-7481e41f8d2c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "6b79aa2f-02c7-492e-b27e-7481e41f8d2c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "d8f51f7d-c9de-4914-883e-7a875d3d73ad" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "d8f51f7d-c9de-4914-883e-7a875d3d73ad" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe2d63c-46eb-40c7-88e0-401369d72047]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1, portal: 172.16.0.220,3260]
Nov 02 01:35:16 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1, portal: 172.16.0.220,3260] successful.
Nov 02 01:35:16 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56b547c-b3ab-4509-84a7-cf32463cb981]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "fea802b7-64d9-4c77-87a7-eaba1dce5c22" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e60d36-d3d3-4861-83a9-16acd5d3782f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:35:16 user nova-compute[74996]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:35:16 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:35:16 user nova-compute[74996]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:35:16 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] HCTL ('34', '-', '-', 0) found on session 11 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "7307f3a3-1ad1-43f7-be49-9cd03a626cd7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "4f81e089-21cf-4132-9f04-a5cf777158d8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "2621c5a2-acff-4055-9746-1b2f5829b39d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.125s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "d8f51f7d-c9de-4914-883e-7a875d3d73ad" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.129s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG nova.compute.manager [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:35:17 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Creating image(s)
Nov 02 01:35:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Did not create local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Ensure instance console log exists: /opt/stack/data/nova/instances/12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Start _get_guest_xml network_info=[{"id": "0881efe5-be2c-456a-abb9-a923b83c0f3e", "address": "fa:16:3e:97:b6:d5", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0881efe5-be", "ovs_interfaceid": "0881efe5-be2c-456a-abb9-a923b83c0f3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4347b3ea-e108-42b6-ae93-89b6ab265fd2', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TtQvKSOi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a', 'attached_at': '', 'detached_at': '', 'volume_id': 'fe5410d6-f096-4581-aec0-48a7fd8bab01', 'serial': 'fe5410d6-f096-4581-aec0-48a7fd8bab01'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d031bc-321f-4822-a7bc-2840b523a963]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Searching for a device in session 11 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMBCqxAQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "6b79aa2f-02c7-492e-b27e-7481e41f8d2c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.152s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:17 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:35:17 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:35:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TtQvKSOi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:35:17 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:35:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:35:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '26266303462636534', 'path': '/dev/sdc'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266303462636534', 'path': '/dev/sdc'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.898s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:35:18 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:35:18 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:35:18 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG nova.objects.instance [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lazy-loading 'flavor' on Instance uuid fa6400fb-9e90-4f94-9da7-238b91276f41 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3431ac8-b0d1-40a7-844c-c7f49db53c0e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:35:18 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 01:35:18 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:35:18 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 01:35:18 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:35:18 user nova-compute[74996]:   <serial>a249585d-899f-41ad-ab90-28d47b08fcf1</serial>
Nov 02 01:35:18 user nova-compute[74996]: </disk>
Nov 02 01:35:18 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a6fbe1-4bf5-496f-974b-972802c3a2b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01] added
Nov 02 01:35:18 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dff30f-0fce-45ca-8aad-514ec6f027ab]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[68746553-d6d6-4520-853e-e98a8678e901]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TtQvKSOi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TtQvKSOi" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4c3c37-3862-4166-964f-eac7969d44df]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TtQvKSOi'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1310f0-6199-4e5f-b788-049d164fe6de]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8e5db1-b2c2-4a64-a84e-c161b3437425]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:35:18 user nova-compute[74996]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:35:18 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:35:18 user nova-compute[74996]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:35:18 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e681ae15-9af0-41de-8ba2-f1dc6b6550c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01, portal: 172.16.0.220,3260]
Nov 02 01:35:18 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01, portal: 172.16.0.220,3260] successful.
Nov 02 01:35:18 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86a84e9-5e1c-4465-ac68-c76c5345c3cf]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d91f898-4edc-4286-b167-632e86d17c60]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:35:18 user nova-compute[74996]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:35:18 user nova-compute[74996]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:35:18 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:35:18 user nova-compute[74996]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:35:18 user nova-compute[74996]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:35:18 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] HCTL ('35', '-', '-', 0) found on session 12 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd31574-f93d-42ca-8195-b11399cf144f]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Searching for a device in session 12 and hctl ['35', '*', '*', 0] yield: None {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] No VIF found with MAC fa:16:3e:8e:48:16, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bb6e5f92-cccd-4c72-a86e-b8416feb1723 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.348s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.811s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:19 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Searching for a device in session 12 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:35:19 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TtQvKSOi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:35:19 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:35:19 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] <== connect_volume: return (2219ms) {'type': 'block', 'scsi_wwn': '23939326465366661', 'path': '/dev/sdd'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:35:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939326465366661', 'path': '/dev/sdd'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:35:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:34:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-65913740',display_name='tempest-TestVolumeBootPattern-server-65913740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-65913740',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31965b482eb243a69112a49bf1302779',ramdisk_id='',reservation_id='r-24v14wun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-216720976',owner_user_name='tempest-TestVolumeBootPattern-216720976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:34:16Z,user_data=None,user_id='be6bf504c3a649898e8c83399f6fee8e',uuid=12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0881efe5-be2c-456a-abb9-a923b83c0f3e", "address": "fa:16:3e:97:b6:d5", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0881efe5-be", "ovs_interfaceid": "0881efe5-be2c-456a-abb9-a923b83c0f3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:35:19 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converting VIF {"id": "0881efe5-be2c-456a-abb9-a923b83c0f3e", "address": "fa:16:3e:97:b6:d5", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0881efe5-be", "ovs_interfaceid": "0881efe5-be2c-456a-abb9-a923b83c0f3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:35:19 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:b6:d5,bridge_name='br-int',has_traffic_filtering=True,id=0881efe5-be2c-456a-abb9-a923b83c0f3e,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0881efe5-be') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:35:19 user nova-compute[74996]: DEBUG nova.objects.instance [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lazy-loading 'pci_devices' on Instance uuid 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:35:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:35:19 user nova-compute[74996]:   <uuid>12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a</uuid>
Nov 02 01:35:19 user nova-compute[74996]:   <name>instance-0000000e</name>
Nov 02 01:35:19 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:35:19 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:35:19 user nova-compute[74996]:   <metadata>
Nov 02 01:35:19 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:35:19 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:35:19 user nova-compute[74996]:       <nova:name>tempest-TestVolumeBootPattern-server-65913740</nova:name>
Nov 02 01:35:19 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:35:17</nova:creationTime>
Nov 02 01:35:19 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:35:19 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:35:19 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:35:19 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:35:19 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:35:19 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:35:19 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:35:19 user nova-compute[74996]:       <nova:owner>
Nov 02 01:35:19 user nova-compute[74996]:         <nova:user uuid="be6bf504c3a649898e8c83399f6fee8e">tempest-TestVolumeBootPattern-216720976-project-member</nova:user>
Nov 02 01:35:19 user nova-compute[74996]:         <nova:project uuid="31965b482eb243a69112a49bf1302779">tempest-TestVolumeBootPattern-216720976</nova:project>
Nov 02 01:35:19 user nova-compute[74996]:       </nova:owner>
Nov 02 01:35:19 user nova-compute[74996]:       <nova:ports>
Nov 02 01:35:19 user nova-compute[74996]:         <nova:port uuid="0881efe5-be2c-456a-abb9-a923b83c0f3e">
Nov 02 01:35:19 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 02 01:35:19 user nova-compute[74996]:         </nova:port>
Nov 02 01:35:19 user nova-compute[74996]:       </nova:ports>
Nov 02 01:35:19 user nova-compute[74996]:     </nova:instance>
Nov 02 01:35:19 user nova-compute[74996]:   </metadata>
Nov 02 01:35:19 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:35:19 user nova-compute[74996]:     <system>
Nov 02 01:35:19 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:35:19 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:35:19 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:35:19 user nova-compute[74996]:       <entry name="serial">12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a</entry>
Nov 02 01:35:19 user nova-compute[74996]:       <entry name="uuid">12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a</entry>
Nov 02 01:35:19 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:35:19 user nova-compute[74996]:     </system>
Nov 02 01:35:19 user nova-compute[74996]:   </sysinfo>
Nov 02 01:35:19 user nova-compute[74996]:   <os>
Nov 02 01:35:19 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:35:19 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:35:19 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:35:19 user nova-compute[74996]:   </os>
Nov 02 01:35:19 user nova-compute[74996]:   <features>
Nov 02 01:35:19 user nova-compute[74996]:     <acpi/>
Nov 02 01:35:19 user nova-compute[74996]:     <apic/>
Nov 02 01:35:19 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:35:19 user nova-compute[74996]:   </features>
Nov 02 01:35:19 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:35:19 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:35:19 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:35:19 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:35:19 user nova-compute[74996]:   </clock>
Nov 02 01:35:19 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:35:19 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:35:19 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:35:19 user nova-compute[74996]:   </cpu>
Nov 02 01:35:19 user nova-compute[74996]:   <devices>
Nov 02 01:35:19 user nova-compute[74996]:     <disk type="block" device="disk">
Nov 02 01:35:19 user nova-compute[74996]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:35:19 user nova-compute[74996]:       <source dev="/dev/sdd"/>
Nov 02 01:35:19 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:35:19 user nova-compute[74996]:       <serial>fe5410d6-f096-4581-aec0-48a7fd8bab01</serial>
Nov 02 01:35:19 user nova-compute[74996]:     </disk>
Nov 02 01:35:19 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:35:19 user nova-compute[74996]:       <mac address="fa:16:3e:97:b6:d5"/>
Nov 02 01:35:19 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:35:19 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:35:19 user nova-compute[74996]:       <target dev="tap0881efe5-be"/>
Nov 02 01:35:19 user nova-compute[74996]:     </interface>
Nov 02 01:35:19 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:35:19 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a/console.log" append="off"/>
Nov 02 01:35:19 user nova-compute[74996]:     </serial>
Nov 02 01:35:19 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:35:19 user nova-compute[74996]:     <video>
Nov 02 01:35:19 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:35:19 user nova-compute[74996]:     </video>
Nov 02 01:35:19 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:35:19 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:35:19 user nova-compute[74996]:     </rng>
Nov 02 01:35:19 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:35:19 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:35:19 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:35:19 user nova-compute[74996]:     </memballoon>
Nov 02 01:35:19 user nova-compute[74996]:   </devices>
Nov 02 01:35:19 user nova-compute[74996]: </domain>
Nov 02 01:35:19 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:35:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:34:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-65913740',display_name='tempest-TestVolumeBootPattern-server-65913740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-65913740',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31965b482eb243a69112a49bf1302779',ramdisk_id='',reservation_id='r-24v14wun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-216720976',owner_user_name='tempest-TestVolumeBootPattern-216720976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:34:16Z,user_data=None,user_id='be6bf504c3a649898e8c83399f6fee8e',uuid=12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0881efe5-be2c-456a-abb9-a923b83c0f3e", "address": "fa:16:3e:97:b6:d5", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0881efe5-be", "ovs_interfaceid": "0881efe5-be2c-456a-abb9-a923b83c0f3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:35:19 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converting VIF {"id": "0881efe5-be2c-456a-abb9-a923b83c0f3e", "address": "fa:16:3e:97:b6:d5", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0881efe5-be", "ovs_interfaceid": "0881efe5-be2c-456a-abb9-a923b83c0f3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:35:19 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:b6:d5,bridge_name='br-int',has_traffic_filtering=True,id=0881efe5-be2c-456a-abb9-a923b83c0f3e,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0881efe5-be') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:35:19 user nova-compute[74996]: DEBUG os_vif [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:b6:d5,bridge_name='br-int',has_traffic_filtering=True,id=0881efe5-be2c-456a-abb9-a923b83c0f3e,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0881efe5-be') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:35:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:35:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:35:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ac3b85e-7d95-52fd-9ed7-e45a9d064fe0', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:35:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:35:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0881efe5-be, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:35:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0881efe5-be, col_values=(('qos', UUID('d18196cd-e1df-481f-a65c-6526fb7158dd')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:35:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0881efe5-be, col_values=(('external_ids', {'iface-id': '0881efe5-be2c-456a-abb9-a923b83c0f3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:b6:d5', 'vm-uuid': '12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:35:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:35:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:19 user nova-compute[74996]: INFO os_vif [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:b6:d5,bridge_name='br-int',has_traffic_filtering=True,id=0881efe5-be2c-456a-abb9-a923b83c0f3e,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0881efe5-be')
Nov 02 01:35:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:35:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] No VIF found with MAC fa:16:3e:97:b6:d5, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:35:19 user nova-compute[74996]: INFO nova.compute.manager [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Rebuilding instance
Nov 02 01:35:19 user nova-compute[74996]: DEBUG nova.compute.manager [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:35:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:20 user nova-compute[74996]: DEBUG nova.compute.manager [req-229dc12b-fe22-4830-8bff-c1a4846ed488 req-96adefb6-e432-43b2-a687-a46961bb6651 service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Received event network-vif-unplugged-7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:35:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-229dc12b-fe22-4830-8bff-c1a4846ed488 req-96adefb6-e432-43b2-a687-a46961bb6651 service nova] Acquiring lock "fa6400fb-9e90-4f94-9da7-238b91276f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-229dc12b-fe22-4830-8bff-c1a4846ed488 req-96adefb6-e432-43b2-a687-a46961bb6651 service nova] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-229dc12b-fe22-4830-8bff-c1a4846ed488 req-96adefb6-e432-43b2-a687-a46961bb6651 service nova] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:20 user nova-compute[74996]: DEBUG nova.compute.manager [req-229dc12b-fe22-4830-8bff-c1a4846ed488 req-96adefb6-e432-43b2-a687-a46961bb6651 service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] No waiting events found dispatching network-vif-unplugged-7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:35:20 user nova-compute[74996]: WARNING nova.compute.manager [req-229dc12b-fe22-4830-8bff-c1a4846ed488 req-96adefb6-e432-43b2-a687-a46961bb6651 service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Received unexpected event network-vif-unplugged-7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e for instance with vm_state active and task_state rebuilding.
Nov 02 01:35:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:21 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Instance destroyed successfully.
Nov 02 01:35:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:21 user nova-compute[74996]: INFO nova.virt.block_device [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Booting with volume 1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 at /dev/vdb
Nov 02 01:35:21 user nova-compute[74996]: INFO nova.compute.manager [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Detaching volume a249585d-899f-41ad-ab90-28d47b08fcf1
Nov 02 01:35:21 user nova-compute[74996]: INFO nova.virt.block_device [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Attempting to driver detach volume a249585d-899f-41ad-ab90-28d47b08fcf1 from mountpoint /dev/vdb
Nov 02 01:35:21 user nova-compute[74996]: DEBUG os_brick.utils [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Attempting to detach device vdb from instance fa6400fb-9e90-4f94-9da7-238b91276f41 from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 01:35:21 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:35:21 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 01:35:21 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:35:21 user nova-compute[74996]:   <serial>a249585d-899f-41ad-ab90-28d47b08fcf1</serial>
Nov 02 01:35:21 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 01:35:21 user nova-compute[74996]: </disk>
Nov 02 01:35:21 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e1093a-8fa9-424a-8cb8-4b469446a4b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG nova.compute.manager [req-40d4244c-e894-4961-9c4e-8ad167b361f4 req-5c58c237-281b-4d3c-b3dd-e13acf8da5ac service nova] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Received event network-vif-plugged-0881efe5-be2c-456a-abb9-a923b83c0f3e {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-40d4244c-e894-4961-9c4e-8ad167b361f4 req-5c58c237-281b-4d3c-b3dd-e13acf8da5ac service nova] Acquiring lock "12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-40d4244c-e894-4961-9c4e-8ad167b361f4 req-5c58c237-281b-4d3c-b3dd-e13acf8da5ac service nova] Lock "12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-40d4244c-e894-4961-9c4e-8ad167b361f4 req-5c58c237-281b-4d3c-b3dd-e13acf8da5ac service nova] Lock "12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG nova.compute.manager [req-40d4244c-e894-4961-9c4e-8ad167b361f4 req-5c58c237-281b-4d3c-b3dd-e13acf8da5ac service nova] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] No waiting events found dispatching network-vif-plugged-0881efe5-be2c-456a-abb9-a923b83c0f3e {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:35:21 user nova-compute[74996]: WARNING nova.compute.manager [req-40d4244c-e894-4961-9c4e-8ad167b361f4 req-5c58c237-281b-4d3c-b3dd-e13acf8da5ac service nova] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Received unexpected event network-vif-plugged-0881efe5-be2c-456a-abb9-a923b83c0f3e for instance with vm_state building and task_state spawning.
Nov 02 01:35:21 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Successfully detached device vdb from instance fa6400fb-9e90-4f94-9da7-238b91276f41 from the persistent domain config.
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d94acf7-9c04-4921-a97e-4406b78d556d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMBCqxAQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:35:21 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 01:35:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[46013a67-d737-4f06-a47a-dcf0ed9e07f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7c271f-f600-4238-a600-e38eb190c683]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b773a55-12e4-48de-956e-19c9823c9744]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:35:21 user nova-compute[74996]: No targets found.
Nov 02 01:35:21 user nova-compute[74996]: iSNS:
Nov 02 01:35:21 user nova-compute[74996]: No targets found.
Nov 02 01:35:21 user nova-compute[74996]: STATIC:
Nov 02 01:35:21 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1
Nov 02 01:35:21 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:35:21 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:35:21 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01
Nov 02 01:35:21 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:35:21 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:35:21 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84
Nov 02 01:35:21 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:35:21 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:35:21 user nova-compute[74996]: FIRMWARE:
Nov 02 01:35:21 user nova-compute[74996]: No targets found.
Nov 02 01:35:21 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:35:21 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:35:21 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:35:21 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[01307f28-3f05-4c59-8ac3-24b5b92f48e0]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG os_brick.utils [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Updating existing volume attachment record: 075b5c3d-d0f6-4808-b165-2beb7a25bab9 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f623eb-d5b5-4c1d-a3af-3226140f2257]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce7c75b-b19e-4377-89d6-fdca1ee9edb7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:35:21 user nova-compute[74996]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:35:21 user nova-compute[74996]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:35:21 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:35:21 user nova-compute[74996]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:35:21 user nova-compute[74996]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:35:21 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f831de276d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1'): ({'sdc'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Removing single pathed devices sdc {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[593a982e-bacd-4e05-b901-69ab0218e9bf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a43d0f4-a374-47b3-b81c-76458ede92f3]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Flushing IO for device /dev/sdc {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[255f9e63-3761-4b2b-836d-f5322ac776b9]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e9eb19-dadf-4ba2-aab3-ed2a27f658e2]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6fd7bc-f674-4967-810b-a98bdba4b310]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[751a44f4-020c-498e-8803-e735ae93699b]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1, portal: 172.16.0.220,3260]
Nov 02 01:35:21 user nova-compute[74996]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1, portal: 172.16.0.220,3260] successful.
Nov 02 01:35:21 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17fb1b9-2d0c-4d6a-a577-a0dc032367d8]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] <== disconnect_volume: return (418ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:35:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:35:22 user nova-compute[74996]: DEBUG nova.compute.manager [req-00715549-168d-4417-8a91-d4593ac3a691 req-81a85af1-c72f-497c-b4fe-61c71474b429 service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Received event network-vif-plugged-7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:35:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-00715549-168d-4417-8a91-d4593ac3a691 req-81a85af1-c72f-497c-b4fe-61c71474b429 service nova] Acquiring lock "fa6400fb-9e90-4f94-9da7-238b91276f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-00715549-168d-4417-8a91-d4593ac3a691 req-81a85af1-c72f-497c-b4fe-61c71474b429 service nova] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-00715549-168d-4417-8a91-d4593ac3a691 req-81a85af1-c72f-497c-b4fe-61c71474b429 service nova] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:22 user nova-compute[74996]: DEBUG nova.compute.manager [req-00715549-168d-4417-8a91-d4593ac3a691 req-81a85af1-c72f-497c-b4fe-61c71474b429 service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] No waiting events found dispatching network-vif-plugged-7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:35:22 user nova-compute[74996]: WARNING nova.compute.manager [req-00715549-168d-4417-8a91-d4593ac3a691 req-81a85af1-c72f-497c-b4fe-61c71474b429 service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Received unexpected event network-vif-plugged-7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e for instance with vm_state active and task_state rebuilding.
Nov 02 01:35:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:23 user nova-compute[74996]: DEBUG nova.compute.manager [req-865884e6-440a-471a-bdff-d286507467c2 req-b237d6f4-29fc-4f0e-906c-ae6c617fcf9c service nova] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Received event network-vif-plugged-0881efe5-be2c-456a-abb9-a923b83c0f3e {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:35:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-865884e6-440a-471a-bdff-d286507467c2 req-b237d6f4-29fc-4f0e-906c-ae6c617fcf9c service nova] Acquiring lock "12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-865884e6-440a-471a-bdff-d286507467c2 req-b237d6f4-29fc-4f0e-906c-ae6c617fcf9c service nova] Lock "12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-865884e6-440a-471a-bdff-d286507467c2 req-b237d6f4-29fc-4f0e-906c-ae6c617fcf9c service nova] Lock "12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:23 user nova-compute[74996]: DEBUG nova.compute.manager [req-865884e6-440a-471a-bdff-d286507467c2 req-b237d6f4-29fc-4f0e-906c-ae6c617fcf9c service nova] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] No waiting events found dispatching network-vif-plugged-0881efe5-be2c-456a-abb9-a923b83c0f3e {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:35:23 user nova-compute[74996]: WARNING nova.compute.manager [req-865884e6-440a-471a-bdff-d286507467c2 req-b237d6f4-29fc-4f0e-906c-ae6c617fcf9c service nova] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Received unexpected event network-vif-plugged-0881efe5-be2c-456a-abb9-a923b83c0f3e for instance with vm_state building and task_state spawning.
Nov 02 01:35:23 user nova-compute[74996]: DEBUG nova.compute.manager [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:35:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:35:23 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Instance spawned successfully.
Nov 02 01:35:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:35:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:35:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:35:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:35:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:35:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:35:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:35:23 user nova-compute[74996]: INFO nova.compute.manager [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Took 6.93 seconds to spawn the instance on the hypervisor.
Nov 02 01:35:23 user nova-compute[74996]: DEBUG nova.compute.manager [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:35:24 user nova-compute[74996]: INFO nova.compute.manager [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Took 69.20 seconds to build instance.
Nov 02 01:35:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3a7b2a43-70dd-495b-9f70-7c4467f86ce0 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 69.310s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.195s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:24 user nova-compute[74996]: INFO nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 02 01:35:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Acquiring lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:26 user nova-compute[74996]: DEBUG nova.compute.manager [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:35:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:35:26 user nova-compute[74996]: INFO nova.compute.claims [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Claim successful on node user
Nov 02 01:35:26 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Refreshing inventories for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 01:35:27 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Updating ProviderTree inventory for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 01:35:27 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Updating inventory in ProviderTree for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 01:35:27 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Refreshing aggregate associations for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259, aggregates: None {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 01:35:27 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Refreshing trait associations for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 01:35:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:27 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:35:27 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:35:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.906s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:27 user nova-compute[74996]: DEBUG nova.compute.manager [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:35:27 user nova-compute[74996]: DEBUG nova.compute.manager [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:35:27 user nova-compute[74996]: DEBUG nova.network.neutron [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:35:27 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:35:27 user nova-compute[74996]: DEBUG nova.compute.manager [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:35:27 user nova-compute[74996]: DEBUG nova.policy [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1bb72dff3f614017b0ddc032ac15cd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981230c517e493883bb048b1cfa7907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:35:28 user nova-compute[74996]: DEBUG nova.compute.manager [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:35:28 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:35:28 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Creating image(s)
Nov 02 01:35:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Acquiring lock "/opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "/opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "/opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.211s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.223s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk 1073741824" returned: 0 in 0.063s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:28 user nova-compute[74996]: DEBUG nova.network.neutron [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Successfully created port: fbf546f3-964c-4816-84c1-20d11b5ed544 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:35:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.257s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:28 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:35:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:29 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Cannot resize image /opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:35:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:35:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Ensure instance console log exists: /opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:35:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:29 user nova-compute[74996]: DEBUG nova.network.neutron [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Successfully updated port: fbf546f3-964c-4816-84c1-20d11b5ed544 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:35:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Acquiring lock "refresh_cache-f44d0b13-9dae-40c9-83d0-0b84699b1cc2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:35:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Acquired lock "refresh_cache-f44d0b13-9dae-40c9-83d0-0b84699b1cc2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:35:29 user nova-compute[74996]: DEBUG nova.network.neutron [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:35:29 user nova-compute[74996]: DEBUG nova.compute.manager [req-7e224595-bc4f-4303-9d11-bcf4d1fc8f22 req-afe91148-9fe8-4ca6-bf21-bb49f9ce9fc4 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Received event network-changed-fbf546f3-964c-4816-84c1-20d11b5ed544 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:35:29 user nova-compute[74996]: DEBUG nova.compute.manager [req-7e224595-bc4f-4303-9d11-bcf4d1fc8f22 req-afe91148-9fe8-4ca6-bf21-bb49f9ce9fc4 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Refreshing instance network info cache due to event network-changed-fbf546f3-964c-4816-84c1-20d11b5ed544. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:35:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7e224595-bc4f-4303-9d11-bcf4d1fc8f22 req-afe91148-9fe8-4ca6-bf21-bb49f9ce9fc4 service nova] Acquiring lock "refresh_cache-f44d0b13-9dae-40c9-83d0-0b84699b1cc2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:35:29 user nova-compute[74996]: DEBUG nova.network.neutron [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.network.neutron [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Updating instance_info_cache with network_info: [{"id": "fbf546f3-964c-4816-84c1-20d11b5ed544", "address": "fa:16:3e:e1:e1:a7", "network": {"id": "2cb390f5-5458-4e64-bf80-887d5f41bdf8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1475294747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7981230c517e493883bb048b1cfa7907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf546f3-96", "ovs_interfaceid": "fbf546f3-964c-4816-84c1-20d11b5ed544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Releasing lock "refresh_cache-f44d0b13-9dae-40c9-83d0-0b84699b1cc2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.compute.manager [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Instance network_info: |[{"id": "fbf546f3-964c-4816-84c1-20d11b5ed544", "address": "fa:16:3e:e1:e1:a7", "network": {"id": "2cb390f5-5458-4e64-bf80-887d5f41bdf8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1475294747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7981230c517e493883bb048b1cfa7907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf546f3-96", "ovs_interfaceid": "fbf546f3-964c-4816-84c1-20d11b5ed544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7e224595-bc4f-4303-9d11-bcf4d1fc8f22 req-afe91148-9fe8-4ca6-bf21-bb49f9ce9fc4 service nova] Acquired lock "refresh_cache-f44d0b13-9dae-40c9-83d0-0b84699b1cc2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.network.neutron [req-7e224595-bc4f-4303-9d11-bcf4d1fc8f22 req-afe91148-9fe8-4ca6-bf21-bb49f9ce9fc4 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Refreshing network info cache for port fbf546f3-964c-4816-84c1-20d11b5ed544 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Start _get_guest_xml network_info=[{"id": "fbf546f3-964c-4816-84c1-20d11b5ed544", "address": "fa:16:3e:e1:e1:a7", "network": {"id": "2cb390f5-5458-4e64-bf80-887d5f41bdf8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1475294747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7981230c517e493883bb048b1cfa7907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf546f3-96", "ovs_interfaceid": "fbf546f3-964c-4816-84c1-20d11b5ed544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:35:30 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:35:30 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111239639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111239639',id=17,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLtwBp/DvHskyQXeHr37ezG4yqg/zTU4wDpo1xGzexMimgVBKyE7nsHF9zbcCIyqHw1sf3kCFQioLSlFRREV/mNyOI03M7/LCcKSZAW08/rLH78veAeoRHPxfQDNyUQqA==',key_name='tempest-keypair-876877355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7981230c517e493883bb048b1cfa7907',ramdisk_id='',reservation_id='r-ccrouw9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-722286534',owner_user_name='tempest-TaggedAttachmentsTest-722286534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:35:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bb72dff3f614017b0ddc032ac15cd7b',uuid=f44d0b13-9dae-40c9-83d0-0b84699b1cc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbf546f3-964c-4816-84c1-20d11b5ed544", "address": "fa:16:3e:e1:e1:a7", "network": {"id": "2cb390f5-5458-4e64-bf80-887d5f41bdf8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1475294747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7981230c517e493883bb048b1cfa7907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf546f3-96", "ovs_interfaceid": "fbf546f3-964c-4816-84c1-20d11b5ed544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Converting VIF {"id": "fbf546f3-964c-4816-84c1-20d11b5ed544", "address": "fa:16:3e:e1:e1:a7", "network": {"id": "2cb390f5-5458-4e64-bf80-887d5f41bdf8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1475294747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7981230c517e493883bb048b1cfa7907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf546f3-96", "ovs_interfaceid": "fbf546f3-964c-4816-84c1-20d11b5ed544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:e1:a7,bridge_name='br-int',has_traffic_filtering=True,id=fbf546f3-964c-4816-84c1-20d11b5ed544,network=Network(2cb390f5-5458-4e64-bf80-887d5f41bdf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbf546f3-96') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.objects.instance [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lazy-loading 'pci_devices' on Instance uuid f44d0b13-9dae-40c9-83d0-0b84699b1cc2 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:35:30 user nova-compute[74996]:   <uuid>f44d0b13-9dae-40c9-83d0-0b84699b1cc2</uuid>
Nov 02 01:35:30 user nova-compute[74996]:   <name>instance-00000011</name>
Nov 02 01:35:30 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:35:30 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:35:30 user nova-compute[74996]:   <metadata>
Nov 02 01:35:30 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:35:30 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:35:30 user nova-compute[74996]:       <nova:name>tempest-device-tagging-server-2111239639</nova:name>
Nov 02 01:35:30 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:35:30</nova:creationTime>
Nov 02 01:35:30 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:35:30 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:35:30 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:35:30 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:35:30 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:35:30 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:35:30 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:35:30 user nova-compute[74996]:       <nova:owner>
Nov 02 01:35:30 user nova-compute[74996]:         <nova:user uuid="1bb72dff3f614017b0ddc032ac15cd7b">tempest-TaggedAttachmentsTest-722286534-project-member</nova:user>
Nov 02 01:35:30 user nova-compute[74996]:         <nova:project uuid="7981230c517e493883bb048b1cfa7907">tempest-TaggedAttachmentsTest-722286534</nova:project>
Nov 02 01:35:30 user nova-compute[74996]:       </nova:owner>
Nov 02 01:35:30 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:35:30 user nova-compute[74996]:       <nova:ports>
Nov 02 01:35:30 user nova-compute[74996]:         <nova:port uuid="fbf546f3-964c-4816-84c1-20d11b5ed544">
Nov 02 01:35:30 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 01:35:30 user nova-compute[74996]:         </nova:port>
Nov 02 01:35:30 user nova-compute[74996]:       </nova:ports>
Nov 02 01:35:30 user nova-compute[74996]:     </nova:instance>
Nov 02 01:35:30 user nova-compute[74996]:   </metadata>
Nov 02 01:35:30 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:35:30 user nova-compute[74996]:     <system>
Nov 02 01:35:30 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:35:30 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:35:30 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:35:30 user nova-compute[74996]:       <entry name="serial">f44d0b13-9dae-40c9-83d0-0b84699b1cc2</entry>
Nov 02 01:35:30 user nova-compute[74996]:       <entry name="uuid">f44d0b13-9dae-40c9-83d0-0b84699b1cc2</entry>
Nov 02 01:35:30 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:35:30 user nova-compute[74996]:     </system>
Nov 02 01:35:30 user nova-compute[74996]:   </sysinfo>
Nov 02 01:35:30 user nova-compute[74996]:   <os>
Nov 02 01:35:30 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:35:30 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:35:30 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:35:30 user nova-compute[74996]:   </os>
Nov 02 01:35:30 user nova-compute[74996]:   <features>
Nov 02 01:35:30 user nova-compute[74996]:     <acpi/>
Nov 02 01:35:30 user nova-compute[74996]:     <apic/>
Nov 02 01:35:30 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:35:30 user nova-compute[74996]:   </features>
Nov 02 01:35:30 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:35:30 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:35:30 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:35:30 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:35:30 user nova-compute[74996]:   </clock>
Nov 02 01:35:30 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:35:30 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:35:30 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:35:30 user nova-compute[74996]:   </cpu>
Nov 02 01:35:30 user nova-compute[74996]:   <devices>
Nov 02 01:35:30 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:35:30 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:35:30 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk"/>
Nov 02 01:35:30 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:35:30 user nova-compute[74996]:     </disk>
Nov 02 01:35:30 user nova-compute[74996]:     <disk type="file" device="cdrom">
Nov 02 01:35:30 user nova-compute[74996]:       <driver name="qemu" type="raw" cache="none"/>
Nov 02 01:35:30 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk.config"/>
Nov 02 01:35:30 user nova-compute[74996]:       <target dev="hda" bus="ide"/>
Nov 02 01:35:30 user nova-compute[74996]:     </disk>
Nov 02 01:35:30 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:35:30 user nova-compute[74996]:       <mac address="fa:16:3e:e1:e1:a7"/>
Nov 02 01:35:30 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:35:30 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:35:30 user nova-compute[74996]:       <target dev="tapfbf546f3-96"/>
Nov 02 01:35:30 user nova-compute[74996]:     </interface>
Nov 02 01:35:30 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:35:30 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/console.log" append="off"/>
Nov 02 01:35:30 user nova-compute[74996]:     </serial>
Nov 02 01:35:30 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:35:30 user nova-compute[74996]:     <video>
Nov 02 01:35:30 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:35:30 user nova-compute[74996]:     </video>
Nov 02 01:35:30 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:35:30 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:35:30 user nova-compute[74996]:     </rng>
Nov 02 01:35:30 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:35:30 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:35:30 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:35:30 user nova-compute[74996]:     </memballoon>
Nov 02 01:35:30 user nova-compute[74996]:   </devices>
Nov 02 01:35:30 user nova-compute[74996]: </domain>
Nov 02 01:35:30 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111239639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111239639',id=17,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLtwBp/DvHskyQXeHr37ezG4yqg/zTU4wDpo1xGzexMimgVBKyE7nsHF9zbcCIyqHw1sf3kCFQioLSlFRREV/mNyOI03M7/LCcKSZAW08/rLH78veAeoRHPxfQDNyUQqA==',key_name='tempest-keypair-876877355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7981230c517e493883bb048b1cfa7907',ramdisk_id='',reservation_id='r-ccrouw9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-722286534',owner_user_name='tempest-TaggedAttachmentsTest-722286534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:35:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bb72dff3f614017b0ddc032ac15cd7b',uuid=f44d0b13-9dae-40c9-83d0-0b84699b1cc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbf546f3-964c-4816-84c1-20d11b5ed544", "address": "fa:16:3e:e1:e1:a7", "network": {"id": "2cb390f5-5458-4e64-bf80-887d5f41bdf8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1475294747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7981230c517e493883bb048b1cfa7907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf546f3-96", "ovs_interfaceid": "fbf546f3-964c-4816-84c1-20d11b5ed544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Converting VIF {"id": "fbf546f3-964c-4816-84c1-20d11b5ed544", "address": "fa:16:3e:e1:e1:a7", "network": {"id": "2cb390f5-5458-4e64-bf80-887d5f41bdf8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1475294747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7981230c517e493883bb048b1cfa7907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf546f3-96", "ovs_interfaceid": "fbf546f3-964c-4816-84c1-20d11b5ed544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:e1:a7,bridge_name='br-int',has_traffic_filtering=True,id=fbf546f3-964c-4816-84c1-20d11b5ed544,network=Network(2cb390f5-5458-4e64-bf80-887d5f41bdf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbf546f3-96') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG os_vif [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:e1:a7,bridge_name='br-int',has_traffic_filtering=True,id=fbf546f3-964c-4816-84c1-20d11b5ed544,network=Network(2cb390f5-5458-4e64-bf80-887d5f41bdf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbf546f3-96') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5dda062d-6c77-5aa9-baaf-674767600a51', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbf546f3-96, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfbf546f3-96, col_values=(('qos', UUID('3b4ac355-e4f0-4844-8ac1-c6995009201d')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfbf546f3-96, col_values=(('external_ids', {'iface-id': 'fbf546f3-964c-4816-84c1-20d11b5ed544', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:e1:a7', 'vm-uuid': 'f44d0b13-9dae-40c9-83d0-0b84699b1cc2'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:30 user nova-compute[74996]: INFO os_vif [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:e1:a7,bridge_name='br-int',has_traffic_filtering=True,id=fbf546f3-964c-4816-84c1-20d11b5ed544,network=Network(2cb390f5-5458-4e64-bf80-887d5f41bdf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbf546f3-96')
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] No BDM found with device name hda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] No VIF found with MAC fa:16:3e:e1:e1:a7, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:35:30 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Using config drive
Nov 02 01:35:30 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Creating config drive at /opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk.config
Nov 02 01:35:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpghjqd9kc {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.network.neutron [req-7e224595-bc4f-4303-9d11-bcf4d1fc8f22 req-afe91148-9fe8-4ca6-bf21-bb49f9ce9fc4 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Updated VIF entry in instance network info cache for port fbf546f3-964c-4816-84c1-20d11b5ed544. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG nova.network.neutron [req-7e224595-bc4f-4303-9d11-bcf4d1fc8f22 req-afe91148-9fe8-4ca6-bf21-bb49f9ce9fc4 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Updating instance_info_cache with network_info: [{"id": "fbf546f3-964c-4816-84c1-20d11b5ed544", "address": "fa:16:3e:e1:e1:a7", "network": {"id": "2cb390f5-5458-4e64-bf80-887d5f41bdf8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1475294747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7981230c517e493883bb048b1cfa7907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf546f3-96", "ovs_interfaceid": "fbf546f3-964c-4816-84c1-20d11b5ed544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpghjqd9kc" returned: 0 in 0.069s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7e224595-bc4f-4303-9d11-bcf4d1fc8f22 req-afe91148-9fe8-4ca6-bf21-bb49f9ce9fc4 service nova] Releasing lock "refresh_cache-f44d0b13-9dae-40c9-83d0-0b84699b1cc2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:35:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:32 user nova-compute[74996]: DEBUG nova.compute.manager [req-a5f4d126-6aa9-469d-bdf2-1efcfedca782 req-2a8cd71e-1503-44a8-9df7-837ac8f611dd service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Received event network-vif-plugged-fbf546f3-964c-4816-84c1-20d11b5ed544 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:35:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a5f4d126-6aa9-469d-bdf2-1efcfedca782 req-2a8cd71e-1503-44a8-9df7-837ac8f611dd service nova] Acquiring lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a5f4d126-6aa9-469d-bdf2-1efcfedca782 req-2a8cd71e-1503-44a8-9df7-837ac8f611dd service nova] Lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a5f4d126-6aa9-469d-bdf2-1efcfedca782 req-2a8cd71e-1503-44a8-9df7-837ac8f611dd service nova] Lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:32 user nova-compute[74996]: DEBUG nova.compute.manager [req-a5f4d126-6aa9-469d-bdf2-1efcfedca782 req-2a8cd71e-1503-44a8-9df7-837ac8f611dd service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] No waiting events found dispatching network-vif-plugged-fbf546f3-964c-4816-84c1-20d11b5ed544 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:35:32 user nova-compute[74996]: WARNING nova.compute.manager [req-a5f4d126-6aa9-469d-bdf2-1efcfedca782 req-2a8cd71e-1503-44a8-9df7-837ac8f611dd service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Received unexpected event network-vif-plugged-fbf546f3-964c-4816-84c1-20d11b5ed544 for instance with vm_state building and task_state spawning.
Nov 02 01:35:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:34 user nova-compute[74996]: DEBUG nova.compute.manager [req-6e0fdbf9-25a7-4abc-99ef-05cdb972dac9 req-85f4cb0c-6564-4b2d-a355-9152d0ec2f52 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Received event network-vif-plugged-fbf546f3-964c-4816-84c1-20d11b5ed544 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:35:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6e0fdbf9-25a7-4abc-99ef-05cdb972dac9 req-85f4cb0c-6564-4b2d-a355-9152d0ec2f52 service nova] Acquiring lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6e0fdbf9-25a7-4abc-99ef-05cdb972dac9 req-85f4cb0c-6564-4b2d-a355-9152d0ec2f52 service nova] Lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6e0fdbf9-25a7-4abc-99ef-05cdb972dac9 req-85f4cb0c-6564-4b2d-a355-9152d0ec2f52 service nova] Lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:34 user nova-compute[74996]: DEBUG nova.compute.manager [req-6e0fdbf9-25a7-4abc-99ef-05cdb972dac9 req-85f4cb0c-6564-4b2d-a355-9152d0ec2f52 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] No waiting events found dispatching network-vif-plugged-fbf546f3-964c-4816-84c1-20d11b5ed544 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:35:34 user nova-compute[74996]: WARNING nova.compute.manager [req-6e0fdbf9-25a7-4abc-99ef-05cdb972dac9 req-85f4cb0c-6564-4b2d-a355-9152d0ec2f52 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Received unexpected event network-vif-plugged-fbf546f3-964c-4816-84c1-20d11b5ed544 for instance with vm_state building and task_state spawning.
Nov 02 01:35:34 user nova-compute[74996]: DEBUG nova.compute.manager [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:35:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:35:34 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Instance spawned successfully.
Nov 02 01:35:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:35:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:35:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:35:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:35:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:35:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:35:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:35:34 user nova-compute[74996]: INFO nova.compute.manager [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Took 6.81 seconds to spawn the instance on the hypervisor.
Nov 02 01:35:34 user nova-compute[74996]: DEBUG nova.compute.manager [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:35:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bfc5f9ee-5000-47ff-a9ce-4b91f53f58c0 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Acquiring lock "4f81e089-21cf-4132-9f04-a5cf777158d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bfc5f9ee-5000-47ff-a9ce-4b91f53f58c0 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "4f81e089-21cf-4132-9f04-a5cf777158d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bfc5f9ee-5000-47ff-a9ce-4b91f53f58c0 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Acquiring lock "4f81e089-21cf-4132-9f04-a5cf777158d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bfc5f9ee-5000-47ff-a9ce-4b91f53f58c0 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "4f81e089-21cf-4132-9f04-a5cf777158d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bfc5f9ee-5000-47ff-a9ce-4b91f53f58c0 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "4f81e089-21cf-4132-9f04-a5cf777158d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:35 user nova-compute[74996]: INFO nova.compute.manager [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Took 8.26 seconds to build instance.
Nov 02 01:35:35 user nova-compute[74996]: INFO nova.compute.manager [None req-bfc5f9ee-5000-47ff-a9ce-4b91f53f58c0 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Terminating instance
Nov 02 01:35:35 user nova-compute[74996]: DEBUG nova.compute.manager [None req-bfc5f9ee-5000-47ff-a9ce-4b91f53f58c0 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:35:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0781210c-db95-4070-bc37-490a541d2b81 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.374s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:35 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Instance destroyed successfully.
Nov 02 01:35:35 user nova-compute[74996]: DEBUG nova.objects.instance [None req-bfc5f9ee-5000-47ff-a9ce-4b91f53f58c0 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lazy-loading 'resources' on Instance uuid 4f81e089-21cf-4132-9f04-a5cf777158d8 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:35:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-bfc5f9ee-5000-47ff-a9ce-4b91f53f58c0 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:32:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-800574735',display_name='tempest-VolumesAdminNegativeTest-server-800574735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-800574735',id=10,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:32:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f91486d1ff074f7599b5bc2e771e28d9',ramdisk_id='',reservation_id='r-pgpe1jq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1150311361',owner_user_name='tempest-VolumesAdminNegativeTest-1150311361-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:32:57Z,user_data=None,user_id='369a170aab0b4d3f9de0713b52798b72',uuid=4f81e089-21cf-4132-9f04-a5cf777158d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1442b29d-a02a-4c37-a95a-1936f024f562", "address": "fa:16:3e:36:fa:46", "network": {"id": "8bca3600-c671-4a05-9913-14a9531365d1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2106930518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91486d1ff074f7599b5bc2e771e28d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1442b29d-a0", "ovs_interfaceid": "1442b29d-a02a-4c37-a95a-1936f024f562", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:35:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-bfc5f9ee-5000-47ff-a9ce-4b91f53f58c0 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Converting VIF {"id": "1442b29d-a02a-4c37-a95a-1936f024f562", "address": "fa:16:3e:36:fa:46", "network": {"id": "8bca3600-c671-4a05-9913-14a9531365d1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2106930518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91486d1ff074f7599b5bc2e771e28d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1442b29d-a0", "ovs_interfaceid": "1442b29d-a02a-4c37-a95a-1936f024f562", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:35:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-bfc5f9ee-5000-47ff-a9ce-4b91f53f58c0 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:fa:46,bridge_name='br-int',has_traffic_filtering=True,id=1442b29d-a02a-4c37-a95a-1936f024f562,network=Network(8bca3600-c671-4a05-9913-14a9531365d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1442b29d-a0') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:35:35 user nova-compute[74996]: DEBUG os_vif [None req-bfc5f9ee-5000-47ff-a9ce-4b91f53f58c0 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:fa:46,bridge_name='br-int',has_traffic_filtering=True,id=1442b29d-a02a-4c37-a95a-1936f024f562,network=Network(8bca3600-c671-4a05-9913-14a9531365d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1442b29d-a0') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:35:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1442b29d-a0, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:35:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:35:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d19017e-d4a8-49f7-ac97-f2a862095cd0) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:35:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:35:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:35 user nova-compute[74996]: INFO os_vif [None req-bfc5f9ee-5000-47ff-a9ce-4b91f53f58c0 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:fa:46,bridge_name='br-int',has_traffic_filtering=True,id=1442b29d-a02a-4c37-a95a-1936f024f562,network=Network(8bca3600-c671-4a05-9913-14a9531365d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1442b29d-a0')
Nov 02 01:35:35 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-bfc5f9ee-5000-47ff-a9ce-4b91f53f58c0 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Deleting instance files /opt/stack/data/nova/instances/4f81e089-21cf-4132-9f04-a5cf777158d8_del
Nov 02 01:35:35 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-bfc5f9ee-5000-47ff-a9ce-4b91f53f58c0 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Deletion of /opt/stack/data/nova/instances/4f81e089-21cf-4132-9f04-a5cf777158d8_del complete
Nov 02 01:35:36 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Instance destroyed successfully.
Nov 02 01:35:36 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2134430177',display_name='tempest-ServerActionsTestOtherA-server-263817137',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2134430177',id=11,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNN6oJiXhFxdMwj/0co4qWNsZDCOOAm4cBGkxSrT+8SbME3yAUS7Lu3VoxNK9wQW0hSSDE/yVKt92SwOB9CarD6wWY/rtu715m22W1QHYAaorIXtxO2ABbriBx1V6vl75g==',key_name='tempest-keypair-884605409',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:33:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f462793d4eb4433c9c27d92f80518db1',ramdisk_id='',reservation_id='r-nwbxga7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-852070362',owner_user_name='tempest-ServerActionsTestOtherA-852070362-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:35:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0ac87391a0140ba83743c0a2cd193fe',uuid=fa6400fb-9e90-4f94-9da7-238b91276f41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "address": "fa:16:3e:8e:48:16", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3ba0fb-89", "ovs_interfaceid": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Converting VIF {"id": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "address": "fa:16:3e:8e:48:16", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3ba0fb-89", "ovs_interfaceid": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:48:16,bridge_name='br-int',has_traffic_filtering=True,id=7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3ba0fb-89') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG os_vif [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:48:16,bridge_name='br-int',has_traffic_filtering=True,id=7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3ba0fb-89') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a3ba0fb-89, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c2e075f5-70f3-46cf-9768-2bba7ccdf429) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:35:36 user nova-compute[74996]: INFO os_vif [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:48:16,bridge_name='br-int',has_traffic_filtering=True,id=7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3ba0fb-89')
Nov 02 01:35:36 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMBCqxAQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:35:36 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 01:35:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c9379e-f040-49a0-911d-7ab9f6a0f79f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:35:36 user nova-compute[74996]: No targets found.
Nov 02 01:35:36 user nova-compute[74996]: iSNS:
Nov 02 01:35:36 user nova-compute[74996]: No targets found.
Nov 02 01:35:36 user nova-compute[74996]: STATIC:
Nov 02 01:35:36 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01
Nov 02 01:35:36 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:35:36 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:35:36 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84
Nov 02 01:35:36 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:35:36 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:35:36 user nova-compute[74996]: FIRMWARE:
Nov 02 01:35:36 user nova-compute[74996]: No targets found.
Nov 02 01:35:36 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:35:36 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:35:36 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6a8ebb-2910-49f8-98ef-ef3e9384e301]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:36 user nova-compute[74996]: INFO nova.compute.manager [None req-bfc5f9ee-5000-47ff-a9ce-4b91f53f58c0 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-bfc5f9ee-5000-47ff-a9ce-4b91f53f58c0 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd492cb-876f-4312-a40f-56fa8682ab71]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:35:36 user nova-compute[74996]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:35:36 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:35:36 user nova-compute[74996]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:35:36 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830c61d990>, {}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Disconnecting from: [] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.072s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] <== disconnect_volume: return (73ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:35:36 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Deleting instance files /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41_del
Nov 02 01:35:36 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Deletion of /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41_del complete
Nov 02 01:35:36 user nova-compute[74996]: INFO nova.virt.block_device [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Booting with volume a249585d-899f-41ad-ab90-28d47b08fcf1 at /dev/vdb
Nov 02 01:35:36 user nova-compute[74996]: DEBUG os_brick.utils [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[811a886c-ef2e-412f-ba14-3a99721b589b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.029s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc002cb3-89a6-4d51-8b3d-0cf0f0740664]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f1a933-f0d6-4d1a-aa4b-eca1fbbc9add]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-2303d47d-d17f-40fb-90a4-6979c1b52396 req-e4e90164-8d56-4905-ab74-3df1364c4e37 service nova] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Received event network-vif-unplugged-1442b29d-a02a-4c37-a95a-1936f024f562 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2303d47d-d17f-40fb-90a4-6979c1b52396 req-e4e90164-8d56-4905-ab74-3df1364c4e37 service nova] Acquiring lock "4f81e089-21cf-4132-9f04-a5cf777158d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2303d47d-d17f-40fb-90a4-6979c1b52396 req-e4e90164-8d56-4905-ab74-3df1364c4e37 service nova] Lock "4f81e089-21cf-4132-9f04-a5cf777158d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2303d47d-d17f-40fb-90a4-6979c1b52396 req-e4e90164-8d56-4905-ab74-3df1364c4e37 service nova] Lock "4f81e089-21cf-4132-9f04-a5cf777158d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-2303d47d-d17f-40fb-90a4-6979c1b52396 req-e4e90164-8d56-4905-ab74-3df1364c4e37 service nova] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] No waiting events found dispatching network-vif-unplugged-1442b29d-a02a-4c37-a95a-1936f024f562 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-2303d47d-d17f-40fb-90a4-6979c1b52396 req-e4e90164-8d56-4905-ab74-3df1364c4e37 service nova] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Received event network-vif-unplugged-1442b29d-a02a-4c37-a95a-1936f024f562 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-2303d47d-d17f-40fb-90a4-6979c1b52396 req-e4e90164-8d56-4905-ab74-3df1364c4e37 service nova] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Received event network-vif-plugged-1442b29d-a02a-4c37-a95a-1936f024f562 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2303d47d-d17f-40fb-90a4-6979c1b52396 req-e4e90164-8d56-4905-ab74-3df1364c4e37 service nova] Acquiring lock "4f81e089-21cf-4132-9f04-a5cf777158d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2303d47d-d17f-40fb-90a4-6979c1b52396 req-e4e90164-8d56-4905-ab74-3df1364c4e37 service nova] Lock "4f81e089-21cf-4132-9f04-a5cf777158d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2303d47d-d17f-40fb-90a4-6979c1b52396 req-e4e90164-8d56-4905-ab74-3df1364c4e37 service nova] Lock "4f81e089-21cf-4132-9f04-a5cf777158d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-2303d47d-d17f-40fb-90a4-6979c1b52396 req-e4e90164-8d56-4905-ab74-3df1364c4e37 service nova] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] No waiting events found dispatching network-vif-plugged-1442b29d-a02a-4c37-a95a-1936f024f562 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:35:36 user nova-compute[74996]: WARNING nova.compute.manager [req-2303d47d-d17f-40fb-90a4-6979c1b52396 req-e4e90164-8d56-4905-ab74-3df1364c4e37 service nova] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Received unexpected event network-vif-plugged-1442b29d-a02a-4c37-a95a-1936f024f562 for instance with vm_state active and task_state deleting.
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e84eb1-d353-4f7d-928d-7e8d689b442c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-bfa49a80-4612-4751-9106-9f01d84f1433 req-b11c95cc-8878-4469-8b18-4750e4fd47cc service nova] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Received event network-vif-deleted-1442b29d-a02a-4c37-a95a-1936f024f562 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:35:36 user nova-compute[74996]: INFO nova.compute.manager [req-bfa49a80-4612-4751-9106-9f01d84f1433 req-b11c95cc-8878-4469-8b18-4750e4fd47cc service nova] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Neutron deleted interface 1442b29d-a02a-4c37-a95a-1936f024f562; detaching it from the instance and deleting it from the info cache
Nov 02 01:35:36 user nova-compute[74996]: DEBUG nova.network.neutron [req-bfa49a80-4612-4751-9106-9f01d84f1433 req-b11c95cc-8878-4469-8b18-4750e4fd47cc service nova] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:36 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Took 0.70 seconds to deallocate network for instance.
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:35:36 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[43953c6a-423f-4400-a6b9-42a56173f889]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG os_brick.utils [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] <== get_connector_properties: return (332ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Updating existing volume attachment record: ba5f6ec2-b674-4e20-9c9a-d256f6d91781 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-bfa49a80-4612-4751-9106-9f01d84f1433 req-b11c95cc-8878-4469-8b18-4750e4fd47cc service nova] [instance: 4f81e089-21cf-4132-9f04-a5cf777158d8] Detach interface failed, port_id=1442b29d-a02a-4c37-a95a-1936f024f562, reason: Instance 4f81e089-21cf-4132-9f04-a5cf777158d8 could not be found. {{(pid=74996) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bfc5f9ee-5000-47ff-a9ce-4b91f53f58c0 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bfc5f9ee-5000-47ff-a9ce-4b91f53f58c0 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:37 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-bfc5f9ee-5000-47ff-a9ce-4b91f53f58c0 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:35:37 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-bfc5f9ee-5000-47ff-a9ce-4b91f53f58c0 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:35:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bfc5f9ee-5000-47ff-a9ce-4b91f53f58c0 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.595s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:37 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-bfc5f9ee-5000-47ff-a9ce-4b91f53f58c0 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Deleted allocations for instance 4f81e089-21cf-4132-9f04-a5cf777158d8
Nov 02 01:35:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bfc5f9ee-5000-47ff-a9ce-4b91f53f58c0 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "4f81e089-21cf-4132-9f04-a5cf777158d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.587s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:44 user nova-compute[74996]: INFO nova.virt.block_device [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Booting with volume ec3ba29d-5a27-4f3c-be18-2d9d10bba873 at /dev/vdc
Nov 02 01:35:45 user nova-compute[74996]: DEBUG os_brick.utils [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:35:45 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:45 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:45 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8871281-bf8e-4d7b-b44e-f587aba9ad69]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:45 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:45 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:45 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f271a6ac-d5fc-4223-9f2e-ec69a649912d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:45 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:45 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:45 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad05c4e6-d231-4a8d-92b5-ab4aac804cf5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:45 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8515c6f2-9f7b-4c8c-aede-ed365fbaa68d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:45 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:45 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:35:45 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:35:45 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:45 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:35:45 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:35:45 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[011313a2-a5e1-4adc-b126-469344b9d8ce]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:45 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:35:45 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:35:45 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:35:45 user nova-compute[74996]: DEBUG os_brick.utils [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:35:45 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Updating existing volume attachment record: 19dddff9-784c-4a4b-a776-baeaa06ac0f5 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:35:46 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:56 user nova-compute[74996]: DEBUG nova.network.neutron [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Port 0a0d9417-e8c0-4392-ba9b-f1e27712adad binding to destination host user is already ACTIVE {{(pid=74996) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 02 01:35:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "refresh_cache-c04b39dd-3961-4e23-ad43-34a218f4a472" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:35:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquired lock "refresh_cache-c04b39dd-3961-4e23-ad43-34a218f4a472" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:35:56 user nova-compute[74996]: DEBUG nova.network.neutron [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:35:56 user nova-compute[74996]: DEBUG nova.network.neutron [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Updating instance_info_cache with network_info: [{"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:35:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Releasing lock "refresh_cache-c04b39dd-3961-4e23-ad43-34a218f4a472" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:35:56 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Creating tmpfile /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/tmpwxk_z_ks to verify with other compute node that the instance is on the same shared storage. {{(pid=74996) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 02 01:35:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:56 user nova-compute[74996]: DEBUG nova.compute.manager [req-212f035f-bc04-48b7-a74c-75d910af1be9 req-c9cfa5be-08e7-449a-9783-15b916ea2e44 service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Received event network-vif-unplugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:35:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-212f035f-bc04-48b7-a74c-75d910af1be9 req-c9cfa5be-08e7-449a-9783-15b916ea2e44 service nova] Acquiring lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-212f035f-bc04-48b7-a74c-75d910af1be9 req-c9cfa5be-08e7-449a-9783-15b916ea2e44 service nova] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-212f035f-bc04-48b7-a74c-75d910af1be9 req-c9cfa5be-08e7-449a-9783-15b916ea2e44 service nova] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:56 user nova-compute[74996]: DEBUG nova.compute.manager [req-212f035f-bc04-48b7-a74c-75d910af1be9 req-c9cfa5be-08e7-449a-9783-15b916ea2e44 service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] No waiting events found dispatching network-vif-unplugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:35:56 user nova-compute[74996]: WARNING nova.compute.manager [req-212f035f-bc04-48b7-a74c-75d910af1be9 req-c9cfa5be-08e7-449a-9783-15b916ea2e44 service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Received unexpected event network-vif-unplugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad for instance with vm_state resized and task_state resize_reverting.
Nov 02 01:35:57 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Instance destroyed successfully.
Nov 02 01:35:57 user nova-compute[74996]: DEBUG nova.objects.instance [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lazy-loading 'resources' on Instance uuid c04b39dd-3961-4e23-ad43-34a218f4a472 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-83700266',display_name='tempest-ServerActionsTestOtherB-server-83700266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-83700266',id=2,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+Qz/HK0D2SWfSjBSFTRJ1B5PKDz0As2T6IrqSYMkdjVvyXlNOPr+4jggbHQf8/h9wUb6gFXAyyFyjYzXEE9DdDVU1SAq0i/8zGeoZyzalitAxQC04YuAZwWq1fcoAvuw==',key_name='tempest-keypair-912688440',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:34:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28fc6b23ac2b4c7e82fd2a473ddc69c7',ramdisk_id='',reservation_id='r-8s5rn1jj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-539262669',owner_user_name='tempest-ServerActionsTestOtherB-539262669-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:34:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbb633ea13724161916c7a7b0ca2c392',uuid=c04b39dd-3961-4e23-ad43-34a218f4a472,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Converting VIF {"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:a5:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a0d9417-e8c0-4392-ba9b-f1e27712adad,network=Network(fb067344-da99-4071-93f6-a4f844b74341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0d9417-e8') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG os_vif [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:a5:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a0d9417-e8c0-4392-ba9b-f1e27712adad,network=Network(fb067344-da99-4071-93f6-a4f844b74341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0d9417-e8') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a0d9417-e8, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82683be9-fe64-42c5-a750-bead6e30ee0c) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:57 user nova-compute[74996]: INFO os_vif [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:a5:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a0d9417-e8c0-4392-ba9b-f1e27712adad,network=Network(fb067344-da99-4071-93f6-a4f844b74341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0d9417-e8')
Nov 02 01:35:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EvZlqADN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:35:57 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:35:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[edec83e4-335d-4b53-b8f4-01ad66921084]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:35:57 user nova-compute[74996]: No targets found.
Nov 02 01:35:57 user nova-compute[74996]: iSNS:
Nov 02 01:35:57 user nova-compute[74996]: No targets found.
Nov 02 01:35:57 user nova-compute[74996]: STATIC:
Nov 02 01:35:57 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01
Nov 02 01:35:57 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:35:57 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:35:57 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84
Nov 02 01:35:57 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:35:57 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:35:57 user nova-compute[74996]: FIRMWARE:
Nov 02 01:35:57 user nova-compute[74996]: No targets found.
Nov 02 01:35:57 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:35:57 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:35:57 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f1f979-90bc-4855-afdb-f64eb277a3f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fd00e2-a4cc-42e3-adb3-f5e65c58f8bf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:35:57 user nova-compute[74996]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:35:57 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:35:57 user nova-compute[74996]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:35:57 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830c505900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84'): ({'sdb'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Removing single pathed devices sdb {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f63d37-651a-43cb-9499-afc021ddcda4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fc4f61-e75d-4a96-81ba-65875a11387c]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Flushing IO for device /dev/sdb {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d713da7-4e2f-4cff-8a66-e2350ef3cfd1]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[78750593-9cf9-4277-b834-59de9f76fefe]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e6abf3-4164-4869-aee1-42afce5c6698]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfbbf6b-1dfc-4f84-98eb-73b6e71a1f15]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84, portal: 172.16.0.220,3260]
Nov 02 01:35:57 user nova-compute[74996]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84, portal: 172.16.0.220,3260] successful.
Nov 02 01:35:57 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b9fd2c-b2df-4452-a1f8-9e5f22b6aeb2]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] <== disconnect_volume: return (311ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:35:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:35:58 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:35:58 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Creating image(s)
Nov 02 01:35:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "/opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "/opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:58 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:58 user nova-compute[74996]: DEBUG nova.compute.manager [req-d864dfc9-ced5-4527-b84d-f993cf4d989a req-b3f1f122-b0e9-44dc-aed9-561879248deb service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Received event network-vif-plugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:35:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d864dfc9-ced5-4527-b84d-f993cf4d989a req-b3f1f122-b0e9-44dc-aed9-561879248deb service nova] Acquiring lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d864dfc9-ced5-4527-b84d-f993cf4d989a req-b3f1f122-b0e9-44dc-aed9-561879248deb service nova] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d864dfc9-ced5-4527-b84d-f993cf4d989a req-b3f1f122-b0e9-44dc-aed9-561879248deb service nova] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:58 user nova-compute[74996]: DEBUG nova.compute.manager [req-d864dfc9-ced5-4527-b84d-f993cf4d989a req-b3f1f122-b0e9-44dc-aed9-561879248deb service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] No waiting events found dispatching network-vif-plugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:35:58 user nova-compute[74996]: WARNING nova.compute.manager [req-d864dfc9-ced5-4527-b84d-f993cf4d989a req-b3f1f122-b0e9-44dc-aed9-561879248deb service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Received unexpected event network-vif-plugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad for instance with vm_state resized and task_state resize_reverting.
Nov 02 01:35:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.194s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.202s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk 1073741824" returned: 0 in 0.061s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.200s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Cannot resize image /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Ensure instance console log exists: /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Start _get_guest_xml network_info=[{"id": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "address": "fa:16:3e:8e:48:16", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3ba0fb-89", "ovs_interfaceid": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ba5f6ec2-b674-4e20-9c9a-d256f6d91781', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMBCqxAQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fa6400fb-9e90-4f94-9da7-238b91276f41', 'attached_at': '', 'detached_at': '', 'volume_id': 'a249585d-899f-41ad-ab90-28d47b08fcf1', 'serial': 'a249585d-899f-41ad-ab90-28d47b08fcf1'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:35:59 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 02 01:35:59 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 02 01:35:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG nova.objects.instance [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lazy-loading 'vcpu_model' on Instance uuid fa6400fb-9e90-4f94-9da7-238b91276f41 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMBCqxAQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:35:59 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 01:35:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:35:59 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 01:35:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:35:59 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:35:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e70ab3-c3dc-4166-ab81-0a768c3f28cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:35:59 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8622adda-9f4a-47d0-994a-3ecbda2b8729]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1] added
Nov 02 01:35:59 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae809b76-4d69-4aec-a483-4901548ab63b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:35:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5caab2-85a3-41d3-940e-d50a17f413d4]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jMBCqxAQ {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jMBCqxAQ" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3e794c-6eb7-44a6-beaf-c9e7f3ceae9e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jMBCqxAQ'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f5958e-b316-4a6f-8cb2-555fc8bd4392]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4726481-1361-4c8c-a45f-e3d7c9e766a5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:36:00 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:36:00 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[162484ab-e4ae-4df5-bff2-4de0fb214005]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1, portal: 172.16.0.220,3260]
Nov 02 01:36:00 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1, portal: 172.16.0.220,3260] successful.
Nov 02 01:36:00 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe2d597-5b3e-4671-a56d-c2f9b5169572]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[99439718-7895-4ce6-98ba-401323734ad8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:36:00 user nova-compute[74996]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:36:00 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:36:00 user nova-compute[74996]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:36:00 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dacea4-a46f-4bbe-a6ba-ba5f42015b8b]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:36:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMBCqxAQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:36:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:36:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26266303462636534', 'path': '/dev/sdb'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:36:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266303462636534', 'path': '/dev/sdb'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:36:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T01:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2134430177',display_name='tempest-ServerActionsTestOtherA-server-263817137',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2134430177',id=11,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNN6oJiXhFxdMwj/0co4qWNsZDCOOAm4cBGkxSrT+8SbME3yAUS7Lu3VoxNK9wQW0hSSDE/yVKt92SwOB9CarD6wWY/rtu715m22W1QHYAaorIXtxO2ABbriBx1V6vl75g==',key_name='tempest-keypair-884605409',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:33:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f462793d4eb4433c9c27d92f80518db1',ramdisk_id='',reservation_id='r-nwbxga7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-852070362',owner_user_name='tempest-ServerActionsTestOtherA-852070362-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:35:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0ac87391a0140ba83743c0a2cd193fe',uuid=fa6400fb-9e90-4f94-9da7-238b91276f41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "address": "fa:16:3e:8e:48:16", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3ba0fb-89", "ovs_interfaceid": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:36:01 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Converting VIF {"id": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "address": "fa:16:3e:8e:48:16", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3ba0fb-89", "ovs_interfaceid": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:36:01 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:48:16,bridge_name='br-int',has_traffic_filtering=True,id=7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3ba0fb-89') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:36:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:36:01 user nova-compute[74996]:   <uuid>fa6400fb-9e90-4f94-9da7-238b91276f41</uuid>
Nov 02 01:36:01 user nova-compute[74996]:   <name>instance-0000000b</name>
Nov 02 01:36:01 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:36:01 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:36:01 user nova-compute[74996]:   <metadata>
Nov 02 01:36:01 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:36:01 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:36:01 user nova-compute[74996]:       <nova:name>tempest-ServerActionsTestOtherA-server-263817137</nova:name>
Nov 02 01:36:01 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:35:59</nova:creationTime>
Nov 02 01:36:01 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:36:01 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:36:01 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:36:01 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:36:01 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:36:01 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:36:01 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:36:01 user nova-compute[74996]:       <nova:owner>
Nov 02 01:36:01 user nova-compute[74996]:         <nova:user uuid="f0ac87391a0140ba83743c0a2cd193fe">tempest-ServerActionsTestOtherA-852070362-project-member</nova:user>
Nov 02 01:36:01 user nova-compute[74996]:         <nova:project uuid="f462793d4eb4433c9c27d92f80518db1">tempest-ServerActionsTestOtherA-852070362</nova:project>
Nov 02 01:36:01 user nova-compute[74996]:       </nova:owner>
Nov 02 01:36:01 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:36:01 user nova-compute[74996]:       <nova:ports>
Nov 02 01:36:01 user nova-compute[74996]:         <nova:port uuid="7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e">
Nov 02 01:36:01 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 01:36:01 user nova-compute[74996]:         </nova:port>
Nov 02 01:36:01 user nova-compute[74996]:       </nova:ports>
Nov 02 01:36:01 user nova-compute[74996]:     </nova:instance>
Nov 02 01:36:01 user nova-compute[74996]:   </metadata>
Nov 02 01:36:01 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:36:01 user nova-compute[74996]:     <system>
Nov 02 01:36:01 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:36:01 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:36:01 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:36:01 user nova-compute[74996]:       <entry name="serial">fa6400fb-9e90-4f94-9da7-238b91276f41</entry>
Nov 02 01:36:01 user nova-compute[74996]:       <entry name="uuid">fa6400fb-9e90-4f94-9da7-238b91276f41</entry>
Nov 02 01:36:01 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:36:01 user nova-compute[74996]:     </system>
Nov 02 01:36:01 user nova-compute[74996]:   </sysinfo>
Nov 02 01:36:01 user nova-compute[74996]:   <os>
Nov 02 01:36:01 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:36:01 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:36:01 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:36:01 user nova-compute[74996]:   </os>
Nov 02 01:36:01 user nova-compute[74996]:   <features>
Nov 02 01:36:01 user nova-compute[74996]:     <acpi/>
Nov 02 01:36:01 user nova-compute[74996]:     <apic/>
Nov 02 01:36:01 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:36:01 user nova-compute[74996]:   </features>
Nov 02 01:36:01 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:36:01 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:36:01 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:36:01 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:36:01 user nova-compute[74996]:   </clock>
Nov 02 01:36:01 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:36:01 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:36:01 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:36:01 user nova-compute[74996]:   </cpu>
Nov 02 01:36:01 user nova-compute[74996]:   <devices>
Nov 02 01:36:01 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:36:01 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:36:01 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk"/>
Nov 02 01:36:01 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:36:01 user nova-compute[74996]:     </disk>
Nov 02 01:36:01 user nova-compute[74996]:     <disk type="block" device="disk">
Nov 02 01:36:01 user nova-compute[74996]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:36:01 user nova-compute[74996]:       <source dev="/dev/sdb"/>
Nov 02 01:36:01 user nova-compute[74996]:       <target dev="vdb" bus="virtio"/>
Nov 02 01:36:01 user nova-compute[74996]:       <serial>a249585d-899f-41ad-ab90-28d47b08fcf1</serial>
Nov 02 01:36:01 user nova-compute[74996]:     </disk>
Nov 02 01:36:01 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:36:01 user nova-compute[74996]:       <mac address="fa:16:3e:8e:48:16"/>
Nov 02 01:36:01 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:36:01 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:36:01 user nova-compute[74996]:       <target dev="tap7a3ba0fb-89"/>
Nov 02 01:36:01 user nova-compute[74996]:     </interface>
Nov 02 01:36:01 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:36:01 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/console.log" append="off"/>
Nov 02 01:36:01 user nova-compute[74996]:     </serial>
Nov 02 01:36:01 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:36:01 user nova-compute[74996]:     <video>
Nov 02 01:36:01 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:36:01 user nova-compute[74996]:     </video>
Nov 02 01:36:01 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:36:01 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:36:01 user nova-compute[74996]:     </rng>
Nov 02 01:36:01 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:36:01 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:36:01 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:36:01 user nova-compute[74996]:     </memballoon>
Nov 02 01:36:01 user nova-compute[74996]:   </devices>
Nov 02 01:36:01 user nova-compute[74996]: </domain>
Nov 02 01:36:01 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:36:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T01:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2134430177',display_name='tempest-ServerActionsTestOtherA-server-263817137',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2134430177',id=11,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNN6oJiXhFxdMwj/0co4qWNsZDCOOAm4cBGkxSrT+8SbME3yAUS7Lu3VoxNK9wQW0hSSDE/yVKt92SwOB9CarD6wWY/rtu715m22W1QHYAaorIXtxO2ABbriBx1V6vl75g==',key_name='tempest-keypair-884605409',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:33:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f462793d4eb4433c9c27d92f80518db1',ramdisk_id='',reservation_id='r-nwbxga7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-852070362',owner_user_name='tempest-ServerActionsTestOtherA-852070362-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:35:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0ac87391a0140ba83743c0a2cd193fe',uuid=fa6400fb-9e90-4f94-9da7-238b91276f41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "address": "fa:16:3e:8e:48:16", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3ba0fb-89", "ovs_interfaceid": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:36:01 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Converting VIF {"id": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "address": "fa:16:3e:8e:48:16", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3ba0fb-89", "ovs_interfaceid": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:36:01 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:48:16,bridge_name='br-int',has_traffic_filtering=True,id=7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3ba0fb-89') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:36:01 user nova-compute[74996]: DEBUG os_vif [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:48:16,bridge_name='br-int',has_traffic_filtering=True,id=7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3ba0fb-89') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:36:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:36:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd73a3b0c-f361-5973-9c87-0f8f81ef88b8', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:36:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a3ba0fb-89, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a3ba0fb-89, col_values=(('qos', UUID('44d0931d-1374-4cfd-8ca4-893d2e78ed67')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a3ba0fb-89, col_values=(('external_ids', {'iface-id': '7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:48:16', 'vm-uuid': 'fa6400fb-9e90-4f94-9da7-238b91276f41'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:36:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:01 user nova-compute[74996]: INFO os_vif [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:48:16,bridge_name='br-int',has_traffic_filtering=True,id=7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3ba0fb-89')
Nov 02 01:36:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:36:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:36:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] No VIF found with MAC fa:16:3e:8e:48:16, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:36:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:03 user nova-compute[74996]: DEBUG nova.compute.manager [req-4ed7eac4-d13c-4691-a415-4f56ca4e843c req-d76d3f35-4bc2-4462-aefd-83f9837e2e0c service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Received event network-vif-plugged-7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4ed7eac4-d13c-4691-a415-4f56ca4e843c req-d76d3f35-4bc2-4462-aefd-83f9837e2e0c service nova] Acquiring lock "fa6400fb-9e90-4f94-9da7-238b91276f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4ed7eac4-d13c-4691-a415-4f56ca4e843c req-d76d3f35-4bc2-4462-aefd-83f9837e2e0c service nova] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4ed7eac4-d13c-4691-a415-4f56ca4e843c req-d76d3f35-4bc2-4462-aefd-83f9837e2e0c service nova] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:03 user nova-compute[74996]: DEBUG nova.compute.manager [req-4ed7eac4-d13c-4691-a415-4f56ca4e843c req-d76d3f35-4bc2-4462-aefd-83f9837e2e0c service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] No waiting events found dispatching network-vif-plugged-7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:36:03 user nova-compute[74996]: WARNING nova.compute.manager [req-4ed7eac4-d13c-4691-a415-4f56ca4e843c req-d76d3f35-4bc2-4462-aefd-83f9837e2e0c service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Received unexpected event network-vif-plugged-7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e for instance with vm_state active and task_state rebuild_spawning.
Nov 02 01:36:05 user nova-compute[74996]: DEBUG nova.compute.manager [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:36:05 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:36:05 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Instance spawned successfully.
Nov 02 01:36:05 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:36:05 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:36:05 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:36:05 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:36:05 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:36:05 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:36:05 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:36:05 user nova-compute[74996]: DEBUG nova.compute.manager [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:36:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:05 user nova-compute[74996]: DEBUG nova.objects.instance [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74996) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 02 01:36:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-26599a68-07d7-4d45-86b4-eb6045af84d7 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.109s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:05 user nova-compute[74996]: DEBUG nova.compute.manager [req-a1a063c6-3611-4543-9b9e-7f10bed3203c req-8f84cf74-f809-485a-a384-3ddd1d29b86b service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Received event network-vif-plugged-7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a1a063c6-3611-4543-9b9e-7f10bed3203c req-8f84cf74-f809-485a-a384-3ddd1d29b86b service nova] Acquiring lock "fa6400fb-9e90-4f94-9da7-238b91276f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a1a063c6-3611-4543-9b9e-7f10bed3203c req-8f84cf74-f809-485a-a384-3ddd1d29b86b service nova] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a1a063c6-3611-4543-9b9e-7f10bed3203c req-8f84cf74-f809-485a-a384-3ddd1d29b86b service nova] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:05 user nova-compute[74996]: DEBUG nova.compute.manager [req-a1a063c6-3611-4543-9b9e-7f10bed3203c req-8f84cf74-f809-485a-a384-3ddd1d29b86b service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] No waiting events found dispatching network-vif-plugged-7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:36:05 user nova-compute[74996]: WARNING nova.compute.manager [req-a1a063c6-3611-4543-9b9e-7f10bed3203c req-8f84cf74-f809-485a-a384-3ddd1d29b86b service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Received unexpected event network-vif-plugged-7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e for instance with vm_state active and task_state None.
Nov 02 01:36:05 user nova-compute[74996]: DEBUG nova.compute.manager [req-a1a063c6-3611-4543-9b9e-7f10bed3203c req-8f84cf74-f809-485a-a384-3ddd1d29b86b service nova] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Received event network-changed-eed60db2-70ab-4fd5-aa15-91c391740d1d {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:05 user nova-compute[74996]: DEBUG nova.compute.manager [req-a1a063c6-3611-4543-9b9e-7f10bed3203c req-8f84cf74-f809-485a-a384-3ddd1d29b86b service nova] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Refreshing instance network info cache due to event network-changed-eed60db2-70ab-4fd5-aa15-91c391740d1d. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:36:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a1a063c6-3611-4543-9b9e-7f10bed3203c req-8f84cf74-f809-485a-a384-3ddd1d29b86b service nova] Acquiring lock "refresh_cache-6b79aa2f-02c7-492e-b27e-7481e41f8d2c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:36:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a1a063c6-3611-4543-9b9e-7f10bed3203c req-8f84cf74-f809-485a-a384-3ddd1d29b86b service nova] Acquired lock "refresh_cache-6b79aa2f-02c7-492e-b27e-7481e41f8d2c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:36:05 user nova-compute[74996]: DEBUG nova.network.neutron [req-a1a063c6-3611-4543-9b9e-7f10bed3203c req-8f84cf74-f809-485a-a384-3ddd1d29b86b service nova] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Refreshing network info cache for port eed60db2-70ab-4fd5-aa15-91c391740d1d {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:36:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:06 user nova-compute[74996]: DEBUG nova.network.neutron [req-a1a063c6-3611-4543-9b9e-7f10bed3203c req-8f84cf74-f809-485a-a384-3ddd1d29b86b service nova] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Updated VIF entry in instance network info cache for port eed60db2-70ab-4fd5-aa15-91c391740d1d. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:36:06 user nova-compute[74996]: DEBUG nova.network.neutron [req-a1a063c6-3611-4543-9b9e-7f10bed3203c req-8f84cf74-f809-485a-a384-3ddd1d29b86b service nova] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Updating instance_info_cache with network_info: [{"id": "eed60db2-70ab-4fd5-aa15-91c391740d1d", "address": "fa:16:3e:16:c6:b4", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed60db2-70", "ovs_interfaceid": "eed60db2-70ab-4fd5-aa15-91c391740d1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:36:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a1a063c6-3611-4543-9b9e-7f10bed3203c req-8f84cf74-f809-485a-a384-3ddd1d29b86b service nova] Releasing lock "refresh_cache-6b79aa2f-02c7-492e-b27e-7481e41f8d2c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:36:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:06 user nova-compute[74996]: DEBUG nova.objects.instance [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lazy-loading 'migration_context' on Instance uuid c04b39dd-3961-4e23-ad43-34a218f4a472 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:36:06 user nova-compute[74996]: DEBUG nova.objects.base [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Object Instance<c04b39dd-3961-4e23-ad43-34a218f4a472> lazy-loaded attributes: resources,migration_context {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:36:07 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:36:07 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:36:07 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:36:07 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:36:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.675s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:07 user nova-compute[74996]: INFO nova.compute.manager [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Swapping old allocation on dict_keys(['f50a6eca-4874-4b8c-8df6-3d5aa5ebb259']) held by migration 837180ea-faaf-4ca9-a3de-4fd9b7db0a50 for instance
Nov 02 01:36:07 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Overwriting current allocation {'allocations': {'f50a6eca-4874-4b8c-8df6-3d5aa5ebb259': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 21}}, 'project_id': '28fc6b23ac2b4c7e82fd2a473ddc69c7', 'user_id': 'fbb633ea13724161916c7a7b0ca2c392', 'consumer_generation': 1} on consumer c04b39dd-3961-4e23-ad43-34a218f4a472 {{(pid=74996) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 02 01:36:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "refresh_cache-c04b39dd-3961-4e23-ad43-34a218f4a472" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:36:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquired lock "refresh_cache-c04b39dd-3961-4e23-ad43-34a218f4a472" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:36:08 user nova-compute[74996]: DEBUG nova.network.neutron [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:36:08 user nova-compute[74996]: DEBUG nova.network.neutron [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Updating instance_info_cache with network_info: [{"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:36:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Releasing lock "refresh_cache-c04b39dd-3961-4e23-ad43-34a218f4a472" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:36:08 user nova-compute[74996]: DEBUG os_brick.utils [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:36:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:08 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44f1e5d-f8f0-4859-b0fb-2d96532e10d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:08 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8505f04-73ed-45a0-8d61-6f6f19a90a43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:08 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[563f5c4c-94d6-42b2-bbee-9121b43860ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:08 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[554e0116-3035-4efb-837f-163bc3e2a9d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:36:08 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:36:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:36:08 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:36:08 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1490c76-2139-473e-a19a-12fe05b8d47f]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:08 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:36:08 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:36:08 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:36:08 user nova-compute[74996]: DEBUG os_brick.utils [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:36:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "6b79aa2f-02c7-492e-b27e-7481e41f8d2c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "6b79aa2f-02c7-492e-b27e-7481e41f8d2c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:11 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:36:11 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:36:11 user nova-compute[74996]: DEBUG nova.objects.instance [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lazy-loading 'flavor' on Instance uuid 6b79aa2f-02c7-492e-b27e-7481e41f8d2c {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:36:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "6b79aa2f-02c7-492e-b27e-7481e41f8d2c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "6b79aa2f-02c7-492e-b27e-7481e41f8d2c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "6b79aa2f-02c7-492e-b27e-7481e41f8d2c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:11 user nova-compute[74996]: INFO nova.compute.manager [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Attaching volume cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 to /dev/vdb
Nov 02 01:36:11 user nova-compute[74996]: DEBUG os_brick.utils [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:36:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4f14d5-9892-4cfb-a0ef-ff691392d59f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d610b7ee-b2c1-4842-a9d2-c3eb1755db2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[98836948-17e9-4dd9-a7cc-103210850f34]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ddd41e-91a5-4948-ab5f-7c76cecd9975]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:36:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:36:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:36:11 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:36:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f200494-6e46-47b0-b38b-4046bd5971af]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:36:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:36:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:36:11 user nova-compute[74996]: DEBUG os_brick.utils [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:36:11 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Updating existing volume attachment record: b3a8cb55-bb71-41e7-984c-66a597f72763 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:36:12 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:36:12 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:36:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:13 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:36:13 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:36:13 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Rebuilding the list of instances to heal {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 01:36:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:13 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Skipping network cache update for instance because it is Building. {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Nov 02 01:36:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-c04b39dd-3961-4e23-ad43-34a218f4a472" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:36:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-c04b39dd-3961-4e23-ad43-34a218f4a472" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:36:13 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 01:36:13 user nova-compute[74996]: DEBUG nova.objects.instance [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lazy-loading 'info_cache' on Instance uuid c04b39dd-3961-4e23-ad43-34a218f4a472 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:36:14 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Updating instance_info_cache with network_info: [{"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:36:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-c04b39dd-3961-4e23-ad43-34a218f4a472" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:36:14 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 01:36:14 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:36:14 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:36:14 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:36:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:14 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:36:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:15 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:36:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:36:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:16 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:17 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:36:17 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:36:17 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=7642MB free_disk=25.309951782226562GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:36:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance fea802b7-64d9-4c77-87a7-eaba1dce5c22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:36:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7307f3a3-1ad1-43f7-be49-9cd03a626cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:36:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 2621c5a2-acff-4055-9746-1b2f5829b39d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:36:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance fa6400fb-9e90-4f94-9da7-238b91276f41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:36:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance c04b39dd-3961-4e23-ad43-34a218f4a472 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:36:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 6b79aa2f-02c7-492e-b27e-7481e41f8d2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:36:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:36:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance d8f51f7d-c9de-4914-883e-7a875d3d73ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:36:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance adfc9441-d607-4b9f-8008-95e42f1ac51e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:36:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance f44d0b13-9dae-40c9-83d0-0b84699b1cc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:36:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:36:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:36:18 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:36:18 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:36:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:36:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.567s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:36:29 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Creating image(s)
Nov 02 01:36:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Did not create local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Ensure instance console log exists: /opt/stack/data/nova/instances/adfc9441-d607-4b9f-8008-95e42f1ac51e/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Start _get_guest_xml network_info=[{"id": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "address": "fa:16:3e:17:b8:62", "network": {"id": "45d38091-67e6-414b-9989-e308ebdcf57d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1896108595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap863ea8b0-7e", "ovs_interfaceid": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62492819-8da0-4a9f-9f78-facaaa194017", "address": "fa:16:3e:ac:91:39", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62492819-8d", "ovs_interfaceid": "62492819-8da0-4a9f-9f78-facaaa194017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "019034ca-6f89-400f-b47a-61e1157f860f", "address": "fa:16:3e:7f:67:62", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap019034ca-6f", "ovs_interfaceid": "019034ca-6f89-400f-b47a-61e1157f860f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37104018-4ea0-4b2f-b507-8887a4f7348a", "address": "fa:16:3e:8a:b6:d9", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37104018-4e", "ovs_interfaceid": "37104018-4ea0-4b2f-b507-8887a4f7348a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ade5deb-e2db-4310-b1a6-df399639eb00", "address": "fa:16:3e:22:42:a5", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ade5deb-e2", "ovs_interfaceid": "3ade5deb-e2db-4310-b1a6-df399639eb00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9042d944-67c5-4e39-9232-72ff23c6f1e0", "address": "fa:16:3e:05:b8:e8", "network": {"id": "9778b912-7b91-4a57-a5d6-fa3e8fd1016c", "bridge": "br-int", "label": "tempest-device-tagging-net2-519483991", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9042d944-67", "ovs_interfaceid": "9042d944-67c5-4e39-9232-72ff23c6f1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87bf8398-6ede-4465-9555-1000f74e75ff", "address": "fa:16:3e:67:28:a7", "network": {"id": "9778b912-7b91-4a57-a5d6-fa3e8fd1016c", "bridge": "br-int", "label": "tempest-device-tagging-net2-519483991", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87bf8398-6e", "ovs_interfaceid": "87bf8398-6ede-4465-9555-1000f74e75ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '644bdb9a-ccb8-4882-a7ae-15b582530b55', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCytujwU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'adfc9441-d607-4b9f-8008-95e42f1ac51e', 'attached_at': '', 'detached_at': '', 'volume_id': 'd40ffcc9-49b2-4ea4-b422-5b07631491e0', 'serial': 'd40ffcc9-49b2-4ea4-b422-5b07631491e0'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None}, {'attachment_id': '075b5c3d-d0f6-4808-b165-2beb7a25bab9', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NqdufOnx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'adfc9441-d607-4b9f-8008-95e42f1ac51e', 'attached_at': '', 'detached_at': '', 'volume_id': '1814f6c5-9658-4fc5-a5bd-3dc79fcf7181', 'serial': '1814f6c5-9658-4fc5-a5bd-3dc79fcf7181'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 1, 'volume_type': None}, {'attachment_id': '19dddff9-784c-4a4b-a776-baeaa06ac0f5', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcnsaRWu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'adfc9441-d607-4b9f-8008-95e42f1ac51e', 'attached_at': '', 'detached_at': '', 'volume_id': 'ec3ba29d-5a27-4f3c-be18-2d9d10bba873', 'serial': 'ec3ba29d-5a27-4f3c-be18-2d9d10bba873'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 2, 'volume_type': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:36:29 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:36:29 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:36:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCytujwU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:36:29 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:36:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:36:29 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:36:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:36:29 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[93872eca-5c53-4471-963d-26da402976eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:36:29 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1260a3a3-e155-4ca5-9d4a-57ab84364c9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0] added
Nov 02 01:36:29 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8af0a0-dea3-40d0-9fe3-1ca8881e1559]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fe92ef-6be5-4864-bc87-463029109019]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cCytujwU {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cCytujwU" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1fea62-c622-4b81-93e2-c3c555b12e54]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cCytujwU'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4701e06f-fbc0-4fd6-83c7-10a196fefa86]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d42a7a-6f7e-425a-8574-823908f1843e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:36:29 user nova-compute[74996]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:36:29 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:36:29 user nova-compute[74996]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:36:29 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7f638c-cac0-4e55-8745-0929241d8b3b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0, portal: 172.16.0.220,3260]
Nov 02 01:36:29 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0, portal: 172.16.0.220,3260] successful.
Nov 02 01:36:29 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8083f3-463f-4a02-b227-ff127908d52d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ea4feb-3c9d-4224-8bf4-7edd378c50f4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:36:29 user nova-compute[74996]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:36:29 user nova-compute[74996]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)
Nov 02 01:36:29 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:36:29 user nova-compute[74996]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:36:29 user nova-compute[74996]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)
Nov 02 01:36:29 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05117ce-5e3f-491c-8098-1c8237b68725]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:36:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCytujwU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26130663066643266', 'path': '/dev/sdc'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130663066643266', 'path': '/dev/sdc'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NqdufOnx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:36:30 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:36:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:36:30 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:36:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:36:30 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:36:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f981d97b-62d2-4df7-a9dc-aa59bcde8bc3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:36:30 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0dc33a4-9932-4e40-a6d1-604b2c7d63e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181] added
Nov 02 01:36:30 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[770bd8dd-029d-405e-9ed7-fbedd2702742]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[249da456-d12b-40a2-a930-a0e2b05f2189]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NqdufOnx {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NqdufOnx" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Starting finish_revert_migration {{(pid=74996) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0529b8ac-f1e9-4eba-a36b-7426adc6d848]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NqdufOnx'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Start _get_guest_xml network_info=[{"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2d641555-30b4-4d18-9e81-337cd36e9704', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EvZlqADN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c04b39dd-3961-4e23-ad43-34a218f4a472', 'attached_at': '2023-11-02T01:36:31.000000', 'detached_at': '', 'volume_id': '3b7eafb5-e19a-44f4-ba2b-38684fd2aa84', 'serial': '3b7eafb5-e19a-44f4-ba2b-38684fd2aa84'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:30 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:36:30 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:36:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG nova.objects.instance [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lazy-loading 'vcpu_model' on Instance uuid c04b39dd-3961-4e23-ad43-34a218f4a472 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a45b8a1-4065-42c8-9545-b0aae0c49fd3]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:31 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:36:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EvZlqADN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:36:31 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:36:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:36:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cfe471-eab8-4b37-b73c-1ab9181a46cf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:36:31 user nova-compute[74996]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:36:31 user nova-compute[74996]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)
Nov 02 01:36:31 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:36:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:36:31 user nova-compute[74996]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:36:31 user nova-compute[74996]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)
Nov 02 01:36:31 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:36:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[825ad93f-45e9-46e4-9e45-4cd14d635501]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181, portal: 172.16.0.220,3260]
Nov 02 01:36:31 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181, portal: 172.16.0.220,3260] successful.
Nov 02 01:36:31 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd850c6f-a7e7-4713-9c05-3ef181b5fef7]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa715fd8-9856-49b3-8c68-437a7258c689]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:36:31 user nova-compute[74996]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:36:31 user nova-compute[74996]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)
Nov 02 01:36:31 user nova-compute[74996]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:36:31 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:36:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:36:31 user nova-compute[74996]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:36:31 user nova-compute[74996]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)
Nov 02 01:36:31 user nova-compute[74996]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:36:31 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:36:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:36:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:36:31 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] HCTL ('36', '-', '-', 0) found on session 15 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:36:31 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:36:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f33442-991a-4134-9a53-06e7d4eb7e5e]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:31 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Searching for a device in session 15 and hctl ['36', '*', '*', 0] yield: None {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:36:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Searching for a device in session 15 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NqdufOnx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23434626331643833', 'path': '/dev/sde'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434626331643833', 'path': '/dev/sde'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.170s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:36:32 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:36:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:36:32 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b1f617-58f6-4132-8b80-75da77db5070]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:36:32 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcnsaRWu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:36:32 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:36:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef822030-7cf3-4aa5-adbb-b5e58ba82cfb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84] added
Nov 02 01:36:32 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9273cbd-317c-4026-a8b0-ed97dd260695]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[47aad06c-bc06-4be9-90e9-9c6c8154803d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EvZlqADN {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EvZlqADN" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcba776d-3199-4409-8b25-deed8f679e4e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EvZlqADN'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[410a3064-e2bb-4dae-adf1-9f4d6131cfb0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9879d259-d5b8-4f26-a0e6-f7dfa1c0814b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:36:32 user nova-compute[74996]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:36:32 user nova-compute[74996]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)
Nov 02 01:36:32 user nova-compute[74996]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:36:32 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:36:32 user nova-compute[74996]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:36:32 user nova-compute[74996]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)
Nov 02 01:36:32 user nova-compute[74996]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:36:32 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32cf71b-1b2c-4490-842a-f19b6f5c4561]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84, portal: 172.16.0.220,3260]
Nov 02 01:36:32 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84, portal: 172.16.0.220,3260] successful.
Nov 02 01:36:32 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0281b9a-094d-4571-8682-b765da98c95f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3618a10d-1568-4670-b62d-a506267466d2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:36:32 user nova-compute[74996]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:36:32 user nova-compute[74996]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)
Nov 02 01:36:32 user nova-compute[74996]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:36:32 user nova-compute[74996]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:36:32 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:36:32 user nova-compute[74996]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:36:32 user nova-compute[74996]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)
Nov 02 01:36:32 user nova-compute[74996]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:36:32 user nova-compute[74996]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:36:32 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] HCTL ('37', '-', '-', 0) found on session 16 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd7c346-6da5-43f7-9d49-8f0706398523]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Searching for a device in session 16 and hctl ['37', '*', '*', 0] yield: None {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Acquiring lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG nova.compute.manager [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:32 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:36:32 user nova-compute[74996]: INFO nova.compute.claims [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Claim successful on node user
Nov 02 01:36:33 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.637s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG nova.compute.manager [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Searching for a device in session 16 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EvZlqADN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] <== connect_volume: return (2520ms) {'type': 'block', 'scsi_wwn': '23665623864653766', 'path': '/dev/sdf'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665623864653766', 'path': '/dev/sdf'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.325s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:36:33 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:36:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:36:33 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qenFIiNA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:36:33 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:36:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[99243f38-805e-42e7-ab6c-fb66c116f095]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:36:33 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG nova.compute.manager [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG nova.network.neutron [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-83700266',display_name='tempest-ServerActionsTestOtherB-server-83700266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-83700266',id=2,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+Qz/HK0D2SWfSjBSFTRJ1B5PKDz0As2T6IrqSYMkdjVvyXlNOPr+4jggbHQf8/h9wUb6gFXAyyFyjYzXEE9DdDVU1SAq0i/8zGeoZyzalitAxQC04YuAZwWq1fcoAvuw==',key_name='tempest-keypair-912688440',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:34:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='28fc6b23ac2b4c7e82fd2a473ddc69c7',ramdisk_id='',reservation_id='r-8s5rn1jj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-539262669',owner_user_name='tempest-ServerActionsTestOtherB-539262669-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:35:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbb633ea13724161916c7a7b0ca2c392',uuid=c04b39dd-3961-4e23-ad43-34a218f4a472,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Converting VIF {"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:a5:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a0d9417-e8c0-4392-ba9b-f1e27712adad,network=Network(fb067344-da99-4071-93f6-a4f844b74341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0d9417-e8') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:36:33 user nova-compute[74996]:   <uuid>c04b39dd-3961-4e23-ad43-34a218f4a472</uuid>
Nov 02 01:36:33 user nova-compute[74996]:   <name>instance-00000002</name>
Nov 02 01:36:33 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:36:33 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:36:33 user nova-compute[74996]:   <metadata>
Nov 02 01:36:33 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:36:33 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:36:33 user nova-compute[74996]:       <nova:name>tempest-ServerActionsTestOtherB-server-83700266</nova:name>
Nov 02 01:36:33 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:36:30</nova:creationTime>
Nov 02 01:36:33 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:36:33 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:36:33 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:36:33 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:36:33 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:36:33 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:36:33 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:36:33 user nova-compute[74996]:       <nova:owner>
Nov 02 01:36:33 user nova-compute[74996]:         <nova:user uuid="fbb633ea13724161916c7a7b0ca2c392">tempest-ServerActionsTestOtherB-539262669-project-member</nova:user>
Nov 02 01:36:33 user nova-compute[74996]:         <nova:project uuid="28fc6b23ac2b4c7e82fd2a473ddc69c7">tempest-ServerActionsTestOtherB-539262669</nova:project>
Nov 02 01:36:33 user nova-compute[74996]:       </nova:owner>
Nov 02 01:36:33 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:36:33 user nova-compute[74996]:       <nova:ports>
Nov 02 01:36:33 user nova-compute[74996]:         <nova:port uuid="0a0d9417-e8c0-4392-ba9b-f1e27712adad">
Nov 02 01:36:33 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 02 01:36:33 user nova-compute[74996]:         </nova:port>
Nov 02 01:36:33 user nova-compute[74996]:       </nova:ports>
Nov 02 01:36:33 user nova-compute[74996]:     </nova:instance>
Nov 02 01:36:33 user nova-compute[74996]:   </metadata>
Nov 02 01:36:33 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:36:33 user nova-compute[74996]:     <system>
Nov 02 01:36:33 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:36:33 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:36:33 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:36:33 user nova-compute[74996]:       <entry name="serial">c04b39dd-3961-4e23-ad43-34a218f4a472</entry>
Nov 02 01:36:33 user nova-compute[74996]:       <entry name="uuid">c04b39dd-3961-4e23-ad43-34a218f4a472</entry>
Nov 02 01:36:33 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:36:33 user nova-compute[74996]:     </system>
Nov 02 01:36:33 user nova-compute[74996]:   </sysinfo>
Nov 02 01:36:33 user nova-compute[74996]:   <os>
Nov 02 01:36:33 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:36:33 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:36:33 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:36:33 user nova-compute[74996]:   </os>
Nov 02 01:36:33 user nova-compute[74996]:   <features>
Nov 02 01:36:33 user nova-compute[74996]:     <acpi/>
Nov 02 01:36:33 user nova-compute[74996]:     <apic/>
Nov 02 01:36:33 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:36:33 user nova-compute[74996]:   </features>
Nov 02 01:36:33 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:36:33 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:36:33 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:36:33 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:36:33 user nova-compute[74996]:   </clock>
Nov 02 01:36:33 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:36:33 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:36:33 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:36:33 user nova-compute[74996]:   </cpu>
Nov 02 01:36:33 user nova-compute[74996]:   <devices>
Nov 02 01:36:33 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:36:33 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:36:33 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk"/>
Nov 02 01:36:33 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:36:33 user nova-compute[74996]:     </disk>
Nov 02 01:36:33 user nova-compute[74996]:     <disk type="block" device="disk">
Nov 02 01:36:33 user nova-compute[74996]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:36:33 user nova-compute[74996]:       <source dev="/dev/sdf"/>
Nov 02 01:36:33 user nova-compute[74996]:       <target dev="vdb" bus="virtio"/>
Nov 02 01:36:33 user nova-compute[74996]:       <serial>3b7eafb5-e19a-44f4-ba2b-38684fd2aa84</serial>
Nov 02 01:36:33 user nova-compute[74996]:     </disk>
Nov 02 01:36:33 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:36:33 user nova-compute[74996]:       <mac address="fa:16:3e:75:a5:8a"/>
Nov 02 01:36:33 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:36:33 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:36:33 user nova-compute[74996]:       <target dev="tap0a0d9417-e8"/>
Nov 02 01:36:33 user nova-compute[74996]:     </interface>
Nov 02 01:36:33 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:36:33 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/console.log" append="off"/>
Nov 02 01:36:33 user nova-compute[74996]:     </serial>
Nov 02 01:36:33 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:36:33 user nova-compute[74996]:     <video>
Nov 02 01:36:33 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:36:33 user nova-compute[74996]:     </video>
Nov 02 01:36:33 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:36:33 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:36:33 user nova-compute[74996]:     </rng>
Nov 02 01:36:33 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:36:33 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:36:33 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:36:33 user nova-compute[74996]:     </memballoon>
Nov 02 01:36:33 user nova-compute[74996]:   </devices>
Nov 02 01:36:33 user nova-compute[74996]: </domain>
Nov 02 01:36:33 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-83700266',display_name='tempest-ServerActionsTestOtherB-server-83700266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-83700266',id=2,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+Qz/HK0D2SWfSjBSFTRJ1B5PKDz0As2T6IrqSYMkdjVvyXlNOPr+4jggbHQf8/h9wUb6gFXAyyFyjYzXEE9DdDVU1SAq0i/8zGeoZyzalitAxQC04YuAZwWq1fcoAvuw==',key_name='tempest-keypair-912688440',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:34:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='28fc6b23ac2b4c7e82fd2a473ddc69c7',ramdisk_id='',reservation_id='r-8s5rn1jj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-539262669',owner_user_name='tempest-ServerActionsTestOtherB-539262669-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:35:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbb633ea13724161916c7a7b0ca2c392',uuid=c04b39dd-3961-4e23-ad43-34a218f4a472,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Converting VIF {"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:a5:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a0d9417-e8c0-4392-ba9b-f1e27712adad,network=Network(fb067344-da99-4071-93f6-a4f844b74341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0d9417-e8') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG os_vif [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:a5:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a0d9417-e8c0-4392-ba9b-f1e27712adad,network=Network(fb067344-da99-4071-93f6-a4f844b74341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0d9417-e8') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc624ef8-1af9-49a3-b17e-9cf632dcf106]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873] added
Nov 02 01:36:33 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:33 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '07e76245-23b1-5e9a-b4a7-4b3c9e8b4691', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a0d9417-e8, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a0d9417-e8, col_values=(('qos', UUID('8cabd521-bece-4ee8-a6d4-97b9119a0a5a')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a0d9417-e8, col_values=(('external_ids', {'iface-id': '0a0d9417-e8c0-4392-ba9b-f1e27712adad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:a5:8a', 'vm-uuid': 'c04b39dd-3961-4e23-ad43-34a218f4a472'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d147271-2aaa-449f-81d6-a71753c08526]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG nova.compute.manager [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:33 user nova-compute[74996]: INFO os_vif [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:a5:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a0d9417-e8c0-4392-ba9b-f1e27712adad,network=Network(fb067344-da99-4071-93f6-a4f844b74341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0d9417-e8')
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2943bf-1a5d-4bb8-a586-e31df2a848d7]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZcnsaRWu {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZcnsaRWu" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[de40fc16-e992-4e58-a90c-3c04ee096da5]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZcnsaRWu'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab59616-231c-4230-a29f-d67e4a06685f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG nova.policy [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4722252fe05d42e7844123dfa5899718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4094553af48241d9896971038ca4560c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faeba5f-fc0d-42c4-bbbd-8b067ec1308b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:36:33 user nova-compute[74996]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:36:33 user nova-compute[74996]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)
Nov 02 01:36:33 user nova-compute[74996]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:36:33 user nova-compute[74996]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:36:33 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:36:33 user nova-compute[74996]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:36:33 user nova-compute[74996]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)
Nov 02 01:36:33 user nova-compute[74996]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:36:33 user nova-compute[74996]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:36:33 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG nova.compute.manager [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:36:33 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Creating image(s)
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Acquiring lock "/opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "/opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "/opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1786e62d-39db-491a-a539-e94b6a5c3309]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873, portal: 172.16.0.220,3260]
Nov 02 01:36:33 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873, portal: 172.16.0.220,3260] successful.
Nov 02 01:36:33 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[32902df7-c18d-4693-826c-70f2a90e424a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f64ef3b-4aac-4426-ba34-a29713dc268a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:36:33 user nova-compute[74996]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:36:33 user nova-compute[74996]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)
Nov 02 01:36:33 user nova-compute[74996]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:36:33 user nova-compute[74996]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:36:33 user nova-compute[74996]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)
Nov 02 01:36:33 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:36:33 user nova-compute[74996]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:36:33 user nova-compute[74996]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)
Nov 02 01:36:33 user nova-compute[74996]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:36:33 user nova-compute[74996]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:36:33 user nova-compute[74996]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)
Nov 02 01:36:33 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] HCTL ('38', '-', '-', 0) found on session 17 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae0e711-a694-46ac-a839-92882a3fa4dd]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Searching for a device in session 17 and hctl ['38', '*', '*', 0] yield: None {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.183s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.188s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce/disk 1073741824" returned: 0 in 0.052s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.188s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG nova.network.neutron [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Successfully created port: 63a93574-ffa2-45a1-9a42-b93779f1d7bb {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Cannot resize image /opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Ensure instance console log exists: /opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Searching for a device in session 17 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcnsaRWu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] <== connect_volume: return (2734ms) {'type': 'block', 'scsi_wwn': '23862613135326662', 'path': '/dev/sdg'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862613135326662', 'path': '/dev/sdg'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.400s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:36:34 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:36:34 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:36:34 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:36:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a676e655-9164-4922-8d83-3e968eab0878]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:36:34 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2013159103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2013159103',id=16,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjPh1tYKHTOH/pGrIpH4Vnubbyf2JsMVF1j+/2RGvozo0HqHWCbSS+Du5081BPYO/UtSiHfiCCf4AM6VV/EbbE3fWTf+keq4ZAqlefVkN1Xv7HHB/RbZQGr5ddsosvM3Q==',key_name='tempest-keypair-130817105',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f98a3a508c5c4966806cb9352c4b9090',ramdisk_id='',reservation_id='r-h1s4ky3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-997890989',owner_user_name='tempest-TaggedBootDevicesTest-997890989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:34:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47029fcd5f04869ab686e226867793c',uuid=adfc9441-d607-4b9f-8008-95e42f1ac51e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "address": "fa:16:3e:17:b8:62", "network": {"id": "45d38091-67e6-414b-9989-e308ebdcf57d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1896108595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap863ea8b0-7e", "ovs_interfaceid": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converting VIF {"id": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "address": "fa:16:3e:17:b8:62", "network": {"id": "45d38091-67e6-414b-9989-e308ebdcf57d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1896108595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap863ea8b0-7e", "ovs_interfaceid": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:b8:62,bridge_name='br-int',has_traffic_filtering=True,id=863ea8b0-7e3d-459a-bfb7-435e3e5001bf,network=Network(45d38091-67e6-414b-9989-e308ebdcf57d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap863ea8b0-7e') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2013159103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2013159103',id=16,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjPh1tYKHTOH/pGrIpH4Vnubbyf2JsMVF1j+/2RGvozo0HqHWCbSS+Du5081BPYO/UtSiHfiCCf4AM6VV/EbbE3fWTf+keq4ZAqlefVkN1Xv7HHB/RbZQGr5ddsosvM3Q==',key_name='tempest-keypair-130817105',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f98a3a508c5c4966806cb9352c4b9090',ramdisk_id='',reservation_id='r-h1s4ky3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-997890989',owner_user_name='tempest-TaggedBootDevicesTest-997890989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:34:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47029fcd5f04869ab686e226867793c',uuid=adfc9441-d607-4b9f-8008-95e42f1ac51e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62492819-8da0-4a9f-9f78-facaaa194017", "address": "fa:16:3e:ac:91:39", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62492819-8d", "ovs_interfaceid": "62492819-8da0-4a9f-9f78-facaaa194017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converting VIF {"id": "62492819-8da0-4a9f-9f78-facaaa194017", "address": "fa:16:3e:ac:91:39", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62492819-8d", "ovs_interfaceid": "62492819-8da0-4a9f-9f78-facaaa194017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:91:39,bridge_name='br-int',has_traffic_filtering=True,id=62492819-8da0-4a9f-9f78-facaaa194017,network=Network(a16e25af-6044-4089-8641-2b184d9e13b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap62492819-8d') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2013159103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2013159103',id=16,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjPh1tYKHTOH/pGrIpH4Vnubbyf2JsMVF1j+/2RGvozo0HqHWCbSS+Du5081BPYO/UtSiHfiCCf4AM6VV/EbbE3fWTf+keq4ZAqlefVkN1Xv7HHB/RbZQGr5ddsosvM3Q==',key_name='tempest-keypair-130817105',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f98a3a508c5c4966806cb9352c4b9090',ramdisk_id='',reservation_id='r-h1s4ky3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-997890989',owner_user_name='tempest-TaggedBootDevicesTest-997890989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:34:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47029fcd5f04869ab686e226867793c',uuid=adfc9441-d607-4b9f-8008-95e42f1ac51e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "019034ca-6f89-400f-b47a-61e1157f860f", "address": "fa:16:3e:7f:67:62", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap019034ca-6f", "ovs_interfaceid": "019034ca-6f89-400f-b47a-61e1157f860f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converting VIF {"id": "019034ca-6f89-400f-b47a-61e1157f860f", "address": "fa:16:3e:7f:67:62", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap019034ca-6f", "ovs_interfaceid": "019034ca-6f89-400f-b47a-61e1157f860f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:36:34 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:67:62,bridge_name='br-int',has_traffic_filtering=True,id=019034ca-6f89-400f-b47a-61e1157f860f,network=Network(a16e25af-6044-4089-8641-2b184d9e13b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap019034ca-6f') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2013159103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2013159103',id=16,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjPh1tYKHTOH/pGrIpH4Vnubbyf2JsMVF1j+/2RGvozo0HqHWCbSS+Du5081BPYO/UtSiHfiCCf4AM6VV/EbbE3fWTf+keq4ZAqlefVkN1Xv7HHB/RbZQGr5ddsosvM3Q==',key_name='tempest-keypair-130817105',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f98a3a508c5c4966806cb9352c4b9090',ramdisk_id='',reservation_id='r-h1s4ky3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-997890989',owner_user_name='tempest-TaggedBootDevicesTest-997890989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:34:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47029fcd5f04869ab686e226867793c',uuid=adfc9441-d607-4b9f-8008-95e42f1ac51e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37104018-4ea0-4b2f-b507-8887a4f7348a", "address": "fa:16:3e:8a:b6:d9", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37104018-4e", "ovs_interfaceid": "37104018-4ea0-4b2f-b507-8887a4f7348a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converting VIF {"id": "37104018-4ea0-4b2f-b507-8887a4f7348a", "address": "fa:16:3e:8a:b6:d9", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37104018-4e", "ovs_interfaceid": "37104018-4ea0-4b2f-b507-8887a4f7348a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:b6:d9,bridge_name='br-int',has_traffic_filtering=True,id=37104018-4ea0-4b2f-b507-8887a4f7348a,network=Network(a16e25af-6044-4089-8641-2b184d9e13b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37104018-4e') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2013159103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2013159103',id=16,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjPh1tYKHTOH/pGrIpH4Vnubbyf2JsMVF1j+/2RGvozo0HqHWCbSS+Du5081BPYO/UtSiHfiCCf4AM6VV/EbbE3fWTf+keq4ZAqlefVkN1Xv7HHB/RbZQGr5ddsosvM3Q==',key_name='tempest-keypair-130817105',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f98a3a508c5c4966806cb9352c4b9090',ramdisk_id='',reservation_id='r-h1s4ky3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-997890989',owner_user_name='tempest-TaggedBootDevicesTest-997890989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:34:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47029fcd5f04869ab686e226867793c',uuid=adfc9441-d607-4b9f-8008-95e42f1ac51e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ade5deb-e2db-4310-b1a6-df399639eb00", "address": "fa:16:3e:22:42:a5", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ade5deb-e2", "ovs_interfaceid": "3ade5deb-e2db-4310-b1a6-df399639eb00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converting VIF {"id": "3ade5deb-e2db-4310-b1a6-df399639eb00", "address": "fa:16:3e:22:42:a5", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ade5deb-e2", "ovs_interfaceid": "3ade5deb-e2db-4310-b1a6-df399639eb00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:42:a5,bridge_name='br-int',has_traffic_filtering=True,id=3ade5deb-e2db-4310-b1a6-df399639eb00,network=Network(a16e25af-6044-4089-8641-2b184d9e13b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ade5deb-e2') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2013159103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2013159103',id=16,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjPh1tYKHTOH/pGrIpH4Vnubbyf2JsMVF1j+/2RGvozo0HqHWCbSS+Du5081BPYO/UtSiHfiCCf4AM6VV/EbbE3fWTf+keq4ZAqlefVkN1Xv7HHB/RbZQGr5ddsosvM3Q==',key_name='tempest-keypair-130817105',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f98a3a508c5c4966806cb9352c4b9090',ramdisk_id='',reservation_id='r-h1s4ky3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-997890989',owner_user_name='tempest-TaggedBootDevicesTest-997890989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:34:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47029fcd5f04869ab686e226867793c',uuid=adfc9441-d607-4b9f-8008-95e42f1ac51e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9042d944-67c5-4e39-9232-72ff23c6f1e0", "address": "fa:16:3e:05:b8:e8", "network": {"id": "9778b912-7b91-4a57-a5d6-fa3e8fd1016c", "bridge": "br-int", "label": "tempest-device-tagging-net2-519483991", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9042d944-67", "ovs_interfaceid": "9042d944-67c5-4e39-9232-72ff23c6f1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converting VIF {"id": "9042d944-67c5-4e39-9232-72ff23c6f1e0", "address": "fa:16:3e:05:b8:e8", "network": {"id": "9778b912-7b91-4a57-a5d6-fa3e8fd1016c", "bridge": "br-int", "label": "tempest-device-tagging-net2-519483991", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9042d944-67", "ovs_interfaceid": "9042d944-67c5-4e39-9232-72ff23c6f1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:b8:e8,bridge_name='br-int',has_traffic_filtering=True,id=9042d944-67c5-4e39-9232-72ff23c6f1e0,network=Network(9778b912-7b91-4a57-a5d6-fa3e8fd1016c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9042d944-67') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2013159103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2013159103',id=16,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjPh1tYKHTOH/pGrIpH4Vnubbyf2JsMVF1j+/2RGvozo0HqHWCbSS+Du5081BPYO/UtSiHfiCCf4AM6VV/EbbE3fWTf+keq4ZAqlefVkN1Xv7HHB/RbZQGr5ddsosvM3Q==',key_name='tempest-keypair-130817105',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f98a3a508c5c4966806cb9352c4b9090',ramdisk_id='',reservation_id='r-h1s4ky3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-997890989',owner_user_name='tempest-TaggedBootDevicesTest-997890989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:34:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47029fcd5f04869ab686e226867793c',uuid=adfc9441-d607-4b9f-8008-95e42f1ac51e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87bf8398-6ede-4465-9555-1000f74e75ff", "address": "fa:16:3e:67:28:a7", "network": {"id": "9778b912-7b91-4a57-a5d6-fa3e8fd1016c", "bridge": "br-int", "label": "tempest-device-tagging-net2-519483991", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87bf8398-6e", "ovs_interfaceid": "87bf8398-6ede-4465-9555-1000f74e75ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converting VIF {"id": "87bf8398-6ede-4465-9555-1000f74e75ff", "address": "fa:16:3e:67:28:a7", "network": {"id": "9778b912-7b91-4a57-a5d6-fa3e8fd1016c", "bridge": "br-int", "label": "tempest-device-tagging-net2-519483991", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87bf8398-6e", "ovs_interfaceid": "87bf8398-6ede-4465-9555-1000f74e75ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:28:a7,bridge_name='br-int',has_traffic_filtering=True,id=87bf8398-6ede-4465-9555-1000f74e75ff,network=Network(9778b912-7b91-4a57-a5d6-fa3e8fd1016c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87bf8398-6e') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.objects.instance [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lazy-loading 'pci_devices' on Instance uuid adfc9441-d607-4b9f-8008-95e42f1ac51e {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d511dfb-097a-499a-a593-686735533ad3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8] added
Nov 02 01:36:35 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:36:35 user nova-compute[74996]:   <uuid>adfc9441-d607-4b9f-8008-95e42f1ac51e</uuid>
Nov 02 01:36:35 user nova-compute[74996]:   <name>instance-00000010</name>
Nov 02 01:36:35 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:36:35 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:36:35 user nova-compute[74996]:   <metadata>
Nov 02 01:36:35 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:36:35 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:36:35 user nova-compute[74996]:       <nova:name>tempest-device-tagging-server-2013159103</nova:name>
Nov 02 01:36:35 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:36:29</nova:creationTime>
Nov 02 01:36:35 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:36:35 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:36:35 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:36:35 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:36:35 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:36:35 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:36:35 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:36:35 user nova-compute[74996]:       <nova:owner>
Nov 02 01:36:35 user nova-compute[74996]:         <nova:user uuid="a47029fcd5f04869ab686e226867793c">tempest-TaggedBootDevicesTest-997890989-project-member</nova:user>
Nov 02 01:36:35 user nova-compute[74996]:         <nova:project uuid="f98a3a508c5c4966806cb9352c4b9090">tempest-TaggedBootDevicesTest-997890989</nova:project>
Nov 02 01:36:35 user nova-compute[74996]:       </nova:owner>
Nov 02 01:36:35 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:36:35 user nova-compute[74996]:       <nova:ports>
Nov 02 01:36:35 user nova-compute[74996]:         <nova:port uuid="863ea8b0-7e3d-459a-bfb7-435e3e5001bf">
Nov 02 01:36:35 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 02 01:36:35 user nova-compute[74996]:         </nova:port>
Nov 02 01:36:35 user nova-compute[74996]:         <nova:port uuid="62492819-8da0-4a9f-9f78-facaaa194017">
Nov 02 01:36:35 user nova-compute[74996]:           <nova:ip type="fixed" address="10.1.1.192" ipVersion="4"/>
Nov 02 01:36:35 user nova-compute[74996]:         </nova:port>
Nov 02 01:36:35 user nova-compute[74996]:         <nova:port uuid="019034ca-6f89-400f-b47a-61e1157f860f">
Nov 02 01:36:35 user nova-compute[74996]:           <nova:ip type="fixed" address="10.1.1.210" ipVersion="4"/>
Nov 02 01:36:35 user nova-compute[74996]:         </nova:port>
Nov 02 01:36:35 user nova-compute[74996]:         <nova:port uuid="37104018-4ea0-4b2f-b507-8887a4f7348a">
Nov 02 01:36:35 user nova-compute[74996]:           <nova:ip type="fixed" address="10.1.1.250" ipVersion="4"/>
Nov 02 01:36:35 user nova-compute[74996]:         </nova:port>
Nov 02 01:36:35 user nova-compute[74996]:         <nova:port uuid="3ade5deb-e2db-4310-b1a6-df399639eb00">
Nov 02 01:36:35 user nova-compute[74996]:           <nova:ip type="fixed" address="10.1.1.66" ipVersion="4"/>
Nov 02 01:36:35 user nova-compute[74996]:         </nova:port>
Nov 02 01:36:35 user nova-compute[74996]:         <nova:port uuid="9042d944-67c5-4e39-9232-72ff23c6f1e0">
Nov 02 01:36:35 user nova-compute[74996]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 02 01:36:35 user nova-compute[74996]:         </nova:port>
Nov 02 01:36:35 user nova-compute[74996]:         <nova:port uuid="87bf8398-6ede-4465-9555-1000f74e75ff">
Nov 02 01:36:35 user nova-compute[74996]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 02 01:36:35 user nova-compute[74996]:         </nova:port>
Nov 02 01:36:35 user nova-compute[74996]:       </nova:ports>
Nov 02 01:36:35 user nova-compute[74996]:     </nova:instance>
Nov 02 01:36:35 user nova-compute[74996]:   </metadata>
Nov 02 01:36:35 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:36:35 user nova-compute[74996]:     <system>
Nov 02 01:36:35 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:36:35 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:36:35 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:36:35 user nova-compute[74996]:       <entry name="serial">adfc9441-d607-4b9f-8008-95e42f1ac51e</entry>
Nov 02 01:36:35 user nova-compute[74996]:       <entry name="uuid">adfc9441-d607-4b9f-8008-95e42f1ac51e</entry>
Nov 02 01:36:35 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:36:35 user nova-compute[74996]:     </system>
Nov 02 01:36:35 user nova-compute[74996]:   </sysinfo>
Nov 02 01:36:35 user nova-compute[74996]:   <os>
Nov 02 01:36:35 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:36:35 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:36:35 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:36:35 user nova-compute[74996]:   </os>
Nov 02 01:36:35 user nova-compute[74996]:   <features>
Nov 02 01:36:35 user nova-compute[74996]:     <acpi/>
Nov 02 01:36:35 user nova-compute[74996]:     <apic/>
Nov 02 01:36:35 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:36:35 user nova-compute[74996]:   </features>
Nov 02 01:36:35 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:36:35 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:36:35 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:36:35 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:36:35 user nova-compute[74996]:   </clock>
Nov 02 01:36:35 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:36:35 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:36:35 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:36:35 user nova-compute[74996]:   </cpu>
Nov 02 01:36:35 user nova-compute[74996]:   <devices>
Nov 02 01:36:35 user nova-compute[74996]:     <disk type="file" device="cdrom">
Nov 02 01:36:35 user nova-compute[74996]:       <driver name="qemu" type="raw" cache="none"/>
Nov 02 01:36:35 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/adfc9441-d607-4b9f-8008-95e42f1ac51e/disk.config"/>
Nov 02 01:36:35 user nova-compute[74996]:       <target dev="hda" bus="ide"/>
Nov 02 01:36:35 user nova-compute[74996]:     </disk>
Nov 02 01:36:35 user nova-compute[74996]:     <disk type="block" device="disk">
Nov 02 01:36:35 user nova-compute[74996]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:36:35 user nova-compute[74996]:       <source dev="/dev/sdc"/>
Nov 02 01:36:35 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:36:35 user nova-compute[74996]:       <serial>d40ffcc9-49b2-4ea4-b422-5b07631491e0</serial>
Nov 02 01:36:35 user nova-compute[74996]:     </disk>
Nov 02 01:36:35 user nova-compute[74996]:     <disk type="block" device="disk">
Nov 02 01:36:35 user nova-compute[74996]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:36:35 user nova-compute[74996]:       <source dev="/dev/sde"/>
Nov 02 01:36:35 user nova-compute[74996]:       <target dev="vdb" bus="virtio"/>
Nov 02 01:36:35 user nova-compute[74996]:       <serial>1814f6c5-9658-4fc5-a5bd-3dc79fcf7181</serial>
Nov 02 01:36:35 user nova-compute[74996]:     </disk>
Nov 02 01:36:35 user nova-compute[74996]:     <disk type="block" device="disk">
Nov 02 01:36:35 user nova-compute[74996]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:36:35 user nova-compute[74996]:       <source dev="/dev/sdg"/>
Nov 02 01:36:35 user nova-compute[74996]:       <target dev="vdc" bus="virtio"/>
Nov 02 01:36:35 user nova-compute[74996]:       <serial>ec3ba29d-5a27-4f3c-be18-2d9d10bba873</serial>
Nov 02 01:36:35 user nova-compute[74996]:     </disk>
Nov 02 01:36:35 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:36:35 user nova-compute[74996]:       <mac address="fa:16:3e:17:b8:62"/>
Nov 02 01:36:35 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:36:35 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:36:35 user nova-compute[74996]:       <target dev="tap863ea8b0-7e"/>
Nov 02 01:36:35 user nova-compute[74996]:     </interface>
Nov 02 01:36:35 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:36:35 user nova-compute[74996]:       <mac address="fa:16:3e:ac:91:39"/>
Nov 02 01:36:35 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:36:35 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:36:35 user nova-compute[74996]:       <target dev="tap62492819-8d"/>
Nov 02 01:36:35 user nova-compute[74996]:     </interface>
Nov 02 01:36:35 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:36:35 user nova-compute[74996]:       <mac address="fa:16:3e:7f:67:62"/>
Nov 02 01:36:35 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:36:35 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:36:35 user nova-compute[74996]:       <target dev="tap019034ca-6f"/>
Nov 02 01:36:35 user nova-compute[74996]:     </interface>
Nov 02 01:36:35 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:36:35 user nova-compute[74996]:       <mac address="fa:16:3e:8a:b6:d9"/>
Nov 02 01:36:35 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:36:35 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:36:35 user nova-compute[74996]:       <target dev="tap37104018-4e"/>
Nov 02 01:36:35 user nova-compute[74996]:     </interface>
Nov 02 01:36:35 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:36:35 user nova-compute[74996]:       <mac address="fa:16:3e:22:42:a5"/>
Nov 02 01:36:35 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:36:35 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:36:35 user nova-compute[74996]:       <target dev="tap3ade5deb-e2"/>
Nov 02 01:36:35 user nova-compute[74996]:     </interface>
Nov 02 01:36:35 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:36:35 user nova-compute[74996]:       <mac address="fa:16:3e:05:b8:e8"/>
Nov 02 01:36:35 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:36:35 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:36:35 user nova-compute[74996]:       <target dev="tap9042d944-67"/>
Nov 02 01:36:35 user nova-compute[74996]:     </interface>
Nov 02 01:36:35 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:36:35 user nova-compute[74996]:       <mac address="fa:16:3e:67:28:a7"/>
Nov 02 01:36:35 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:36:35 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:36:35 user nova-compute[74996]:       <target dev="tap87bf8398-6e"/>
Nov 02 01:36:35 user nova-compute[74996]:     </interface>
Nov 02 01:36:35 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:36:35 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/adfc9441-d607-4b9f-8008-95e42f1ac51e/console.log" append="off"/>
Nov 02 01:36:35 user nova-compute[74996]:     </serial>
Nov 02 01:36:35 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:36:35 user nova-compute[74996]:     <video>
Nov 02 01:36:35 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:36:35 user nova-compute[74996]:     </video>
Nov 02 01:36:35 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:36:35 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:36:35 user nova-compute[74996]:     </rng>
Nov 02 01:36:35 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:36:35 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:36:35 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:36:35 user nova-compute[74996]:     </memballoon>
Nov 02 01:36:35 user nova-compute[74996]:   </devices>
Nov 02 01:36:35 user nova-compute[74996]: </domain>
Nov 02 01:36:35 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2013159103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2013159103',id=16,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjPh1tYKHTOH/pGrIpH4Vnubbyf2JsMVF1j+/2RGvozo0HqHWCbSS+Du5081BPYO/UtSiHfiCCf4AM6VV/EbbE3fWTf+keq4ZAqlefVkN1Xv7HHB/RbZQGr5ddsosvM3Q==',key_name='tempest-keypair-130817105',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f98a3a508c5c4966806cb9352c4b9090',ramdisk_id='',reservation_id='r-h1s4ky3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-997890989',owner_user_name='tempest-TaggedBootDevicesTest-997890989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:34:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47029fcd5f04869ab686e226867793c',uuid=adfc9441-d607-4b9f-8008-95e42f1ac51e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "address": "fa:16:3e:17:b8:62", "network": {"id": "45d38091-67e6-414b-9989-e308ebdcf57d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1896108595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap863ea8b0-7e", "ovs_interfaceid": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converting VIF {"id": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "address": "fa:16:3e:17:b8:62", "network": {"id": "45d38091-67e6-414b-9989-e308ebdcf57d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1896108595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap863ea8b0-7e", "ovs_interfaceid": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:b8:62,bridge_name='br-int',has_traffic_filtering=True,id=863ea8b0-7e3d-459a-bfb7-435e3e5001bf,network=Network(45d38091-67e6-414b-9989-e308ebdcf57d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap863ea8b0-7e') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG os_vif [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:b8:62,bridge_name='br-int',has_traffic_filtering=True,id=863ea8b0-7e3d-459a-bfb7-435e3e5001bf,network=Network(45d38091-67e6-414b-9989-e308ebdcf57d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap863ea8b0-7e') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d499fb-1a20-49c8-ad93-203b897d4cb6]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a7452f6-55ca-5c07-949c-83693dadd679', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap863ea8b0-7e, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap863ea8b0-7e, col_values=(('qos', UUID('ebbde07e-13ff-41f2-b2ef-15b026001648')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap863ea8b0-7e, col_values=(('external_ids', {'iface-id': '863ea8b0-7e3d-459a-bfb7-435e3e5001bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:b8:62', 'vm-uuid': 'adfc9441-d607-4b9f-8008-95e42f1ac51e'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: INFO os_vif [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:b8:62,bridge_name='br-int',has_traffic_filtering=True,id=863ea8b0-7e3d-459a-bfb7-435e3e5001bf,network=Network(45d38091-67e6-414b-9989-e308ebdcf57d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap863ea8b0-7e')
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2013159103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2013159103',id=16,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjPh1tYKHTOH/pGrIpH4Vnubbyf2JsMVF1j+/2RGvozo0HqHWCbSS+Du5081BPYO/UtSiHfiCCf4AM6VV/EbbE3fWTf+keq4ZAqlefVkN1Xv7HHB/RbZQGr5ddsosvM3Q==',key_name='tempest-keypair-130817105',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f98a3a508c5c4966806cb9352c4b9090',ramdisk_id='',reservation_id='r-h1s4ky3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-997890989',owner_user_name='tempest-TaggedBootDevicesTest-997890989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:34:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47029fcd5f04869ab686e226867793c',uuid=adfc9441-d607-4b9f-8008-95e42f1ac51e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62492819-8da0-4a9f-9f78-facaaa194017", "address": "fa:16:3e:ac:91:39", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62492819-8d", "ovs_interfaceid": "62492819-8da0-4a9f-9f78-facaaa194017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converting VIF {"id": "62492819-8da0-4a9f-9f78-facaaa194017", "address": "fa:16:3e:ac:91:39", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62492819-8d", "ovs_interfaceid": "62492819-8da0-4a9f-9f78-facaaa194017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:91:39,bridge_name='br-int',has_traffic_filtering=True,id=62492819-8da0-4a9f-9f78-facaaa194017,network=Network(a16e25af-6044-4089-8641-2b184d9e13b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap62492819-8d') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG os_vif [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:91:39,bridge_name='br-int',has_traffic_filtering=True,id=62492819-8da0-4a9f-9f78-facaaa194017,network=Network(a16e25af-6044-4089-8641-2b184d9e13b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap62492819-8d') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f82387-477c-4692-a4f4-9781693d43db]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qenFIiNA {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '51540410-0269-5101-b540-781e80a85123', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qenFIiNA" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34cd859-f7c3-44ea-9680-0730718362c2]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qenFIiNA'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62492819-8d, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap62492819-8d, col_values=(('qos', UUID('bb0d3920-ee20-4c33-bd6c-fe722ef6353b')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap62492819-8d, col_values=(('external_ids', {'iface-id': '62492819-8da0-4a9f-9f78-facaaa194017', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:91:39', 'vm-uuid': 'adfc9441-d607-4b9f-8008-95e42f1ac51e'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b41508-2606-4d61-8934-209c89af2eee]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: INFO os_vif [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:91:39,bridge_name='br-int',has_traffic_filtering=True,id=62492819-8da0-4a9f-9f78-facaaa194017,network=Network(a16e25af-6044-4089-8641-2b184d9e13b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap62492819-8d')
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2013159103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2013159103',id=16,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjPh1tYKHTOH/pGrIpH4Vnubbyf2JsMVF1j+/2RGvozo0HqHWCbSS+Du5081BPYO/UtSiHfiCCf4AM6VV/EbbE3fWTf+keq4ZAqlefVkN1Xv7HHB/RbZQGr5ddsosvM3Q==',key_name='tempest-keypair-130817105',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f98a3a508c5c4966806cb9352c4b9090',ramdisk_id='',reservation_id='r-h1s4ky3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-997890989',owner_user_name='tempest-TaggedBootDevicesTest-997890989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:34:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47029fcd5f04869ab686e226867793c',uuid=adfc9441-d607-4b9f-8008-95e42f1ac51e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "019034ca-6f89-400f-b47a-61e1157f860f", "address": "fa:16:3e:7f:67:62", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap019034ca-6f", "ovs_interfaceid": "019034ca-6f89-400f-b47a-61e1157f860f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converting VIF {"id": "019034ca-6f89-400f-b47a-61e1157f860f", "address": "fa:16:3e:7f:67:62", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap019034ca-6f", "ovs_interfaceid": "019034ca-6f89-400f-b47a-61e1157f860f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:67:62,bridge_name='br-int',has_traffic_filtering=True,id=019034ca-6f89-400f-b47a-61e1157f860f,network=Network(a16e25af-6044-4089-8641-2b184d9e13b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap019034ca-6f') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG os_vif [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:67:62,bridge_name='br-int',has_traffic_filtering=True,id=019034ca-6f89-400f-b47a-61e1157f860f,network=Network(a16e25af-6044-4089-8641-2b184d9e13b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap019034ca-6f') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f524336-9e26-5931-9160-46c4ad8b73f6', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[925eb54f-f075-4e5e-803d-97fa7859eeed]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:36:35 user nova-compute[74996]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:36:35 user nova-compute[74996]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)
Nov 02 01:36:35 user nova-compute[74996]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:36:35 user nova-compute[74996]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:36:35 user nova-compute[74996]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)
Nov 02 01:36:35 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:36:35 user nova-compute[74996]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:36:35 user nova-compute[74996]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)
Nov 02 01:36:35 user nova-compute[74996]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:36:35 user nova-compute[74996]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:36:35 user nova-compute[74996]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)
Nov 02 01:36:35 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap019034ca-6f, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap019034ca-6f, col_values=(('qos', UUID('acbf9c0f-4b6f-4ed0-b6d0-b98e4eddeb6d')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap019034ca-6f, col_values=(('external_ids', {'iface-id': '019034ca-6f89-400f-b47a-61e1157f860f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:67:62', 'vm-uuid': 'adfc9441-d607-4b9f-8008-95e42f1ac51e'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.network.neutron [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Successfully updated port: 63a93574-ffa2-45a1-9a42-b93779f1d7bb {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: INFO os_vif [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:67:62,bridge_name='br-int',has_traffic_filtering=True,id=019034ca-6f89-400f-b47a-61e1157f860f,network=Network(a16e25af-6044-4089-8641-2b184d9e13b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap019034ca-6f')
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2013159103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2013159103',id=16,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjPh1tYKHTOH/pGrIpH4Vnubbyf2JsMVF1j+/2RGvozo0HqHWCbSS+Du5081BPYO/UtSiHfiCCf4AM6VV/EbbE3fWTf+keq4ZAqlefVkN1Xv7HHB/RbZQGr5ddsosvM3Q==',key_name='tempest-keypair-130817105',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f98a3a508c5c4966806cb9352c4b9090',ramdisk_id='',reservation_id='r-h1s4ky3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-997890989',owner_user_name='tempest-TaggedBootDevicesTest-997890989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:34:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47029fcd5f04869ab686e226867793c',uuid=adfc9441-d607-4b9f-8008-95e42f1ac51e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37104018-4ea0-4b2f-b507-8887a4f7348a", "address": "fa:16:3e:8a:b6:d9", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37104018-4e", "ovs_interfaceid": "37104018-4ea0-4b2f-b507-8887a4f7348a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converting VIF {"id": "37104018-4ea0-4b2f-b507-8887a4f7348a", "address": "fa:16:3e:8a:b6:d9", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37104018-4e", "ovs_interfaceid": "37104018-4ea0-4b2f-b507-8887a4f7348a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:b6:d9,bridge_name='br-int',has_traffic_filtering=True,id=37104018-4ea0-4b2f-b507-8887a4f7348a,network=Network(a16e25af-6044-4089-8641-2b184d9e13b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37104018-4e') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG os_vif [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:b6:d9,bridge_name='br-int',has_traffic_filtering=True,id=37104018-4ea0-4b2f-b507-8887a4f7348a,network=Network(a16e25af-6044-4089-8641-2b184d9e13b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37104018-4e') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8312899d-835b-5f19-8aaa-373b837a7f89', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.compute.manager [req-bb030077-16c0-4091-90bb-b94f00f2c39a req-218e1210-eee0-4f23-862e-7f0c266d859f service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Received event network-vif-plugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-bb030077-16c0-4091-90bb-b94f00f2c39a req-218e1210-eee0-4f23-862e-7f0c266d859f service nova] Acquiring lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-bb030077-16c0-4091-90bb-b94f00f2c39a req-218e1210-eee0-4f23-862e-7f0c266d859f service nova] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-bb030077-16c0-4091-90bb-b94f00f2c39a req-218e1210-eee0-4f23-862e-7f0c266d859f service nova] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.compute.manager [req-bb030077-16c0-4091-90bb-b94f00f2c39a req-218e1210-eee0-4f23-862e-7f0c266d859f service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] No waiting events found dispatching network-vif-plugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:36:35 user nova-compute[74996]: WARNING nova.compute.manager [req-bb030077-16c0-4091-90bb-b94f00f2c39a req-218e1210-eee0-4f23-862e-7f0c266d859f service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Received unexpected event network-vif-plugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad for instance with vm_state resized and task_state resize_reverting.
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Acquiring lock "refresh_cache-da10dadd-b04a-4f3b-92bd-fcaa18b51fce" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Acquired lock "refresh_cache-da10dadd-b04a-4f3b-92bd-fcaa18b51fce" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.network.neutron [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.compute.manager [req-fe4bb7fe-3589-4790-b671-8ce85d29b9a5 req-9dd9a5f3-f326-4bc3-bbea-ed40ea3bb53c service nova] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Received event network-changed-63a93574-ffa2-45a1-9a42-b93779f1d7bb {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.compute.manager [req-fe4bb7fe-3589-4790-b671-8ce85d29b9a5 req-9dd9a5f3-f326-4bc3-bbea-ed40ea3bb53c service nova] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Refreshing instance network info cache due to event network-changed-63a93574-ffa2-45a1-9a42-b93779f1d7bb. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-fe4bb7fe-3589-4790-b671-8ce85d29b9a5 req-9dd9a5f3-f326-4bc3-bbea-ed40ea3bb53c service nova] Acquiring lock "refresh_cache-da10dadd-b04a-4f3b-92bd-fcaa18b51fce" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37104018-4e, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37104018-4e, col_values=(('qos', UUID('b4fb3003-4974-487f-be26-561befefc704')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37104018-4e, col_values=(('external_ids', {'iface-id': '37104018-4ea0-4b2f-b507-8887a4f7348a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:b6:d9', 'vm-uuid': 'adfc9441-d607-4b9f-8008-95e42f1ac51e'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.203s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffa99aa-6b31-4ec4-b60f-9c1c1c4265c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8, portal: 172.16.0.220,3260]
Nov 02 01:36:35 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8, portal: 172.16.0.220,3260] successful.
Nov 02 01:36:35 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2d2b5c-217f-4adc-8873-96ab27c43d0b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: INFO os_vif [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:b6:d9,bridge_name='br-int',has_traffic_filtering=True,id=37104018-4ea0-4b2f-b507-8887a4f7348a,network=Network(a16e25af-6044-4089-8641-2b184d9e13b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37104018-4e')
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2013159103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2013159103',id=16,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjPh1tYKHTOH/pGrIpH4Vnubbyf2JsMVF1j+/2RGvozo0HqHWCbSS+Du5081BPYO/UtSiHfiCCf4AM6VV/EbbE3fWTf+keq4ZAqlefVkN1Xv7HHB/RbZQGr5ddsosvM3Q==',key_name='tempest-keypair-130817105',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f98a3a508c5c4966806cb9352c4b9090',ramdisk_id='',reservation_id='r-h1s4ky3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-997890989',owner_user_name='tempest-TaggedBootDevicesTest-997890989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:34:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47029fcd5f04869ab686e226867793c',uuid=adfc9441-d607-4b9f-8008-95e42f1ac51e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ade5deb-e2db-4310-b1a6-df399639eb00", "address": "fa:16:3e:22:42:a5", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ade5deb-e2", "ovs_interfaceid": "3ade5deb-e2db-4310-b1a6-df399639eb00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converting VIF {"id": "3ade5deb-e2db-4310-b1a6-df399639eb00", "address": "fa:16:3e:22:42:a5", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ade5deb-e2", "ovs_interfaceid": "3ade5deb-e2db-4310-b1a6-df399639eb00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:42:a5,bridge_name='br-int',has_traffic_filtering=True,id=3ade5deb-e2db-4310-b1a6-df399639eb00,network=Network(a16e25af-6044-4089-8641-2b184d9e13b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ade5deb-e2') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG os_vif [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:42:a5,bridge_name='br-int',has_traffic_filtering=True,id=3ade5deb-e2db-4310-b1a6-df399639eb00,network=Network(a16e25af-6044-4089-8641-2b184d9e13b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ade5deb-e2') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0f40376-4c8f-5258-8d42-31d796e300ab', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee74ce8b-5205-46bd-8adb-f416a34bd7aa]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:36:35 user nova-compute[74996]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:36:35 user nova-compute[74996]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)
Nov 02 01:36:35 user nova-compute[74996]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:36:35 user nova-compute[74996]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:36:35 user nova-compute[74996]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)
Nov 02 01:36:35 user nova-compute[74996]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:36:35 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:36:35 user nova-compute[74996]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:36:35 user nova-compute[74996]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)
Nov 02 01:36:35 user nova-compute[74996]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:36:35 user nova-compute[74996]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:36:35 user nova-compute[74996]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)
Nov 02 01:36:35 user nova-compute[74996]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:36:35 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.533s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] HCTL ('39', '-', '-', 0) found on session 18 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8a8db5-f86a-4f50-9888-5635341778f2]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Searching for a device in session 18 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qenFIiNA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ade5deb-e2, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ade5deb-e2, col_values=(('qos', UUID('dfc9dc6c-a2b8-4f55-9ab5-6eeeaaf700ac')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ade5deb-e2, col_values=(('external_ids', {'iface-id': '3ade5deb-e2db-4310-b1a6-df399639eb00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:42:a5', 'vm-uuid': 'adfc9441-d607-4b9f-8008-95e42f1ac51e'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.network.neutron [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: INFO os_vif [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:42:a5,bridge_name='br-int',has_traffic_filtering=True,id=3ade5deb-e2db-4310-b1a6-df399639eb00,network=Network(a16e25af-6044-4089-8641-2b184d9e13b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ade5deb-e2')
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2013159103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2013159103',id=16,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjPh1tYKHTOH/pGrIpH4Vnubbyf2JsMVF1j+/2RGvozo0HqHWCbSS+Du5081BPYO/UtSiHfiCCf4AM6VV/EbbE3fWTf+keq4ZAqlefVkN1Xv7HHB/RbZQGr5ddsosvM3Q==',key_name='tempest-keypair-130817105',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f98a3a508c5c4966806cb9352c4b9090',ramdisk_id='',reservation_id='r-h1s4ky3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-997890989',owner_user_name='tempest-TaggedBootDevicesTest-997890989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:34:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47029fcd5f04869ab686e226867793c',uuid=adfc9441-d607-4b9f-8008-95e42f1ac51e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9042d944-67c5-4e39-9232-72ff23c6f1e0", "address": "fa:16:3e:05:b8:e8", "network": {"id": "9778b912-7b91-4a57-a5d6-fa3e8fd1016c", "bridge": "br-int", "label": "tempest-device-tagging-net2-519483991", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9042d944-67", "ovs_interfaceid": "9042d944-67c5-4e39-9232-72ff23c6f1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converting VIF {"id": "9042d944-67c5-4e39-9232-72ff23c6f1e0", "address": "fa:16:3e:05:b8:e8", "network": {"id": "9778b912-7b91-4a57-a5d6-fa3e8fd1016c", "bridge": "br-int", "label": "tempest-device-tagging-net2-519483991", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9042d944-67", "ovs_interfaceid": "9042d944-67c5-4e39-9232-72ff23c6f1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:b8:e8,bridge_name='br-int',has_traffic_filtering=True,id=9042d944-67c5-4e39-9232-72ff23c6f1e0,network=Network(9778b912-7b91-4a57-a5d6-fa3e8fd1016c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9042d944-67') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG os_vif [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:b8:e8,bridge_name='br-int',has_traffic_filtering=True,id=9042d944-67c5-4e39-9232-72ff23c6f1e0,network=Network(9778b912-7b91-4a57-a5d6-fa3e8fd1016c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9042d944-67') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1cfa6c9a-1cd6-55cf-ac8f-9971e9f37709', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9042d944-67, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9042d944-67, col_values=(('qos', UUID('cd4a4b92-796b-47ac-ad97-64c20b7ea856')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9042d944-67, col_values=(('external_ids', {'iface-id': '9042d944-67c5-4e39-9232-72ff23c6f1e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:b8:e8', 'vm-uuid': 'adfc9441-d607-4b9f-8008-95e42f1ac51e'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: INFO os_vif [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:b8:e8,bridge_name='br-int',has_traffic_filtering=True,id=9042d944-67c5-4e39-9232-72ff23c6f1e0,network=Network(9778b912-7b91-4a57-a5d6-fa3e8fd1016c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9042d944-67')
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2013159103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2013159103',id=16,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjPh1tYKHTOH/pGrIpH4Vnubbyf2JsMVF1j+/2RGvozo0HqHWCbSS+Du5081BPYO/UtSiHfiCCf4AM6VV/EbbE3fWTf+keq4ZAqlefVkN1Xv7HHB/RbZQGr5ddsosvM3Q==',key_name='tempest-keypair-130817105',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f98a3a508c5c4966806cb9352c4b9090',ramdisk_id='',reservation_id='r-h1s4ky3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-997890989',owner_user_name='tempest-TaggedBootDevicesTest-997890989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:34:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47029fcd5f04869ab686e226867793c',uuid=adfc9441-d607-4b9f-8008-95e42f1ac51e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87bf8398-6ede-4465-9555-1000f74e75ff", "address": "fa:16:3e:67:28:a7", "network": {"id": "9778b912-7b91-4a57-a5d6-fa3e8fd1016c", "bridge": "br-int", "label": "tempest-device-tagging-net2-519483991", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87bf8398-6e", "ovs_interfaceid": "87bf8398-6ede-4465-9555-1000f74e75ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converting VIF {"id": "87bf8398-6ede-4465-9555-1000f74e75ff", "address": "fa:16:3e:67:28:a7", "network": {"id": "9778b912-7b91-4a57-a5d6-fa3e8fd1016c", "bridge": "br-int", "label": "tempest-device-tagging-net2-519483991", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87bf8398-6e", "ovs_interfaceid": "87bf8398-6ede-4465-9555-1000f74e75ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:28:a7,bridge_name='br-int',has_traffic_filtering=True,id=87bf8398-6ede-4465-9555-1000f74e75ff,network=Network(9778b912-7b91-4a57-a5d6-fa3e8fd1016c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87bf8398-6e') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG os_vif [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:28:a7,bridge_name='br-int',has_traffic_filtering=True,id=87bf8398-6ede-4465-9555-1000f74e75ff,network=Network(9778b912-7b91-4a57-a5d6-fa3e8fd1016c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87bf8398-6e') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9744e0d0-7b63-5da1-8d4d-01042c88e3b4', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.network.neutron [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Updating instance_info_cache with network_info: [{"id": "63a93574-ffa2-45a1-9a42-b93779f1d7bb", "address": "fa:16:3e:f8:1e:be", "network": {"id": "2a051be1-8b15-49b1-8686-7da5c3825033", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1021749906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4094553af48241d9896971038ca4560c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63a93574-ff", "ovs_interfaceid": "63a93574-ffa2-45a1-9a42-b93779f1d7bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Releasing lock "refresh_cache-da10dadd-b04a-4f3b-92bd-fcaa18b51fce" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.compute.manager [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Instance network_info: |[{"id": "63a93574-ffa2-45a1-9a42-b93779f1d7bb", "address": "fa:16:3e:f8:1e:be", "network": {"id": "2a051be1-8b15-49b1-8686-7da5c3825033", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1021749906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4094553af48241d9896971038ca4560c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63a93574-ff", "ovs_interfaceid": "63a93574-ffa2-45a1-9a42-b93779f1d7bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-fe4bb7fe-3589-4790-b671-8ce85d29b9a5 req-9dd9a5f3-f326-4bc3-bbea-ed40ea3bb53c service nova] Acquired lock "refresh_cache-da10dadd-b04a-4f3b-92bd-fcaa18b51fce" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.network.neutron [req-fe4bb7fe-3589-4790-b671-8ce85d29b9a5 req-9dd9a5f3-f326-4bc3-bbea-ed40ea3bb53c service nova] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Refreshing network info cache for port 63a93574-ffa2-45a1-9a42-b93779f1d7bb {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Start _get_guest_xml network_info=[{"id": "63a93574-ffa2-45a1-9a42-b93779f1d7bb", "address": "fa:16:3e:f8:1e:be", "network": {"id": "2a051be1-8b15-49b1-8686-7da5c3825033", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1021749906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4094553af48241d9896971038ca4560c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63a93574-ff", "ovs_interfaceid": "63a93574-ffa2-45a1-9a42-b93779f1d7bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87bf8398-6e, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap87bf8398-6e, col_values=(('qos', UUID('2b0cb9ad-9e60-40cd-8b22-4f960909d468')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap87bf8398-6e, col_values=(('external_ids', {'iface-id': '87bf8398-6ede-4465-9555-1000f74e75ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:28:a7', 'vm-uuid': 'adfc9441-d607-4b9f-8008-95e42f1ac51e'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:36:35 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:36:35 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-648562890',display_name='tempest-TestServerVolumeAttachmentScenario-server-648562890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-648562890',id=18,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO41NR7dPdT4RGwBW5jxFL3kBGYDG0YElffqYyIwWiPntUjo1FCFsJCxkQa3rgp98mOxJ37aBJEltK4AxTaDzRyq9atWaJE2SR1gZFN0Fz5mvmiqxAdQoj4trhh8dPDfKQ==',key_name='tempest-keypair-933157162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4094553af48241d9896971038ca4560c',ramdisk_id='',reservation_id='r-6s61vrzs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-125699075',owner_user_name='tempest-TestServerVolumeAttachmentScenario-125699075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:36:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4722252fe05d42e7844123dfa5899718',uuid=da10dadd-b04a-4f3b-92bd-fcaa18b51fce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63a93574-ffa2-45a1-9a42-b93779f1d7bb", "address": "fa:16:3e:f8:1e:be", "network": {"id": "2a051be1-8b15-49b1-8686-7da5c3825033", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1021749906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4094553af48241d9896971038ca4560c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63a93574-ff", "ovs_interfaceid": "63a93574-ffa2-45a1-9a42-b93779f1d7bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Converting VIF {"id": "63a93574-ffa2-45a1-9a42-b93779f1d7bb", "address": "fa:16:3e:f8:1e:be", "network": {"id": "2a051be1-8b15-49b1-8686-7da5c3825033", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1021749906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4094553af48241d9896971038ca4560c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63a93574-ff", "ovs_interfaceid": "63a93574-ffa2-45a1-9a42-b93779f1d7bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:1e:be,bridge_name='br-int',has_traffic_filtering=True,id=63a93574-ffa2-45a1-9a42-b93779f1d7bb,network=Network(2a051be1-8b15-49b1-8686-7da5c3825033),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63a93574-ff') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG nova.objects.instance [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lazy-loading 'pci_devices' on Instance uuid da10dadd-b04a-4f3b-92bd-fcaa18b51fce {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:36:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:36:36 user nova-compute[74996]:   <uuid>da10dadd-b04a-4f3b-92bd-fcaa18b51fce</uuid>
Nov 02 01:36:36 user nova-compute[74996]:   <name>instance-00000012</name>
Nov 02 01:36:36 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:36:36 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:36:36 user nova-compute[74996]:   <metadata>
Nov 02 01:36:36 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:36:36 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:36:36 user nova-compute[74996]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-648562890</nova:name>
Nov 02 01:36:36 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:36:35</nova:creationTime>
Nov 02 01:36:36 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:36:36 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:36:36 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:36:36 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:36:36 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:36:36 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:36:36 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:36:36 user nova-compute[74996]:       <nova:owner>
Nov 02 01:36:36 user nova-compute[74996]:         <nova:user uuid="4722252fe05d42e7844123dfa5899718">tempest-TestServerVolumeAttachmentScenario-125699075-project-member</nova:user>
Nov 02 01:36:36 user nova-compute[74996]:         <nova:project uuid="4094553af48241d9896971038ca4560c">tempest-TestServerVolumeAttachmentScenario-125699075</nova:project>
Nov 02 01:36:36 user nova-compute[74996]:       </nova:owner>
Nov 02 01:36:36 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:36:36 user nova-compute[74996]:       <nova:ports>
Nov 02 01:36:36 user nova-compute[74996]:         <nova:port uuid="63a93574-ffa2-45a1-9a42-b93779f1d7bb">
Nov 02 01:36:36 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 01:36:36 user nova-compute[74996]:         </nova:port>
Nov 02 01:36:36 user nova-compute[74996]:       </nova:ports>
Nov 02 01:36:36 user nova-compute[74996]:     </nova:instance>
Nov 02 01:36:36 user nova-compute[74996]:   </metadata>
Nov 02 01:36:36 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:36:36 user nova-compute[74996]:     <system>
Nov 02 01:36:36 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:36:36 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:36:36 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:36:36 user nova-compute[74996]:       <entry name="serial">da10dadd-b04a-4f3b-92bd-fcaa18b51fce</entry>
Nov 02 01:36:36 user nova-compute[74996]:       <entry name="uuid">da10dadd-b04a-4f3b-92bd-fcaa18b51fce</entry>
Nov 02 01:36:36 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:36:36 user nova-compute[74996]:     </system>
Nov 02 01:36:36 user nova-compute[74996]:   </sysinfo>
Nov 02 01:36:36 user nova-compute[74996]:   <os>
Nov 02 01:36:36 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:36:36 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:36:36 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:36:36 user nova-compute[74996]:   </os>
Nov 02 01:36:36 user nova-compute[74996]:   <features>
Nov 02 01:36:36 user nova-compute[74996]:     <acpi/>
Nov 02 01:36:36 user nova-compute[74996]:     <apic/>
Nov 02 01:36:36 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:36:36 user nova-compute[74996]:   </features>
Nov 02 01:36:36 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:36:36 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:36:36 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:36:36 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:36:36 user nova-compute[74996]:   </clock>
Nov 02 01:36:36 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:36:36 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:36:36 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:36:36 user nova-compute[74996]:   </cpu>
Nov 02 01:36:36 user nova-compute[74996]:   <devices>
Nov 02 01:36:36 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:36:36 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:36:36 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce/disk"/>
Nov 02 01:36:36 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:36:36 user nova-compute[74996]:     </disk>
Nov 02 01:36:36 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:36:36 user nova-compute[74996]:       <mac address="fa:16:3e:f8:1e:be"/>
Nov 02 01:36:36 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:36:36 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:36:36 user nova-compute[74996]:       <target dev="tap63a93574-ff"/>
Nov 02 01:36:36 user nova-compute[74996]:     </interface>
Nov 02 01:36:36 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:36:36 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce/console.log" append="off"/>
Nov 02 01:36:36 user nova-compute[74996]:     </serial>
Nov 02 01:36:36 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:36:36 user nova-compute[74996]:     <video>
Nov 02 01:36:36 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:36:36 user nova-compute[74996]:     </video>
Nov 02 01:36:36 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:36:36 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:36:36 user nova-compute[74996]:     </rng>
Nov 02 01:36:36 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:36:36 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:36:36 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:36:36 user nova-compute[74996]:     </memballoon>
Nov 02 01:36:36 user nova-compute[74996]:   </devices>
Nov 02 01:36:36 user nova-compute[74996]: </domain>
Nov 02 01:36:36 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-648562890',display_name='tempest-TestServerVolumeAttachmentScenario-server-648562890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-648562890',id=18,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO41NR7dPdT4RGwBW5jxFL3kBGYDG0YElffqYyIwWiPntUjo1FCFsJCxkQa3rgp98mOxJ37aBJEltK4AxTaDzRyq9atWaJE2SR1gZFN0Fz5mvmiqxAdQoj4trhh8dPDfKQ==',key_name='tempest-keypair-933157162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4094553af48241d9896971038ca4560c',ramdisk_id='',reservation_id='r-6s61vrzs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-125699075',owner_user_name='tempest-TestServerVolumeAttachmentScenario-125699075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:36:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4722252fe05d42e7844123dfa5899718',uuid=da10dadd-b04a-4f3b-92bd-fcaa18b51fce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63a93574-ffa2-45a1-9a42-b93779f1d7bb", "address": "fa:16:3e:f8:1e:be", "network": {"id": "2a051be1-8b15-49b1-8686-7da5c3825033", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1021749906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4094553af48241d9896971038ca4560c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63a93574-ff", "ovs_interfaceid": "63a93574-ffa2-45a1-9a42-b93779f1d7bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Converting VIF {"id": "63a93574-ffa2-45a1-9a42-b93779f1d7bb", "address": "fa:16:3e:f8:1e:be", "network": {"id": "2a051be1-8b15-49b1-8686-7da5c3825033", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1021749906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4094553af48241d9896971038ca4560c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63a93574-ff", "ovs_interfaceid": "63a93574-ffa2-45a1-9a42-b93779f1d7bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:1e:be,bridge_name='br-int',has_traffic_filtering=True,id=63a93574-ffa2-45a1-9a42-b93779f1d7bb,network=Network(2a051be1-8b15-49b1-8686-7da5c3825033),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63a93574-ff') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG os_vif [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:1e:be,bridge_name='br-int',has_traffic_filtering=True,id=63a93574-ffa2-45a1-9a42-b93779f1d7bb,network=Network(2a051be1-8b15-49b1-8686-7da5c3825033),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63a93574-ff') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:36 user nova-compute[74996]: INFO os_vif [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:28:a7,bridge_name='br-int',has_traffic_filtering=True,id=87bf8398-6ede-4465-9555-1000f74e75ff,network=Network(9778b912-7b91-4a57-a5d6-fa3e8fd1016c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87bf8398-6e')
Nov 02 01:36:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ecd449ef-0014-513d-a04d-841d0b69929b', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] No BDM found with device name hda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] No VIF found with MAC fa:16:3e:17:b8:62, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] No VIF found with MAC fa:16:3e:22:42:a5, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:36:36 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Using config drive
Nov 02 01:36:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63a93574-ff, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63a93574-ff, col_values=(('qos', UUID('c57cb7fe-85c4-436a-a057-dba1fb406732')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63a93574-ff, col_values=(('external_ids', {'iface-id': '63a93574-ffa2-45a1-9a42-b93779f1d7bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:1e:be', 'vm-uuid': 'da10dadd-b04a-4f3b-92bd-fcaa18b51fce'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:36 user nova-compute[74996]: INFO os_vif [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:1e:be,bridge_name='br-int',has_traffic_filtering=True,id=63a93574-ffa2-45a1-9a42-b93779f1d7bb,network=Network(2a051be1-8b15-49b1-8686-7da5c3825033),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63a93574-ff')
Nov 02 01:36:36 user nova-compute[74996]: DEBUG nova.network.neutron [req-fe4bb7fe-3589-4790-b671-8ce85d29b9a5 req-9dd9a5f3-f326-4bc3-bbea-ed40ea3bb53c service nova] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Updated VIF entry in instance network info cache for port 63a93574-ffa2-45a1-9a42-b93779f1d7bb. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG nova.network.neutron [req-fe4bb7fe-3589-4790-b671-8ce85d29b9a5 req-9dd9a5f3-f326-4bc3-bbea-ed40ea3bb53c service nova] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Updating instance_info_cache with network_info: [{"id": "63a93574-ffa2-45a1-9a42-b93779f1d7bb", "address": "fa:16:3e:f8:1e:be", "network": {"id": "2a051be1-8b15-49b1-8686-7da5c3825033", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1021749906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4094553af48241d9896971038ca4560c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63a93574-ff", "ovs_interfaceid": "63a93574-ffa2-45a1-9a42-b93779f1d7bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-fe4bb7fe-3589-4790-b671-8ce85d29b9a5 req-9dd9a5f3-f326-4bc3-bbea-ed40ea3bb53c service nova] Releasing lock "refresh_cache-da10dadd-b04a-4f3b-92bd-fcaa18b51fce" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] No VIF found with MAC fa:16:3e:f8:1e:be, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:36:36 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Creating config drive at /opt/stack/data/nova/instances/adfc9441-d607-4b9f-8008-95e42f1ac51e/disk.config
Nov 02 01:36:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/adfc9441-d607-4b9f-8008-95e42f1ac51e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp95voneb5 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/adfc9441-d607-4b9f-8008-95e42f1ac51e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp95voneb5" returned: 0 in 0.064s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.577s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] <== connect_volume: return (2976ms) {'type': 'block', 'scsi_wwn': '23937633833306261', 'path': '/dev/sdh'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937633833306261', 'path': '/dev/sdh'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG nova.objects.instance [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lazy-loading 'flavor' on Instance uuid 6b79aa2f-02c7-492e-b27e-7481e41f8d2c {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 01:36:36 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:36:36 user nova-compute[74996]:   <source dev="/dev/sdh"/>
Nov 02 01:36:36 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:36:36 user nova-compute[74996]:   <serial>cd193bfc-2f88-478c-b7f3-e67be6cfe3b8</serial>
Nov 02 01:36:36 user nova-compute[74996]: </disk>
Nov 02 01:36:36 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 01:36:36 user nova-compute[74996]: DEBUG nova.compute.manager [None req-3b654062-4c28-4ea5-b4f8-f299c8b4b3b9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:36:36 user nova-compute[74996]: INFO nova.compute.manager [None req-3b654062-4c28-4ea5-b4f8-f299c8b4b3b9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] instance snapshotting
Nov 02 01:36:36 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-3b654062-4c28-4ea5-b4f8-f299c8b4b3b9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Beginning live snapshot process
Nov 02 01:36:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3b654062-4c28-4ea5-b4f8-f299c8b4b3b9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json -f qcow2 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3b654062-4c28-4ea5-b4f8-f299c8b4b3b9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3b654062-4c28-4ea5-b4f8-f299c8b4b3b9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json -f qcow2 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:37 user nova-compute[74996]: DEBUG nova.compute.manager [req-4bb08004-2f36-4207-bf7d-db9410ccc7ea req-19246bf7-0bd1-4cdf-a676-b8495cd0a536 service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Received event network-vif-plugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4bb08004-2f36-4207-bf7d-db9410ccc7ea req-19246bf7-0bd1-4cdf-a676-b8495cd0a536 service nova] Acquiring lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4bb08004-2f36-4207-bf7d-db9410ccc7ea req-19246bf7-0bd1-4cdf-a676-b8495cd0a536 service nova] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4bb08004-2f36-4207-bf7d-db9410ccc7ea req-19246bf7-0bd1-4cdf-a676-b8495cd0a536 service nova] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:37 user nova-compute[74996]: DEBUG nova.compute.manager [req-4bb08004-2f36-4207-bf7d-db9410ccc7ea req-19246bf7-0bd1-4cdf-a676-b8495cd0a536 service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] No waiting events found dispatching network-vif-plugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:36:37 user nova-compute[74996]: WARNING nova.compute.manager [req-4bb08004-2f36-4207-bf7d-db9410ccc7ea req-19246bf7-0bd1-4cdf-a676-b8495cd0a536 service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Received unexpected event network-vif-plugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad for instance with vm_state resized and task_state resize_reverting.
Nov 02 01:36:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:36:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:36:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] No VIF found with MAC fa:16:3e:16:c6:b4, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:36:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3b654062-4c28-4ea5-b4f8-f299c8b4b3b9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3b654062-4c28-4ea5-b4f8-f299c8b4b3b9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:37 user nova-compute[74996]: DEBUG nova.compute.manager [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:36:37 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Instance running successfully.
Nov 02 01:36:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] finish_revert_migration finished successfully. {{(pid=74996) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 02 01:36:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c9bd385-aa71-48b6-a432-9cd4fbb7a5f0 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "6b79aa2f-02c7-492e-b27e-7481e41f8d2c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.244s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3b654062-4c28-4ea5-b4f8-f299c8b4b3b9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.200s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3b654062-4c28-4ea5-b4f8-f299c8b4b3b9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpb5h_5_om/4e6dd5c13136480b940884357367b2ae.delta 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3b654062-4c28-4ea5-b4f8-f299c8b4b3b9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpb5h_5_om/4e6dd5c13136480b940884357367b2ae.delta 1073741824" returned: 0 in 0.063s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:37 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-3b654062-4c28-4ea5-b4f8-f299c8b4b3b9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 02 01:36:37 user nova-compute[74996]: INFO nova.compute.manager [None req-b85ccdae-6ebc-42df-b3c6-53e02badfd23 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Updating instance to original state: 'active'
Nov 02 01:36:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-3b654062-4c28-4ea5-b4f8-f299c8b4b3b9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74996) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 01:36:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-3b654062-4c28-4ea5-b4f8-f299c8b4b3b9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] COPY block job progress, current cursor: 22085632 final cursor: 75497472 {{(pid=74996) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 01:36:40 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-3b654062-4c28-4ea5-b4f8-f299c8b4b3b9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74996) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 01:36:40 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-3b654062-4c28-4ea5-b4f8-f299c8b4b3b9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 02 01:36:40 user nova-compute[74996]: DEBUG nova.privsep.utils [None req-3b654062-4c28-4ea5-b4f8-f299c8b4b3b9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74996) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 01:36:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3b654062-4c28-4ea5-b4f8-f299c8b4b3b9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpb5h_5_om/4e6dd5c13136480b940884357367b2ae.delta /opt/stack/data/nova/instances/snapshots/tmpb5h_5_om/4e6dd5c13136480b940884357367b2ae {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3b654062-4c28-4ea5-b4f8-f299c8b4b3b9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpb5h_5_om/4e6dd5c13136480b940884357367b2ae.delta /opt/stack/data/nova/instances/snapshots/tmpb5h_5_om/4e6dd5c13136480b940884357367b2ae" returned: 0 in 0.755s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:40 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-3b654062-4c28-4ea5-b4f8-f299c8b4b3b9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Snapshot extracted, beginning image upload
Nov 02 01:36:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:41 user nova-compute[74996]: DEBUG nova.compute.manager [req-3d7722fb-8b36-467d-bfdb-ecbdb915af69 req-8335b6af-2d22-402d-9bbb-479c050b1e87 service nova] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Received event network-vif-plugged-63a93574-ffa2-45a1-9a42-b93779f1d7bb {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3d7722fb-8b36-467d-bfdb-ecbdb915af69 req-8335b6af-2d22-402d-9bbb-479c050b1e87 service nova] Acquiring lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3d7722fb-8b36-467d-bfdb-ecbdb915af69 req-8335b6af-2d22-402d-9bbb-479c050b1e87 service nova] Lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3d7722fb-8b36-467d-bfdb-ecbdb915af69 req-8335b6af-2d22-402d-9bbb-479c050b1e87 service nova] Lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:41 user nova-compute[74996]: DEBUG nova.compute.manager [req-3d7722fb-8b36-467d-bfdb-ecbdb915af69 req-8335b6af-2d22-402d-9bbb-479c050b1e87 service nova] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] No waiting events found dispatching network-vif-plugged-63a93574-ffa2-45a1-9a42-b93779f1d7bb {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:36:41 user nova-compute[74996]: WARNING nova.compute.manager [req-3d7722fb-8b36-467d-bfdb-ecbdb915af69 req-8335b6af-2d22-402d-9bbb-479c050b1e87 service nova] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Received unexpected event network-vif-plugged-63a93574-ffa2-45a1-9a42-b93779f1d7bb for instance with vm_state building and task_state spawning.
Nov 02 01:36:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:41 user nova-compute[74996]: DEBUG nova.compute.manager [req-446a3cf8-ea7c-4b27-a205-a0ab6ed4efbc req-3daf8c21-a2a9-4d16-bd88-0b63209864e3 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-plugged-863ea8b0-7e3d-459a-bfb7-435e3e5001bf {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-446a3cf8-ea7c-4b27-a205-a0ab6ed4efbc req-3daf8c21-a2a9-4d16-bd88-0b63209864e3 service nova] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-446a3cf8-ea7c-4b27-a205-a0ab6ed4efbc req-3daf8c21-a2a9-4d16-bd88-0b63209864e3 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-446a3cf8-ea7c-4b27-a205-a0ab6ed4efbc req-3daf8c21-a2a9-4d16-bd88-0b63209864e3 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:41 user nova-compute[74996]: DEBUG nova.compute.manager [req-446a3cf8-ea7c-4b27-a205-a0ab6ed4efbc req-3daf8c21-a2a9-4d16-bd88-0b63209864e3 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] No waiting events found dispatching network-vif-plugged-863ea8b0-7e3d-459a-bfb7-435e3e5001bf {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:36:41 user nova-compute[74996]: WARNING nova.compute.manager [req-446a3cf8-ea7c-4b27-a205-a0ab6ed4efbc req-3daf8c21-a2a9-4d16-bd88-0b63209864e3 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received unexpected event network-vif-plugged-863ea8b0-7e3d-459a-bfb7-435e3e5001bf for instance with vm_state building and task_state spawning.
Nov 02 01:36:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b1f61923-e59f-42a1-8fd8-57dca5711ec9 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Acquiring lock "2621c5a2-acff-4055-9746-1b2f5829b39d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b1f61923-e59f-42a1-8fd8-57dca5711ec9 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "2621c5a2-acff-4055-9746-1b2f5829b39d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b1f61923-e59f-42a1-8fd8-57dca5711ec9 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Acquiring lock "2621c5a2-acff-4055-9746-1b2f5829b39d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b1f61923-e59f-42a1-8fd8-57dca5711ec9 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "2621c5a2-acff-4055-9746-1b2f5829b39d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b1f61923-e59f-42a1-8fd8-57dca5711ec9 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "2621c5a2-acff-4055-9746-1b2f5829b39d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:42 user nova-compute[74996]: INFO nova.compute.manager [None req-b1f61923-e59f-42a1-8fd8-57dca5711ec9 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Terminating instance
Nov 02 01:36:42 user nova-compute[74996]: DEBUG nova.compute.manager [None req-b1f61923-e59f-42a1-8fd8-57dca5711ec9 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:36:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:42 user nova-compute[74996]: DEBUG nova.compute.manager [req-d7797430-ebfe-48b0-8fb6-dbadd960a646 req-c1ad8e30-5ec7-4831-8732-f00d85506a51 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-plugged-019034ca-6f89-400f-b47a-61e1157f860f {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d7797430-ebfe-48b0-8fb6-dbadd960a646 req-c1ad8e30-5ec7-4831-8732-f00d85506a51 service nova] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d7797430-ebfe-48b0-8fb6-dbadd960a646 req-c1ad8e30-5ec7-4831-8732-f00d85506a51 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d7797430-ebfe-48b0-8fb6-dbadd960a646 req-c1ad8e30-5ec7-4831-8732-f00d85506a51 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:42 user nova-compute[74996]: DEBUG nova.compute.manager [req-d7797430-ebfe-48b0-8fb6-dbadd960a646 req-c1ad8e30-5ec7-4831-8732-f00d85506a51 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] No waiting events found dispatching network-vif-plugged-019034ca-6f89-400f-b47a-61e1157f860f {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:36:42 user nova-compute[74996]: WARNING nova.compute.manager [req-d7797430-ebfe-48b0-8fb6-dbadd960a646 req-c1ad8e30-5ec7-4831-8732-f00d85506a51 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received unexpected event network-vif-plugged-019034ca-6f89-400f-b47a-61e1157f860f for instance with vm_state building and task_state spawning.
Nov 02 01:36:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-06b7f348-6c30-41d7-9767-54263fc6b863 req-3a808d98-938f-4e71-b045-3077577a42a6 service nova] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Received event network-vif-plugged-63a93574-ffa2-45a1-9a42-b93779f1d7bb {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-06b7f348-6c30-41d7-9767-54263fc6b863 req-3a808d98-938f-4e71-b045-3077577a42a6 service nova] Acquiring lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-06b7f348-6c30-41d7-9767-54263fc6b863 req-3a808d98-938f-4e71-b045-3077577a42a6 service nova] Lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-06b7f348-6c30-41d7-9767-54263fc6b863 req-3a808d98-938f-4e71-b045-3077577a42a6 service nova] Lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-06b7f348-6c30-41d7-9767-54263fc6b863 req-3a808d98-938f-4e71-b045-3077577a42a6 service nova] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] No waiting events found dispatching network-vif-plugged-63a93574-ffa2-45a1-9a42-b93779f1d7bb {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:36:43 user nova-compute[74996]: WARNING nova.compute.manager [req-06b7f348-6c30-41d7-9767-54263fc6b863 req-3a808d98-938f-4e71-b045-3077577a42a6 service nova] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Received unexpected event network-vif-plugged-63a93574-ffa2-45a1-9a42-b93779f1d7bb for instance with vm_state building and task_state spawning.
Nov 02 01:36:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-06b7f348-6c30-41d7-9767-54263fc6b863 req-3a808d98-938f-4e71-b045-3077577a42a6 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-plugged-62492819-8da0-4a9f-9f78-facaaa194017 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-06b7f348-6c30-41d7-9767-54263fc6b863 req-3a808d98-938f-4e71-b045-3077577a42a6 service nova] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-06b7f348-6c30-41d7-9767-54263fc6b863 req-3a808d98-938f-4e71-b045-3077577a42a6 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-06b7f348-6c30-41d7-9767-54263fc6b863 req-3a808d98-938f-4e71-b045-3077577a42a6 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-06b7f348-6c30-41d7-9767-54263fc6b863 req-3a808d98-938f-4e71-b045-3077577a42a6 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] No waiting events found dispatching network-vif-plugged-62492819-8da0-4a9f-9f78-facaaa194017 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:36:43 user nova-compute[74996]: WARNING nova.compute.manager [req-06b7f348-6c30-41d7-9767-54263fc6b863 req-3a808d98-938f-4e71-b045-3077577a42a6 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received unexpected event network-vif-plugged-62492819-8da0-4a9f-9f78-facaaa194017 for instance with vm_state building and task_state spawning.
Nov 02 01:36:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-06b7f348-6c30-41d7-9767-54263fc6b863 req-3a808d98-938f-4e71-b045-3077577a42a6 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-plugged-62492819-8da0-4a9f-9f78-facaaa194017 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-06b7f348-6c30-41d7-9767-54263fc6b863 req-3a808d98-938f-4e71-b045-3077577a42a6 service nova] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-06b7f348-6c30-41d7-9767-54263fc6b863 req-3a808d98-938f-4e71-b045-3077577a42a6 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-06b7f348-6c30-41d7-9767-54263fc6b863 req-3a808d98-938f-4e71-b045-3077577a42a6 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-06b7f348-6c30-41d7-9767-54263fc6b863 req-3a808d98-938f-4e71-b045-3077577a42a6 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] No waiting events found dispatching network-vif-plugged-62492819-8da0-4a9f-9f78-facaaa194017 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:36:43 user nova-compute[74996]: WARNING nova.compute.manager [req-06b7f348-6c30-41d7-9767-54263fc6b863 req-3a808d98-938f-4e71-b045-3077577a42a6 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received unexpected event network-vif-plugged-62492819-8da0-4a9f-9f78-facaaa194017 for instance with vm_state building and task_state spawning.
Nov 02 01:36:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-264a3084-4ade-49fd-b2e6-573acf3bf896 req-9c44efaf-1df5-4233-8f18-507c242242a0 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-plugged-863ea8b0-7e3d-459a-bfb7-435e3e5001bf {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-264a3084-4ade-49fd-b2e6-573acf3bf896 req-9c44efaf-1df5-4233-8f18-507c242242a0 service nova] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-264a3084-4ade-49fd-b2e6-573acf3bf896 req-9c44efaf-1df5-4233-8f18-507c242242a0 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-264a3084-4ade-49fd-b2e6-573acf3bf896 req-9c44efaf-1df5-4233-8f18-507c242242a0 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-264a3084-4ade-49fd-b2e6-573acf3bf896 req-9c44efaf-1df5-4233-8f18-507c242242a0 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] No waiting events found dispatching network-vif-plugged-863ea8b0-7e3d-459a-bfb7-435e3e5001bf {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:36:43 user nova-compute[74996]: WARNING nova.compute.manager [req-264a3084-4ade-49fd-b2e6-573acf3bf896 req-9c44efaf-1df5-4233-8f18-507c242242a0 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received unexpected event network-vif-plugged-863ea8b0-7e3d-459a-bfb7-435e3e5001bf for instance with vm_state building and task_state spawning.
Nov 02 01:36:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-264a3084-4ade-49fd-b2e6-573acf3bf896 req-9c44efaf-1df5-4233-8f18-507c242242a0 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-plugged-3ade5deb-e2db-4310-b1a6-df399639eb00 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-264a3084-4ade-49fd-b2e6-573acf3bf896 req-9c44efaf-1df5-4233-8f18-507c242242a0 service nova] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-264a3084-4ade-49fd-b2e6-573acf3bf896 req-9c44efaf-1df5-4233-8f18-507c242242a0 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-264a3084-4ade-49fd-b2e6-573acf3bf896 req-9c44efaf-1df5-4233-8f18-507c242242a0 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-264a3084-4ade-49fd-b2e6-573acf3bf896 req-9c44efaf-1df5-4233-8f18-507c242242a0 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] No waiting events found dispatching network-vif-plugged-3ade5deb-e2db-4310-b1a6-df399639eb00 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:36:43 user nova-compute[74996]: WARNING nova.compute.manager [req-264a3084-4ade-49fd-b2e6-573acf3bf896 req-9c44efaf-1df5-4233-8f18-507c242242a0 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received unexpected event network-vif-plugged-3ade5deb-e2db-4310-b1a6-df399639eb00 for instance with vm_state building and task_state spawning.
Nov 02 01:36:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-264a3084-4ade-49fd-b2e6-573acf3bf896 req-9c44efaf-1df5-4233-8f18-507c242242a0 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-plugged-3ade5deb-e2db-4310-b1a6-df399639eb00 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-264a3084-4ade-49fd-b2e6-573acf3bf896 req-9c44efaf-1df5-4233-8f18-507c242242a0 service nova] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-264a3084-4ade-49fd-b2e6-573acf3bf896 req-9c44efaf-1df5-4233-8f18-507c242242a0 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-264a3084-4ade-49fd-b2e6-573acf3bf896 req-9c44efaf-1df5-4233-8f18-507c242242a0 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-264a3084-4ade-49fd-b2e6-573acf3bf896 req-9c44efaf-1df5-4233-8f18-507c242242a0 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] No waiting events found dispatching network-vif-plugged-3ade5deb-e2db-4310-b1a6-df399639eb00 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:36:43 user nova-compute[74996]: WARNING nova.compute.manager [req-264a3084-4ade-49fd-b2e6-573acf3bf896 req-9c44efaf-1df5-4233-8f18-507c242242a0 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received unexpected event network-vif-plugged-3ade5deb-e2db-4310-b1a6-df399639eb00 for instance with vm_state building and task_state spawning.
Nov 02 01:36:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG nova.compute.manager [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:36:43 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Instance spawned successfully.
Nov 02 01:36:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:43 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Instance destroyed successfully.
Nov 02 01:36:43 user nova-compute[74996]: DEBUG nova.objects.instance [None req-b1f61923-e59f-42a1-8fd8-57dca5711ec9 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lazy-loading 'resources' on Instance uuid 2621c5a2-acff-4055-9746-1b2f5829b39d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-b1f61923-e59f-42a1-8fd8-57dca5711ec9 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:29:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-603939195',display_name='tempest-VolumesAdminNegativeTest-server-603939195',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-603939195',id=5,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAW0F9f6TDQcqJlm3J0zPG2j0UBnv2SWztmZTCCnSg9z3fYJ/TWFNOEtd49EX8JMMRemWCsC8Cm08rGumO7UZ/MhsM0MpHE0UuN7rQA8Ra9BV1xMDCq61t9QIuzJthGqjQ==',key_name='tempest-keypair-414965189',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:29:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f91486d1ff074f7599b5bc2e771e28d9',ramdisk_id='',reservation_id='r-2jfhtvei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1150311361',owner_user_name='tempest-VolumesAdminNegativeTest-1150311361-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:29:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='369a170aab0b4d3f9de0713b52798b72',uuid=2621c5a2-acff-4055-9746-1b2f5829b39d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c117844a-dde1-4486-940f-56b671a79d69", "address": "fa:16:3e:90:c7:2d", "network": {"id": "8bca3600-c671-4a05-9913-14a9531365d1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2106930518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91486d1ff074f7599b5bc2e771e28d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc117844a-dd", "ovs_interfaceid": "c117844a-dde1-4486-940f-56b671a79d69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-b1f61923-e59f-42a1-8fd8-57dca5711ec9 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Converting VIF {"id": "c117844a-dde1-4486-940f-56b671a79d69", "address": "fa:16:3e:90:c7:2d", "network": {"id": "8bca3600-c671-4a05-9913-14a9531365d1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2106930518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f91486d1ff074f7599b5bc2e771e28d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc117844a-dd", "ovs_interfaceid": "c117844a-dde1-4486-940f-56b671a79d69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-b1f61923-e59f-42a1-8fd8-57dca5711ec9 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:c7:2d,bridge_name='br-int',has_traffic_filtering=True,id=c117844a-dde1-4486-940f-56b671a79d69,network=Network(8bca3600-c671-4a05-9913-14a9531365d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc117844a-dd') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG os_vif [None req-b1f61923-e59f-42a1-8fd8-57dca5711ec9 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:c7:2d,bridge_name='br-int',has_traffic_filtering=True,id=c117844a-dde1-4486-940f-56b671a79d69,network=Network(8bca3600-c671-4a05-9913-14a9531365d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc117844a-dd') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc117844a-dd, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8702ecd0-524e-4f06-bd0f-79c4240107cb) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:36:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:36:43 user nova-compute[74996]: INFO os_vif [None req-b1f61923-e59f-42a1-8fd8-57dca5711ec9 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:c7:2d,bridge_name='br-int',has_traffic_filtering=True,id=c117844a-dde1-4486-940f-56b671a79d69,network=Network(8bca3600-c671-4a05-9913-14a9531365d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc117844a-dd')
Nov 02 01:36:44 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-b1f61923-e59f-42a1-8fd8-57dca5711ec9 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Deleting instance files /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d_del
Nov 02 01:36:44 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-b1f61923-e59f-42a1-8fd8-57dca5711ec9 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Deletion of /opt/stack/data/nova/instances/2621c5a2-acff-4055-9746-1b2f5829b39d_del complete
Nov 02 01:36:44 user nova-compute[74996]: INFO nova.compute.manager [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Took 10.31 seconds to spawn the instance on the hypervisor.
Nov 02 01:36:44 user nova-compute[74996]: DEBUG nova.compute.manager [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:36:44 user nova-compute[74996]: INFO nova.compute.manager [None req-b1f61923-e59f-42a1-8fd8-57dca5711ec9 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Took 2.01 seconds to destroy the instance on the hypervisor.
Nov 02 01:36:44 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-b1f61923-e59f-42a1-8fd8-57dca5711ec9 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:36:44 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:36:44 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:36:44 user nova-compute[74996]: INFO nova.compute.manager [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Took 11.41 seconds to build instance.
Nov 02 01:36:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-465a383d-51e6-48a0-8f67-6a28dbec989b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.599s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "ac04bff6-90a5-439d-b07d-68e172485456" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "ac04bff6-90a5-439d-b07d-68e172485456" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:44 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:36:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:44 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:36:44 user nova-compute[74996]: INFO nova.compute.claims [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Claim successful on node user
Nov 02 01:36:44 user nova-compute[74996]: DEBUG nova.compute.manager [req-5eb3c9b8-7650-4944-885d-5b723fabae4e req-10890f1c-b1b2-46fc-9764-d504fb494558 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-plugged-019034ca-6f89-400f-b47a-61e1157f860f {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5eb3c9b8-7650-4944-885d-5b723fabae4e req-10890f1c-b1b2-46fc-9764-d504fb494558 service nova] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5eb3c9b8-7650-4944-885d-5b723fabae4e req-10890f1c-b1b2-46fc-9764-d504fb494558 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5eb3c9b8-7650-4944-885d-5b723fabae4e req-10890f1c-b1b2-46fc-9764-d504fb494558 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:44 user nova-compute[74996]: DEBUG nova.compute.manager [req-5eb3c9b8-7650-4944-885d-5b723fabae4e req-10890f1c-b1b2-46fc-9764-d504fb494558 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] No waiting events found dispatching network-vif-plugged-019034ca-6f89-400f-b47a-61e1157f860f {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:36:44 user nova-compute[74996]: WARNING nova.compute.manager [req-5eb3c9b8-7650-4944-885d-5b723fabae4e req-10890f1c-b1b2-46fc-9764-d504fb494558 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received unexpected event network-vif-plugged-019034ca-6f89-400f-b47a-61e1157f860f for instance with vm_state building and task_state spawning.
Nov 02 01:36:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-5eb3c9b8-7650-4944-885d-5b723fabae4e req-10890f1c-b1b2-46fc-9764-d504fb494558 service nova] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Received event network-vif-unplugged-c117844a-dde1-4486-940f-56b671a79d69 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5eb3c9b8-7650-4944-885d-5b723fabae4e req-10890f1c-b1b2-46fc-9764-d504fb494558 service nova] Acquiring lock "2621c5a2-acff-4055-9746-1b2f5829b39d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5eb3c9b8-7650-4944-885d-5b723fabae4e req-10890f1c-b1b2-46fc-9764-d504fb494558 service nova] Lock "2621c5a2-acff-4055-9746-1b2f5829b39d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5eb3c9b8-7650-4944-885d-5b723fabae4e req-10890f1c-b1b2-46fc-9764-d504fb494558 service nova] Lock "2621c5a2-acff-4055-9746-1b2f5829b39d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-5eb3c9b8-7650-4944-885d-5b723fabae4e req-10890f1c-b1b2-46fc-9764-d504fb494558 service nova] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] No waiting events found dispatching network-vif-unplugged-c117844a-dde1-4486-940f-56b671a79d69 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-5eb3c9b8-7650-4944-885d-5b723fabae4e req-10890f1c-b1b2-46fc-9764-d504fb494558 service nova] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Received event network-vif-unplugged-c117844a-dde1-4486-940f-56b671a79d69 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-5eb3c9b8-7650-4944-885d-5b723fabae4e req-10890f1c-b1b2-46fc-9764-d504fb494558 service nova] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Received event network-vif-plugged-c117844a-dde1-4486-940f-56b671a79d69 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5eb3c9b8-7650-4944-885d-5b723fabae4e req-10890f1c-b1b2-46fc-9764-d504fb494558 service nova] Acquiring lock "2621c5a2-acff-4055-9746-1b2f5829b39d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5eb3c9b8-7650-4944-885d-5b723fabae4e req-10890f1c-b1b2-46fc-9764-d504fb494558 service nova] Lock "2621c5a2-acff-4055-9746-1b2f5829b39d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5eb3c9b8-7650-4944-885d-5b723fabae4e req-10890f1c-b1b2-46fc-9764-d504fb494558 service nova] Lock "2621c5a2-acff-4055-9746-1b2f5829b39d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-5eb3c9b8-7650-4944-885d-5b723fabae4e req-10890f1c-b1b2-46fc-9764-d504fb494558 service nova] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] No waiting events found dispatching network-vif-plugged-c117844a-dde1-4486-940f-56b671a79d69 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:36:45 user nova-compute[74996]: WARNING nova.compute.manager [req-5eb3c9b8-7650-4944-885d-5b723fabae4e req-10890f1c-b1b2-46fc-9764-d504fb494558 service nova] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Received unexpected event network-vif-plugged-c117844a-dde1-4486-940f-56b671a79d69 for instance with vm_state active and task_state deleting.
Nov 02 01:36:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-5eb3c9b8-7650-4944-885d-5b723fabae4e req-10890f1c-b1b2-46fc-9764-d504fb494558 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-plugged-87bf8398-6ede-4465-9555-1000f74e75ff {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5eb3c9b8-7650-4944-885d-5b723fabae4e req-10890f1c-b1b2-46fc-9764-d504fb494558 service nova] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5eb3c9b8-7650-4944-885d-5b723fabae4e req-10890f1c-b1b2-46fc-9764-d504fb494558 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5eb3c9b8-7650-4944-885d-5b723fabae4e req-10890f1c-b1b2-46fc-9764-d504fb494558 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-5eb3c9b8-7650-4944-885d-5b723fabae4e req-10890f1c-b1b2-46fc-9764-d504fb494558 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] No waiting events found dispatching network-vif-plugged-87bf8398-6ede-4465-9555-1000f74e75ff {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:36:45 user nova-compute[74996]: WARNING nova.compute.manager [req-5eb3c9b8-7650-4944-885d-5b723fabae4e req-10890f1c-b1b2-46fc-9764-d504fb494558 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received unexpected event network-vif-plugged-87bf8398-6ede-4465-9555-1000f74e75ff for instance with vm_state building and task_state spawning.
Nov 02 01:36:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-de1b86bf-e136-4518-921d-59b5af7a6109 req-3484119e-c4f4-4a14-97cf-1fe5807c2aff service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-plugged-37104018-4ea0-4b2f-b507-8887a4f7348a {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-de1b86bf-e136-4518-921d-59b5af7a6109 req-3484119e-c4f4-4a14-97cf-1fe5807c2aff service nova] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-de1b86bf-e136-4518-921d-59b5af7a6109 req-3484119e-c4f4-4a14-97cf-1fe5807c2aff service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-de1b86bf-e136-4518-921d-59b5af7a6109 req-3484119e-c4f4-4a14-97cf-1fe5807c2aff service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-de1b86bf-e136-4518-921d-59b5af7a6109 req-3484119e-c4f4-4a14-97cf-1fe5807c2aff service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] No waiting events found dispatching network-vif-plugged-37104018-4ea0-4b2f-b507-8887a4f7348a {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:36:45 user nova-compute[74996]: WARNING nova.compute.manager [req-de1b86bf-e136-4518-921d-59b5af7a6109 req-3484119e-c4f4-4a14-97cf-1fe5807c2aff service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received unexpected event network-vif-plugged-37104018-4ea0-4b2f-b507-8887a4f7348a for instance with vm_state building and task_state spawning.
Nov 02 01:36:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-de1b86bf-e136-4518-921d-59b5af7a6109 req-3484119e-c4f4-4a14-97cf-1fe5807c2aff service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-plugged-37104018-4ea0-4b2f-b507-8887a4f7348a {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-de1b86bf-e136-4518-921d-59b5af7a6109 req-3484119e-c4f4-4a14-97cf-1fe5807c2aff service nova] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-de1b86bf-e136-4518-921d-59b5af7a6109 req-3484119e-c4f4-4a14-97cf-1fe5807c2aff service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-de1b86bf-e136-4518-921d-59b5af7a6109 req-3484119e-c4f4-4a14-97cf-1fe5807c2aff service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-de1b86bf-e136-4518-921d-59b5af7a6109 req-3484119e-c4f4-4a14-97cf-1fe5807c2aff service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] No waiting events found dispatching network-vif-plugged-37104018-4ea0-4b2f-b507-8887a4f7348a {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:36:45 user nova-compute[74996]: WARNING nova.compute.manager [req-de1b86bf-e136-4518-921d-59b5af7a6109 req-3484119e-c4f4-4a14-97cf-1fe5807c2aff service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received unexpected event network-vif-plugged-37104018-4ea0-4b2f-b507-8887a4f7348a for instance with vm_state building and task_state spawning.
Nov 02 01:36:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-de1b86bf-e136-4518-921d-59b5af7a6109 req-3484119e-c4f4-4a14-97cf-1fe5807c2aff service nova] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Received event network-vif-deleted-c117844a-dde1-4486-940f-56b671a79d69 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:45 user nova-compute[74996]: INFO nova.compute.manager [req-de1b86bf-e136-4518-921d-59b5af7a6109 req-3484119e-c4f4-4a14-97cf-1fe5807c2aff service nova] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Neutron deleted interface c117844a-dde1-4486-940f-56b671a79d69; detaching it from the instance and deleting it from the info cache
Nov 02 01:36:45 user nova-compute[74996]: DEBUG nova.network.neutron [req-de1b86bf-e136-4518-921d-59b5af7a6109 req-3484119e-c4f4-4a14-97cf-1fe5807c2aff service nova] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-f03526f8-88c4-44a5-ac8b-eb027301c0a1 req-67b60a59-9bad-4411-9daf-de3a95597601 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-plugged-9042d944-67c5-4e39-9232-72ff23c6f1e0 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f03526f8-88c4-44a5-ac8b-eb027301c0a1 req-67b60a59-9bad-4411-9daf-de3a95597601 service nova] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f03526f8-88c4-44a5-ac8b-eb027301c0a1 req-67b60a59-9bad-4411-9daf-de3a95597601 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f03526f8-88c4-44a5-ac8b-eb027301c0a1 req-67b60a59-9bad-4411-9daf-de3a95597601 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-f03526f8-88c4-44a5-ac8b-eb027301c0a1 req-67b60a59-9bad-4411-9daf-de3a95597601 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] No waiting events found dispatching network-vif-plugged-9042d944-67c5-4e39-9232-72ff23c6f1e0 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:36:45 user nova-compute[74996]: WARNING nova.compute.manager [req-f03526f8-88c4-44a5-ac8b-eb027301c0a1 req-67b60a59-9bad-4411-9daf-de3a95597601 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received unexpected event network-vif-plugged-9042d944-67c5-4e39-9232-72ff23c6f1e0 for instance with vm_state building and task_state spawning.
Nov 02 01:36:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-f03526f8-88c4-44a5-ac8b-eb027301c0a1 req-67b60a59-9bad-4411-9daf-de3a95597601 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-plugged-9042d944-67c5-4e39-9232-72ff23c6f1e0 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f03526f8-88c4-44a5-ac8b-eb027301c0a1 req-67b60a59-9bad-4411-9daf-de3a95597601 service nova] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f03526f8-88c4-44a5-ac8b-eb027301c0a1 req-67b60a59-9bad-4411-9daf-de3a95597601 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f03526f8-88c4-44a5-ac8b-eb027301c0a1 req-67b60a59-9bad-4411-9daf-de3a95597601 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-f03526f8-88c4-44a5-ac8b-eb027301c0a1 req-67b60a59-9bad-4411-9daf-de3a95597601 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] No waiting events found dispatching network-vif-plugged-9042d944-67c5-4e39-9232-72ff23c6f1e0 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:36:45 user nova-compute[74996]: WARNING nova.compute.manager [req-f03526f8-88c4-44a5-ac8b-eb027301c0a1 req-67b60a59-9bad-4411-9daf-de3a95597601 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received unexpected event network-vif-plugged-9042d944-67c5-4e39-9232-72ff23c6f1e0 for instance with vm_state building and task_state spawning.
Nov 02 01:36:45 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Took 1.70 seconds to deallocate network for instance.
Nov 02 01:36:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-de1b86bf-e136-4518-921d-59b5af7a6109 req-3484119e-c4f4-4a14-97cf-1fe5807c2aff service nova] [instance: 2621c5a2-acff-4055-9746-1b2f5829b39d] Detach interface failed, port_id=c117844a-dde1-4486-940f-56b671a79d69, reason: Instance 2621c5a2-acff-4055-9746-1b2f5829b39d could not be found. {{(pid=74996) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:36:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b1f61923-e59f-42a1-8fd8-57dca5711ec9 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:45 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-3b654062-4c28-4ea5-b4f8-f299c8b4b3b9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Snapshot image upload complete
Nov 02 01:36:45 user nova-compute[74996]: INFO nova.compute.manager [None req-3b654062-4c28-4ea5-b4f8-f299c8b4b3b9 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Took 9.31 seconds to snapshot the instance on the hypervisor.
Nov 02 01:36:45 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:36:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.326s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:46 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:36:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b1f61923-e59f-42a1-8fd8-57dca5711ec9 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.109s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:46 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:36:46 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:36:46 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:36:46 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:36:46 user nova-compute[74996]: DEBUG nova.policy [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '700d6c84a40547e99f3e364d6447ad4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6b2c4a38374459b73fa76b8dde9db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:36:46 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:36:46 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:36:46 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Creating image(s)
Nov 02 01:36:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "/opt/stack/data/nova/instances/ac04bff6-90a5-439d-b07d-68e172485456/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "/opt/stack/data/nova/instances/ac04bff6-90a5-439d-b07d-68e172485456/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "/opt/stack/data/nova/instances/ac04bff6-90a5-439d-b07d-68e172485456/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:46 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:46 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.233s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:46 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-b1f61923-e59f-42a1-8fd8-57dca5711ec9 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:36:46 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-b1f61923-e59f-42a1-8fd8-57dca5711ec9 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:36:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b1f61923-e59f-42a1-8fd8-57dca5711ec9 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.716s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:46 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-b1f61923-e59f-42a1-8fd8-57dca5711ec9 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Deleted allocations for instance 2621c5a2-acff-4055-9746-1b2f5829b39d
Nov 02 01:36:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.255s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/ac04bff6-90a5-439d-b07d-68e172485456/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/ac04bff6-90a5-439d-b07d-68e172485456/disk 1073741824" returned: 0 in 0.085s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.355s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b1f61923-e59f-42a1-8fd8-57dca5711ec9 tempest-VolumesAdminNegativeTest-1150311361 tempest-VolumesAdminNegativeTest-1150311361-project-member] Lock "2621c5a2-acff-4055-9746-1b2f5829b39d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.982s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:47 user nova-compute[74996]: DEBUG nova.compute.manager [req-cbae0b66-ea17-4b73-91c3-46413d7d6147 req-5f34237c-6b81-49ff-8c3f-3d36532bf8a5 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-plugged-87bf8398-6ede-4465-9555-1000f74e75ff {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cbae0b66-ea17-4b73-91c3-46413d7d6147 req-5f34237c-6b81-49ff-8c3f-3d36532bf8a5 service nova] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cbae0b66-ea17-4b73-91c3-46413d7d6147 req-5f34237c-6b81-49ff-8c3f-3d36532bf8a5 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cbae0b66-ea17-4b73-91c3-46413d7d6147 req-5f34237c-6b81-49ff-8c3f-3d36532bf8a5 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:47 user nova-compute[74996]: DEBUG nova.compute.manager [req-cbae0b66-ea17-4b73-91c3-46413d7d6147 req-5f34237c-6b81-49ff-8c3f-3d36532bf8a5 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] No waiting events found dispatching network-vif-plugged-87bf8398-6ede-4465-9555-1000f74e75ff {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:36:47 user nova-compute[74996]: WARNING nova.compute.manager [req-cbae0b66-ea17-4b73-91c3-46413d7d6147 req-5f34237c-6b81-49ff-8c3f-3d36532bf8a5 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received unexpected event network-vif-plugged-87bf8398-6ede-4465-9555-1000f74e75ff for instance with vm_state building and task_state spawning.
Nov 02 01:36:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.204s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:47 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ac04bff6-90a5-439d-b07d-68e172485456/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:36:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac04bff6-90a5-439d-b07d-68e172485456/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:47 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Successfully created port: bd0b81f2-2c9d-4c2b-8d29-2d295c521219 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:36:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac04bff6-90a5-439d-b07d-68e172485456/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:47 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Cannot resize image /opt/stack/data/nova/instances/ac04bff6-90a5-439d-b07d-68e172485456/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:36:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:36:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Ensure instance console log exists: /opt/stack/data/nova/instances/ac04bff6-90a5-439d-b07d-68e172485456/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:36:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:47 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:36:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:36:47 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Instance spawned successfully.
Nov 02 01:36:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:36:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:36:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:36:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:36:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:36:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:36:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:36:47 user nova-compute[74996]: INFO nova.compute.manager [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Took 18.33 seconds to spawn the instance on the hypervisor.
Nov 02 01:36:47 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:36:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:47 user nova-compute[74996]: INFO nova.compute.manager [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Took 109.71 seconds to build instance.
Nov 02 01:36:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7405302d-c208-4b93-aed5-2d2637da7a56 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 109.859s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 90.928s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:47 user nova-compute[74996]: INFO nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 02 01:36:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Successfully updated port: bd0b81f2-2c9d-4c2b-8d29-2d295c521219 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "refresh_cache-ac04bff6-90a5-439d-b07d-68e172485456" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquired lock "refresh_cache-ac04bff6-90a5-439d-b07d-68e172485456" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.compute.manager [req-a78c4448-e7cc-4197-af6e-45b606ee2d6e req-8bd9360b-d557-480e-a3e9-0c72f95b4f37 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Received event network-changed-bd0b81f2-2c9d-4c2b-8d29-2d295c521219 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.compute.manager [req-a78c4448-e7cc-4197-af6e-45b606ee2d6e req-8bd9360b-d557-480e-a3e9-0c72f95b4f37 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Refreshing instance network info cache due to event network-changed-bd0b81f2-2c9d-4c2b-8d29-2d295c521219. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a78c4448-e7cc-4197-af6e-45b606ee2d6e req-8bd9360b-d557-480e-a3e9-0c72f95b4f37 service nova] Acquiring lock "refresh_cache-ac04bff6-90a5-439d-b07d-68e172485456" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Updating instance_info_cache with network_info: [{"id": "bd0b81f2-2c9d-4c2b-8d29-2d295c521219", "address": "fa:16:3e:3a:e5:40", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0b81f2-2c", "ovs_interfaceid": "bd0b81f2-2c9d-4c2b-8d29-2d295c521219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Releasing lock "refresh_cache-ac04bff6-90a5-439d-b07d-68e172485456" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Instance network_info: |[{"id": "bd0b81f2-2c9d-4c2b-8d29-2d295c521219", "address": "fa:16:3e:3a:e5:40", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0b81f2-2c", "ovs_interfaceid": "bd0b81f2-2c9d-4c2b-8d29-2d295c521219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a78c4448-e7cc-4197-af6e-45b606ee2d6e req-8bd9360b-d557-480e-a3e9-0c72f95b4f37 service nova] Acquired lock "refresh_cache-ac04bff6-90a5-439d-b07d-68e172485456" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.network.neutron [req-a78c4448-e7cc-4197-af6e-45b606ee2d6e req-8bd9360b-d557-480e-a3e9-0c72f95b4f37 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Refreshing network info cache for port bd0b81f2-2c9d-4c2b-8d29-2d295c521219 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Start _get_guest_xml network_info=[{"id": "bd0b81f2-2c9d-4c2b-8d29-2d295c521219", "address": "fa:16:3e:3a:e5:40", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0b81f2-2c", "ovs_interfaceid": "bd0b81f2-2c9d-4c2b-8d29-2d295c521219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:36:48 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:36:48 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:36:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-103058351',display_name='tempest-AttachVolumeNegativeTest-server-103058351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-103058351',id=19,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRiroOJUGOVJzZXOF+/vAB/kDwa1hdAeROEWJbWxar46GZkPbf06aJnCQeRVGfaN+njK9+nVT//F3XGaTgENpCjTzMO/momoYAKAOdUQReKbJD14VggbMznrVkwVM9nJg==',key_name='tempest-keypair-929854003',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b6b2c4a38374459b73fa76b8dde9db4',ramdisk_id='',reservation_id='r-7pxmv37i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1395123327',owner_user_name='tempest-AttachVolumeNegativeTest-1395123327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:36:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='700d6c84a40547e99f3e364d6447ad4e',uuid=ac04bff6-90a5-439d-b07d-68e172485456,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd0b81f2-2c9d-4c2b-8d29-2d295c521219", "address": "fa:16:3e:3a:e5:40", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0b81f2-2c", "ovs_interfaceid": "bd0b81f2-2c9d-4c2b-8d29-2d295c521219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Converting VIF {"id": "bd0b81f2-2c9d-4c2b-8d29-2d295c521219", "address": "fa:16:3e:3a:e5:40", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0b81f2-2c", "ovs_interfaceid": "bd0b81f2-2c9d-4c2b-8d29-2d295c521219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:e5:40,bridge_name='br-int',has_traffic_filtering=True,id=bd0b81f2-2c9d-4c2b-8d29-2d295c521219,network=Network(d18bfd38-1454-4665-a175-2c7d0e2002ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd0b81f2-2c') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.objects.instance [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lazy-loading 'pci_devices' on Instance uuid ac04bff6-90a5-439d-b07d-68e172485456 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:36:48 user nova-compute[74996]:   <uuid>ac04bff6-90a5-439d-b07d-68e172485456</uuid>
Nov 02 01:36:48 user nova-compute[74996]:   <name>instance-00000013</name>
Nov 02 01:36:48 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:36:48 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:36:48 user nova-compute[74996]:   <metadata>
Nov 02 01:36:48 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:36:48 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:36:48 user nova-compute[74996]:       <nova:name>tempest-AttachVolumeNegativeTest-server-103058351</nova:name>
Nov 02 01:36:48 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:36:48</nova:creationTime>
Nov 02 01:36:48 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:36:48 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:36:48 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:36:48 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:36:48 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:36:48 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:36:48 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:36:48 user nova-compute[74996]:       <nova:owner>
Nov 02 01:36:48 user nova-compute[74996]:         <nova:user uuid="700d6c84a40547e99f3e364d6447ad4e">tempest-AttachVolumeNegativeTest-1395123327-project-member</nova:user>
Nov 02 01:36:48 user nova-compute[74996]:         <nova:project uuid="9b6b2c4a38374459b73fa76b8dde9db4">tempest-AttachVolumeNegativeTest-1395123327</nova:project>
Nov 02 01:36:48 user nova-compute[74996]:       </nova:owner>
Nov 02 01:36:48 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:36:48 user nova-compute[74996]:       <nova:ports>
Nov 02 01:36:48 user nova-compute[74996]:         <nova:port uuid="bd0b81f2-2c9d-4c2b-8d29-2d295c521219">
Nov 02 01:36:48 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 02 01:36:48 user nova-compute[74996]:         </nova:port>
Nov 02 01:36:48 user nova-compute[74996]:       </nova:ports>
Nov 02 01:36:48 user nova-compute[74996]:     </nova:instance>
Nov 02 01:36:48 user nova-compute[74996]:   </metadata>
Nov 02 01:36:48 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:36:48 user nova-compute[74996]:     <system>
Nov 02 01:36:48 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:36:48 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:36:48 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:36:48 user nova-compute[74996]:       <entry name="serial">ac04bff6-90a5-439d-b07d-68e172485456</entry>
Nov 02 01:36:48 user nova-compute[74996]:       <entry name="uuid">ac04bff6-90a5-439d-b07d-68e172485456</entry>
Nov 02 01:36:48 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:36:48 user nova-compute[74996]:     </system>
Nov 02 01:36:48 user nova-compute[74996]:   </sysinfo>
Nov 02 01:36:48 user nova-compute[74996]:   <os>
Nov 02 01:36:48 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:36:48 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:36:48 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:36:48 user nova-compute[74996]:   </os>
Nov 02 01:36:48 user nova-compute[74996]:   <features>
Nov 02 01:36:48 user nova-compute[74996]:     <acpi/>
Nov 02 01:36:48 user nova-compute[74996]:     <apic/>
Nov 02 01:36:48 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:36:48 user nova-compute[74996]:   </features>
Nov 02 01:36:48 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:36:48 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:36:48 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:36:48 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:36:48 user nova-compute[74996]:   </clock>
Nov 02 01:36:48 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:36:48 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:36:48 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:36:48 user nova-compute[74996]:   </cpu>
Nov 02 01:36:48 user nova-compute[74996]:   <devices>
Nov 02 01:36:48 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:36:48 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:36:48 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/ac04bff6-90a5-439d-b07d-68e172485456/disk"/>
Nov 02 01:36:48 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:36:48 user nova-compute[74996]:     </disk>
Nov 02 01:36:48 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:36:48 user nova-compute[74996]:       <mac address="fa:16:3e:3a:e5:40"/>
Nov 02 01:36:48 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:36:48 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:36:48 user nova-compute[74996]:       <target dev="tapbd0b81f2-2c"/>
Nov 02 01:36:48 user nova-compute[74996]:     </interface>
Nov 02 01:36:48 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:36:48 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/ac04bff6-90a5-439d-b07d-68e172485456/console.log" append="off"/>
Nov 02 01:36:48 user nova-compute[74996]:     </serial>
Nov 02 01:36:48 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:36:48 user nova-compute[74996]:     <video>
Nov 02 01:36:48 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:36:48 user nova-compute[74996]:     </video>
Nov 02 01:36:48 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:36:48 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:36:48 user nova-compute[74996]:     </rng>
Nov 02 01:36:48 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:36:48 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:36:48 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:36:48 user nova-compute[74996]:     </memballoon>
Nov 02 01:36:48 user nova-compute[74996]:   </devices>
Nov 02 01:36:48 user nova-compute[74996]: </domain>
Nov 02 01:36:48 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:36:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-103058351',display_name='tempest-AttachVolumeNegativeTest-server-103058351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-103058351',id=19,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRiroOJUGOVJzZXOF+/vAB/kDwa1hdAeROEWJbWxar46GZkPbf06aJnCQeRVGfaN+njK9+nVT//F3XGaTgENpCjTzMO/momoYAKAOdUQReKbJD14VggbMznrVkwVM9nJg==',key_name='tempest-keypair-929854003',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b6b2c4a38374459b73fa76b8dde9db4',ramdisk_id='',reservation_id='r-7pxmv37i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1395123327',owner_user_name='tempest-AttachVolumeNegativeTest-1395123327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:36:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='700d6c84a40547e99f3e364d6447ad4e',uuid=ac04bff6-90a5-439d-b07d-68e172485456,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd0b81f2-2c9d-4c2b-8d29-2d295c521219", "address": "fa:16:3e:3a:e5:40", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0b81f2-2c", "ovs_interfaceid": "bd0b81f2-2c9d-4c2b-8d29-2d295c521219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Converting VIF {"id": "bd0b81f2-2c9d-4c2b-8d29-2d295c521219", "address": "fa:16:3e:3a:e5:40", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0b81f2-2c", "ovs_interfaceid": "bd0b81f2-2c9d-4c2b-8d29-2d295c521219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:e5:40,bridge_name='br-int',has_traffic_filtering=True,id=bd0b81f2-2c9d-4c2b-8d29-2d295c521219,network=Network(d18bfd38-1454-4665-a175-2c7d0e2002ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd0b81f2-2c') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG os_vif [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:e5:40,bridge_name='br-int',has_traffic_filtering=True,id=bd0b81f2-2c9d-4c2b-8d29-2d295c521219,network=Network(d18bfd38-1454-4665-a175-2c7d0e2002ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd0b81f2-2c') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0cabf52a-b74a-5a8e-bcc9-8ed477dcb038', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd0b81f2-2c, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd0b81f2-2c, col_values=(('qos', UUID('0b97f09e-dcf8-47fb-9405-6a88ddd7b6ec')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd0b81f2-2c, col_values=(('external_ids', {'iface-id': 'bd0b81f2-2c9d-4c2b-8d29-2d295c521219', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:e5:40', 'vm-uuid': 'ac04bff6-90a5-439d-b07d-68e172485456'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:48 user nova-compute[74996]: INFO os_vif [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:e5:40,bridge_name='br-int',has_traffic_filtering=True,id=bd0b81f2-2c9d-4c2b-8d29-2d295c521219,network=Network(d18bfd38-1454-4665-a175-2c7d0e2002ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd0b81f2-2c')
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:36:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] No VIF found with MAC fa:16:3e:3a:e5:40, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:36:49 user nova-compute[74996]: DEBUG nova.network.neutron [req-a78c4448-e7cc-4197-af6e-45b606ee2d6e req-8bd9360b-d557-480e-a3e9-0c72f95b4f37 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Updated VIF entry in instance network info cache for port bd0b81f2-2c9d-4c2b-8d29-2d295c521219. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:36:49 user nova-compute[74996]: DEBUG nova.network.neutron [req-a78c4448-e7cc-4197-af6e-45b606ee2d6e req-8bd9360b-d557-480e-a3e9-0c72f95b4f37 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Updating instance_info_cache with network_info: [{"id": "bd0b81f2-2c9d-4c2b-8d29-2d295c521219", "address": "fa:16:3e:3a:e5:40", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0b81f2-2c", "ovs_interfaceid": "bd0b81f2-2c9d-4c2b-8d29-2d295c521219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:36:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a78c4448-e7cc-4197-af6e-45b606ee2d6e req-8bd9360b-d557-480e-a3e9-0c72f95b4f37 service nova] Releasing lock "refresh_cache-ac04bff6-90a5-439d-b07d-68e172485456" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:36:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:50 user nova-compute[74996]: DEBUG nova.compute.manager [req-7f9e8f85-8c69-4120-a999-bbb4e19ede38 req-529227c0-5eaf-4881-8d0d-a42bef672f73 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Received event network-vif-plugged-bd0b81f2-2c9d-4c2b-8d29-2d295c521219 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7f9e8f85-8c69-4120-a999-bbb4e19ede38 req-529227c0-5eaf-4881-8d0d-a42bef672f73 service nova] Acquiring lock "ac04bff6-90a5-439d-b07d-68e172485456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7f9e8f85-8c69-4120-a999-bbb4e19ede38 req-529227c0-5eaf-4881-8d0d-a42bef672f73 service nova] Lock "ac04bff6-90a5-439d-b07d-68e172485456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7f9e8f85-8c69-4120-a999-bbb4e19ede38 req-529227c0-5eaf-4881-8d0d-a42bef672f73 service nova] Lock "ac04bff6-90a5-439d-b07d-68e172485456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:50 user nova-compute[74996]: DEBUG nova.compute.manager [req-7f9e8f85-8c69-4120-a999-bbb4e19ede38 req-529227c0-5eaf-4881-8d0d-a42bef672f73 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] No waiting events found dispatching network-vif-plugged-bd0b81f2-2c9d-4c2b-8d29-2d295c521219 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:36:50 user nova-compute[74996]: WARNING nova.compute.manager [req-7f9e8f85-8c69-4120-a999-bbb4e19ede38 req-529227c0-5eaf-4881-8d0d-a42bef672f73 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Received unexpected event network-vif-plugged-bd0b81f2-2c9d-4c2b-8d29-2d295c521219 for instance with vm_state building and task_state spawning.
Nov 02 01:36:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:52 user nova-compute[74996]: DEBUG nova.compute.manager [req-385e90e4-e85f-4924-adc1-2d872e12d221 req-88760ec4-8c3d-49fa-9611-7b7e8415e9f4 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Received event network-vif-plugged-bd0b81f2-2c9d-4c2b-8d29-2d295c521219 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-385e90e4-e85f-4924-adc1-2d872e12d221 req-88760ec4-8c3d-49fa-9611-7b7e8415e9f4 service nova] Acquiring lock "ac04bff6-90a5-439d-b07d-68e172485456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-385e90e4-e85f-4924-adc1-2d872e12d221 req-88760ec4-8c3d-49fa-9611-7b7e8415e9f4 service nova] Lock "ac04bff6-90a5-439d-b07d-68e172485456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-385e90e4-e85f-4924-adc1-2d872e12d221 req-88760ec4-8c3d-49fa-9611-7b7e8415e9f4 service nova] Lock "ac04bff6-90a5-439d-b07d-68e172485456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:52 user nova-compute[74996]: DEBUG nova.compute.manager [req-385e90e4-e85f-4924-adc1-2d872e12d221 req-88760ec4-8c3d-49fa-9611-7b7e8415e9f4 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] No waiting events found dispatching network-vif-plugged-bd0b81f2-2c9d-4c2b-8d29-2d295c521219 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:36:52 user nova-compute[74996]: WARNING nova.compute.manager [req-385e90e4-e85f-4924-adc1-2d872e12d221 req-88760ec4-8c3d-49fa-9611-7b7e8415e9f4 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Received unexpected event network-vif-plugged-bd0b81f2-2c9d-4c2b-8d29-2d295c521219 for instance with vm_state building and task_state spawning.
Nov 02 01:36:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:52 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:36:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:36:52 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Instance spawned successfully.
Nov 02 01:36:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:36:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:36:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:36:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:36:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:36:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:36:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:36:52 user nova-compute[74996]: INFO nova.compute.manager [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Took 6.53 seconds to spawn the instance on the hypervisor.
Nov 02 01:36:52 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:36:53 user nova-compute[74996]: INFO nova.compute.manager [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Took 8.35 seconds to build instance.
Nov 02 01:36:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7ffeddcd-c1e2-48cd-9888-49affbd2441b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "ac04bff6-90a5-439d-b07d-68e172485456" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.510s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:55 user nova-compute[74996]: INFO nova.compute.manager [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Terminating instance
Nov 02 01:36:55 user nova-compute[74996]: DEBUG nova.compute.manager [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG nova.compute.manager [req-10a6b220-960e-4b22-8cb3-4ddf4ba0023d req-2d108638-48cf-4a72-9065-88aebd01b42f service nova] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Received event network-vif-unplugged-0881efe5-be2c-456a-abb9-a923b83c0f3e {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-10a6b220-960e-4b22-8cb3-4ddf4ba0023d req-2d108638-48cf-4a72-9065-88aebd01b42f service nova] Acquiring lock "12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-10a6b220-960e-4b22-8cb3-4ddf4ba0023d req-2d108638-48cf-4a72-9065-88aebd01b42f service nova] Lock "12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-10a6b220-960e-4b22-8cb3-4ddf4ba0023d req-2d108638-48cf-4a72-9065-88aebd01b42f service nova] Lock "12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG nova.compute.manager [req-10a6b220-960e-4b22-8cb3-4ddf4ba0023d req-2d108638-48cf-4a72-9065-88aebd01b42f service nova] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] No waiting events found dispatching network-vif-unplugged-0881efe5-be2c-456a-abb9-a923b83c0f3e {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG nova.compute.manager [req-10a6b220-960e-4b22-8cb3-4ddf4ba0023d req-2d108638-48cf-4a72-9065-88aebd01b42f service nova] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Received event network-vif-unplugged-0881efe5-be2c-456a-abb9-a923b83c0f3e for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:36:56 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Instance destroyed successfully.
Nov 02 01:36:56 user nova-compute[74996]: DEBUG nova.objects.instance [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lazy-loading 'resources' on Instance uuid 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:34:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-65913740',display_name='tempest-TestVolumeBootPattern-server-65913740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-65913740',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:35:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31965b482eb243a69112a49bf1302779',ramdisk_id='',reservation_id='r-24v14wun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestVolumeBootPattern-216720976',owner_user_name='tempest-TestVolumeBootPattern-216720976-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:35:24Z,user_data=None,user_id='be6bf504c3a649898e8c83399f6fee8e',uuid=12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0881efe5-be2c-456a-abb9-a923b83c0f3e", "address": "fa:16:3e:97:b6:d5", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0881efe5-be", "ovs_interfaceid": "0881efe5-be2c-456a-abb9-a923b83c0f3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converting VIF {"id": "0881efe5-be2c-456a-abb9-a923b83c0f3e", "address": "fa:16:3e:97:b6:d5", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0881efe5-be", "ovs_interfaceid": "0881efe5-be2c-456a-abb9-a923b83c0f3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:b6:d5,bridge_name='br-int',has_traffic_filtering=True,id=0881efe5-be2c-456a-abb9-a923b83c0f3e,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0881efe5-be') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG os_vif [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:b6:d5,bridge_name='br-int',has_traffic_filtering=True,id=0881efe5-be2c-456a-abb9-a923b83c0f3e,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0881efe5-be') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0881efe5-be, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d18196cd-e1df-481f-a65c-6526fb7158dd) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:56 user nova-compute[74996]: INFO os_vif [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:b6:d5,bridge_name='br-int',has_traffic_filtering=True,id=0881efe5-be2c-456a-abb9-a923b83c0f3e,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0881efe5-be')
Nov 02 01:36:56 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TtQvKSOi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:36:56 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:36:56 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.038s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[256958ad-cc3b-43e0-b5ed-5c89b9d0862d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:36:56 user nova-compute[74996]: No targets found.
Nov 02 01:36:56 user nova-compute[74996]: iSNS:
Nov 02 01:36:56 user nova-compute[74996]: No targets found.
Nov 02 01:36:56 user nova-compute[74996]: STATIC:
Nov 02 01:36:56 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1
Nov 02 01:36:56 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:36:56 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:36:56 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0
Nov 02 01:36:56 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:36:56 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:36:56 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01
Nov 02 01:36:56 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:36:56 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:36:56 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84
Nov 02 01:36:56 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:36:56 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:36:56 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873
Nov 02 01:36:56 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:36:56 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:36:56 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8
Nov 02 01:36:56 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:36:56 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:36:56 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181
Nov 02 01:36:56 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:36:56 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:36:56 user nova-compute[74996]: FIRMWARE:
Nov 02 01:36:56 user nova-compute[74996]: No targets found.
Nov 02 01:36:56 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:36:56 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:36:56 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca88516-420d-49a6-88a9-79a3f6b5f04b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c915555-044d-4d78-8832-964f52393e62]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:36:56 user nova-compute[74996]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:36:56 user nova-compute[74996]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)
Nov 02 01:36:56 user nova-compute[74996]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:36:56 user nova-compute[74996]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:36:56 user nova-compute[74996]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)
Nov 02 01:36:56 user nova-compute[74996]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:36:56 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 (non-flash)
Nov 02 01:36:56 user nova-compute[74996]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:36:56 user nova-compute[74996]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)
Nov 02 01:36:56 user nova-compute[74996]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:36:56 user nova-compute[74996]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:36:56 user nova-compute[74996]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)
Nov 02 01:36:56 user nova-compute[74996]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:36:56 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e852e320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01'): ({'sdd'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Removing single pathed devices sdd {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ebac9d-3e70-4e48-92b5-f8bc9c701e02]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4f89df-e9f3-4b8d-bbc0-68323dca2979]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Flushing IO for device /dev/sdd {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca123ca-9e3c-41ca-aa19-0366a646ffd4]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.061s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b479ab-0ab4-4656-b3fb-ba44061e99fe]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] SCSI volumes sdd have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23939326465366661', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_232750a8', '/dev/disk/by-id/scsi-1SCST_BIO232750a8-992de6fa56db4a4f') {{(pid=86449) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 01:36:57 user nova-compute[74996]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23939326465366661
Nov 02 01:36:57 user nova-compute[74996]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_232750a8
Nov 02 01:36:57 user nova-compute[74996]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO232750a8-992de6fa56db4a4f
Nov 02 01:36:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b521f85c-c1d5-4f9b-801f-d34eaa26332a]: (4, None) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3043426d-953e-49cf-87c0-ef07a31513cf]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[90301555-2754-49da-91fe-f342009e854f]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01, portal: 172.16.0.220,3260]
Nov 02 01:36:57 user nova-compute[74996]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01, portal: 172.16.0.220,3260] successful.
Nov 02 01:36:57 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe5410d6-f096-4581-aec0-48a7fd8bab01 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d81bceb-1417-4ff7-81aa-7fa69c549c98]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] <== disconnect_volume: return (428ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:36:57 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Deleting instance files /opt/stack/data/nova/instances/12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a_del
Nov 02 01:36:57 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Deletion of /opt/stack/data/nova/instances/12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a_del complete
Nov 02 01:36:57 user nova-compute[74996]: INFO nova.compute.manager [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Took 1.39 seconds to destroy the instance on the hypervisor.
Nov 02 01:36:57 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:36:57 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Took 0.42 seconds to deallocate network for instance.
Nov 02 01:36:57 user nova-compute[74996]: DEBUG nova.compute.manager [req-af250b6e-42ac-4b84-9c21-d747a5500e99 req-dbe62ba8-95c8-4fb3-a59c-2bfb95cb3ce1 service nova] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Received event network-vif-deleted-0881efe5-be2c-456a-abb9-a923b83c0f3e {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:57 user nova-compute[74996]: INFO nova.compute.manager [req-af250b6e-42ac-4b84-9c21-d747a5500e99 req-dbe62ba8-95c8-4fb3-a59c-2bfb95cb3ce1 service nova] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Neutron deleted interface 0881efe5-be2c-456a-abb9-a923b83c0f3e; detaching it from the instance and deleting it from the info cache
Nov 02 01:36:57 user nova-compute[74996]: DEBUG nova.network.neutron [req-af250b6e-42ac-4b84-9c21-d747a5500e99 req-dbe62ba8-95c8-4fb3-a59c-2bfb95cb3ce1 service nova] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:36:57 user nova-compute[74996]: DEBUG nova.compute.manager [req-af250b6e-42ac-4b84-9c21-d747a5500e99 req-dbe62ba8-95c8-4fb3-a59c-2bfb95cb3ce1 service nova] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Detach interface failed, port_id=0881efe5-be2c-456a-abb9-a923b83c0f3e, reason: Instance 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a could not be found. {{(pid=74996) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 01:36:58 user nova-compute[74996]: DEBUG nova.compute.manager [req-cf9c99a1-5127-4cce-a23b-386a366b0e25 req-5f3e2680-dcf6-4f14-82a1-bb1a1e496cb9 service nova] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Received event network-vif-plugged-0881efe5-be2c-456a-abb9-a923b83c0f3e {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:36:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cf9c99a1-5127-4cce-a23b-386a366b0e25 req-5f3e2680-dcf6-4f14-82a1-bb1a1e496cb9 service nova] Acquiring lock "12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:36:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cf9c99a1-5127-4cce-a23b-386a366b0e25 req-5f3e2680-dcf6-4f14-82a1-bb1a1e496cb9 service nova] Lock "12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:36:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cf9c99a1-5127-4cce-a23b-386a366b0e25 req-5f3e2680-dcf6-4f14-82a1-bb1a1e496cb9 service nova] Lock "12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:36:58 user nova-compute[74996]: DEBUG nova.compute.manager [req-cf9c99a1-5127-4cce-a23b-386a366b0e25 req-5f3e2680-dcf6-4f14-82a1-bb1a1e496cb9 service nova] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] No waiting events found dispatching network-vif-plugged-0881efe5-be2c-456a-abb9-a923b83c0f3e {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:36:58 user nova-compute[74996]: WARNING nova.compute.manager [req-cf9c99a1-5127-4cce-a23b-386a366b0e25 req-5f3e2680-dcf6-4f14-82a1-bb1a1e496cb9 service nova] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Received unexpected event network-vif-plugged-0881efe5-be2c-456a-abb9-a923b83c0f3e for instance with vm_state active and task_state deleting.
Nov 02 01:37:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:12 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:37:12 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:37:12 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:37:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:13 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:37:13 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:37:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-fea802b7-64d9-4c77-87a7-eaba1dce5c22" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:37:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-fea802b7-64d9-4c77-87a7-eaba1dce5c22" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:37:13 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 01:37:13 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Updating instance_info_cache with network_info: [{"id": "c458c481-1588-4776-a269-8f95b72195dd", "address": "fa:16:3e:7f:23:3e", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc458c481-15", "ovs_interfaceid": "c458c481-1588-4776-a269-8f95b72195dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:37:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-fea802b7-64d9-4c77-87a7-eaba1dce5c22" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:37:13 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 01:37:13 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:37:14 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:37:14 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:37:14 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:37:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:37:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:37:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:37:14 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:37:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:37:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:37:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:37:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:37:14 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:37:14 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:37:14 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:37:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:37:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:37:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:37:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:37:15 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:37:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:37:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:37:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:37:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:37:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac04bff6-90a5-439d-b07d-68e172485456/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:37:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac04bff6-90a5-439d-b07d-68e172485456/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:37:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac04bff6-90a5-439d-b07d-68e172485456/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:37:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac04bff6-90a5-439d-b07d-68e172485456/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:37:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:37:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:37:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:37:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:37:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:37:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:37:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:37:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:37:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:37:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:37:16 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:37:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:37:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:37:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:37:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:37:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:37:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:37:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:37:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:37:17 user nova-compute[74996]: DEBUG nova.compute.manager [req-bd9cd47b-a877-4f31-8aa2-068cfa659571 req-c68c7c91-c344-4a75-b4d4-c269036f7946 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Received event network-changed-fbf546f3-964c-4816-84c1-20d11b5ed544 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:37:17 user nova-compute[74996]: DEBUG nova.compute.manager [req-bd9cd47b-a877-4f31-8aa2-068cfa659571 req-c68c7c91-c344-4a75-b4d4-c269036f7946 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Refreshing instance network info cache due to event network-changed-fbf546f3-964c-4816-84c1-20d11b5ed544. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:37:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-bd9cd47b-a877-4f31-8aa2-068cfa659571 req-c68c7c91-c344-4a75-b4d4-c269036f7946 service nova] Acquiring lock "refresh_cache-f44d0b13-9dae-40c9-83d0-0b84699b1cc2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:37:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-bd9cd47b-a877-4f31-8aa2-068cfa659571 req-c68c7c91-c344-4a75-b4d4-c269036f7946 service nova] Acquired lock "refresh_cache-f44d0b13-9dae-40c9-83d0-0b84699b1cc2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:37:17 user nova-compute[74996]: DEBUG nova.network.neutron [req-bd9cd47b-a877-4f31-8aa2-068cfa659571 req-c68c7c91-c344-4a75-b4d4-c269036f7946 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Refreshing network info cache for port fbf546f3-964c-4816-84c1-20d11b5ed544 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:37:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:37:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:37:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:37:18 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:37:18 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:37:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=7164MB free_disk=25.227073669433594GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:37:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:37:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:37:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-88dd28ae-60f5-4678-9542-a849bf890ed7 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Acquiring lock "interface-f44d0b13-9dae-40c9-83d0-0b84699b1cc2-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:37:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-88dd28ae-60f5-4678-9542-a849bf890ed7 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "interface-f44d0b13-9dae-40c9-83d0-0b84699b1cc2-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:37:18 user nova-compute[74996]: DEBUG nova.objects.instance [None req-88dd28ae-60f5-4678-9542-a849bf890ed7 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lazy-loading 'flavor' on Instance uuid f44d0b13-9dae-40c9-83d0-0b84699b1cc2 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:37:18 user nova-compute[74996]: DEBUG nova.network.neutron [req-bd9cd47b-a877-4f31-8aa2-068cfa659571 req-c68c7c91-c344-4a75-b4d4-c269036f7946 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Updated VIF entry in instance network info cache for port fbf546f3-964c-4816-84c1-20d11b5ed544. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:37:18 user nova-compute[74996]: DEBUG nova.network.neutron [req-bd9cd47b-a877-4f31-8aa2-068cfa659571 req-c68c7c91-c344-4a75-b4d4-c269036f7946 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Updating instance_info_cache with network_info: [{"id": "fbf546f3-964c-4816-84c1-20d11b5ed544", "address": "fa:16:3e:e1:e1:a7", "network": {"id": "2cb390f5-5458-4e64-bf80-887d5f41bdf8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1475294747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7981230c517e493883bb048b1cfa7907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf546f3-96", "ovs_interfaceid": "fbf546f3-964c-4816-84c1-20d11b5ed544", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:37:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-bd9cd47b-a877-4f31-8aa2-068cfa659571 req-c68c7c91-c344-4a75-b4d4-c269036f7946 service nova] Releasing lock "refresh_cache-f44d0b13-9dae-40c9-83d0-0b84699b1cc2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:37:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance fea802b7-64d9-4c77-87a7-eaba1dce5c22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:37:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7307f3a3-1ad1-43f7-be49-9cd03a626cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:37:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance fa6400fb-9e90-4f94-9da7-238b91276f41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:37:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance c04b39dd-3961-4e23-ad43-34a218f4a472 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:37:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 6b79aa2f-02c7-492e-b27e-7481e41f8d2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:37:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:37:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance d8f51f7d-c9de-4914-883e-7a875d3d73ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:37:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance adfc9441-d607-4b9f-8008-95e42f1ac51e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:37:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance f44d0b13-9dae-40c9-83d0-0b84699b1cc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:37:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance da10dadd-b04a-4f3b-92bd-fcaa18b51fce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:37:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance ac04bff6-90a5-439d-b07d-68e172485456 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:37:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:37:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:37:18 user nova-compute[74996]: DEBUG nova.objects.instance [None req-88dd28ae-60f5-4678-9542-a849bf890ed7 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lazy-loading 'pci_requests' on Instance uuid f44d0b13-9dae-40c9-83d0-0b84699b1cc2 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:37:18 user nova-compute[74996]: DEBUG nova.objects.base [None req-88dd28ae-60f5-4678-9542-a849bf890ed7 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Object Instance<f44d0b13-9dae-40c9-83d0-0b84699b1cc2> lazy-loaded attributes: flavor,pci_requests {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:37:18 user nova-compute[74996]: DEBUG nova.network.neutron [None req-88dd28ae-60f5-4678-9542-a849bf890ed7 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:37:18 user nova-compute[74996]: DEBUG nova.policy [None req-88dd28ae-60f5-4678-9542-a849bf890ed7 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1bb72dff3f614017b0ddc032ac15cd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7981230c517e493883bb048b1cfa7907', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:37:18 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:37:18 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:37:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:37:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:37:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:19 user nova-compute[74996]: DEBUG nova.network.neutron [None req-88dd28ae-60f5-4678-9542-a849bf890ed7 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Successfully created port: d1504136-cb23-4cfd-981b-5f4a46f71bb1 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:37:19 user nova-compute[74996]: DEBUG nova.network.neutron [None req-88dd28ae-60f5-4678-9542-a849bf890ed7 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Successfully updated port: d1504136-cb23-4cfd-981b-5f4a46f71bb1 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:37:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-88dd28ae-60f5-4678-9542-a849bf890ed7 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Acquiring lock "refresh_cache-f44d0b13-9dae-40c9-83d0-0b84699b1cc2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:37:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-88dd28ae-60f5-4678-9542-a849bf890ed7 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Acquired lock "refresh_cache-f44d0b13-9dae-40c9-83d0-0b84699b1cc2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:37:19 user nova-compute[74996]: DEBUG nova.network.neutron [None req-88dd28ae-60f5-4678-9542-a849bf890ed7 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:37:19 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:37:19 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:37:19 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:37:19 user nova-compute[74996]: DEBUG nova.compute.manager [req-37f2a729-a5a7-405d-b39b-2107c578903d req-1bf549ab-8b0b-412d-bb4a-f0e28000739e service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Received event network-changed-d1504136-cb23-4cfd-981b-5f4a46f71bb1 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:37:19 user nova-compute[74996]: DEBUG nova.compute.manager [req-37f2a729-a5a7-405d-b39b-2107c578903d req-1bf549ab-8b0b-412d-bb4a-f0e28000739e service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Refreshing instance network info cache due to event network-changed-d1504136-cb23-4cfd-981b-5f4a46f71bb1. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:37:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-37f2a729-a5a7-405d-b39b-2107c578903d req-1bf549ab-8b0b-412d-bb4a-f0e28000739e service nova] Acquiring lock "refresh_cache-f44d0b13-9dae-40c9-83d0-0b84699b1cc2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:37:20 user nova-compute[74996]: DEBUG nova.network.neutron [None req-88dd28ae-60f5-4678-9542-a849bf890ed7 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Updating instance_info_cache with network_info: [{"id": "fbf546f3-964c-4816-84c1-20d11b5ed544", "address": "fa:16:3e:e1:e1:a7", "network": {"id": "2cb390f5-5458-4e64-bf80-887d5f41bdf8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1475294747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7981230c517e493883bb048b1cfa7907", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf546f3-96", "ovs_interfaceid": "fbf546f3-964c-4816-84c1-20d11b5ed544", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d1504136-cb23-4cfd-981b-5f4a46f71bb1", "address": "fa:16:3e:fd:76:d8", "network": {"id": "d7c8d7c4-4b9d-4903-bdaf-c3db1f11a6dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1241834085", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7981230c517e493883bb048b1cfa7907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1504136-cb", "ovs_interfaceid": "d1504136-cb23-4cfd-981b-5f4a46f71bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:37:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-88dd28ae-60f5-4678-9542-a849bf890ed7 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Releasing lock "refresh_cache-f44d0b13-9dae-40c9-83d0-0b84699b1cc2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:37:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-37f2a729-a5a7-405d-b39b-2107c578903d req-1bf549ab-8b0b-412d-bb4a-f0e28000739e service nova] Acquired lock "refresh_cache-f44d0b13-9dae-40c9-83d0-0b84699b1cc2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:37:20 user nova-compute[74996]: DEBUG nova.network.neutron [req-37f2a729-a5a7-405d-b39b-2107c578903d req-1bf549ab-8b0b-412d-bb4a-f0e28000739e service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Refreshing network info cache for port d1504136-cb23-4cfd-981b-5f4a46f71bb1 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:37:20 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-88dd28ae-60f5-4678-9542-a849bf890ed7 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111239639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111239639',id=17,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLtwBp/DvHskyQXeHr37ezG4yqg/zTU4wDpo1xGzexMimgVBKyE7nsHF9zbcCIyqHw1sf3kCFQioLSlFRREV/mNyOI03M7/LCcKSZAW08/rLH78veAeoRHPxfQDNyUQqA==',key_name='tempest-keypair-876877355',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:35:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7981230c517e493883bb048b1cfa7907',ramdisk_id='',reservation_id='r-ccrouw9n',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-722286534',owner_user_name='tempest-TaggedAttachmentsTest-722286534-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:35:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bb72dff3f614017b0ddc032ac15cd7b',uuid=f44d0b13-9dae-40c9-83d0-0b84699b1cc2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1504136-cb23-4cfd-981b-5f4a46f71bb1", "address": "fa:16:3e:fd:76:d8", "network": {"id": "d7c8d7c4-4b9d-4903-bdaf-c3db1f11a6dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1241834085", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7981230c517e493883bb048b1cfa7907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1504136-cb", "ovs_interfaceid": "d1504136-cb23-4cfd-981b-5f4a46f71bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:37:20 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-88dd28ae-60f5-4678-9542-a849bf890ed7 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Converting VIF {"id": "d1504136-cb23-4cfd-981b-5f4a46f71bb1", "address": "fa:16:3e:fd:76:d8", "network": {"id": "d7c8d7c4-4b9d-4903-bdaf-c3db1f11a6dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1241834085", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7981230c517e493883bb048b1cfa7907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1504136-cb", "ovs_interfaceid": "d1504136-cb23-4cfd-981b-5f4a46f71bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:37:20 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-88dd28ae-60f5-4678-9542-a849bf890ed7 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:76:d8,bridge_name='br-int',has_traffic_filtering=True,id=d1504136-cb23-4cfd-981b-5f4a46f71bb1,network=Network(d7c8d7c4-4b9d-4903-bdaf-c3db1f11a6dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1504136-cb') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:37:20 user nova-compute[74996]: DEBUG os_vif [None req-88dd28ae-60f5-4678-9542-a849bf890ed7 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:76:d8,bridge_name='br-int',has_traffic_filtering=True,id=d1504136-cb23-4cfd-981b-5f4a46f71bb1,network=Network(d7c8d7c4-4b9d-4903-bdaf-c3db1f11a6dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1504136-cb') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:37:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:37:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:37:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f29aafa9-1fe8-5c45-8480-cfb94ac66cf2', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:37:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:37:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1504136-cb, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:37:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd1504136-cb, col_values=(('qos', UUID('601f66fc-2ab8-4373-9897-2f83cba52d15')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:37:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd1504136-cb, col_values=(('external_ids', {'iface-id': 'd1504136-cb23-4cfd-981b-5f4a46f71bb1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:76:d8', 'vm-uuid': 'f44d0b13-9dae-40c9-83d0-0b84699b1cc2'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:37:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:37:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:20 user nova-compute[74996]: INFO os_vif [None req-88dd28ae-60f5-4678-9542-a849bf890ed7 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:76:d8,bridge_name='br-int',has_traffic_filtering=True,id=d1504136-cb23-4cfd-981b-5f4a46f71bb1,network=Network(d7c8d7c4-4b9d-4903-bdaf-c3db1f11a6dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1504136-cb')
Nov 02 01:37:20 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-88dd28ae-60f5-4678-9542-a849bf890ed7 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111239639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111239639',id=17,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLtwBp/DvHskyQXeHr37ezG4yqg/zTU4wDpo1xGzexMimgVBKyE7nsHF9zbcCIyqHw1sf3kCFQioLSlFRREV/mNyOI03M7/LCcKSZAW08/rLH78veAeoRHPxfQDNyUQqA==',key_name='tempest-keypair-876877355',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:35:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7981230c517e493883bb048b1cfa7907',ramdisk_id='',reservation_id='r-ccrouw9n',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-722286534',owner_user_name='tempest-TaggedAttachmentsTest-722286534-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:35:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bb72dff3f614017b0ddc032ac15cd7b',uuid=f44d0b13-9dae-40c9-83d0-0b84699b1cc2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1504136-cb23-4cfd-981b-5f4a46f71bb1", "address": "fa:16:3e:fd:76:d8", "network": {"id": "d7c8d7c4-4b9d-4903-bdaf-c3db1f11a6dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1241834085", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7981230c517e493883bb048b1cfa7907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1504136-cb", "ovs_interfaceid": "d1504136-cb23-4cfd-981b-5f4a46f71bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:37:20 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-88dd28ae-60f5-4678-9542-a849bf890ed7 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Converting VIF {"id": "d1504136-cb23-4cfd-981b-5f4a46f71bb1", "address": "fa:16:3e:fd:76:d8", "network": {"id": "d7c8d7c4-4b9d-4903-bdaf-c3db1f11a6dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1241834085", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7981230c517e493883bb048b1cfa7907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1504136-cb", "ovs_interfaceid": "d1504136-cb23-4cfd-981b-5f4a46f71bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:37:20 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-88dd28ae-60f5-4678-9542-a849bf890ed7 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:76:d8,bridge_name='br-int',has_traffic_filtering=True,id=d1504136-cb23-4cfd-981b-5f4a46f71bb1,network=Network(d7c8d7c4-4b9d-4903-bdaf-c3db1f11a6dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1504136-cb') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:37:20 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-88dd28ae-60f5-4678-9542-a849bf890ed7 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] attach device xml: <interface type="ethernet">
Nov 02 01:37:20 user nova-compute[74996]:   <mac address="fa:16:3e:fd:76:d8"/>
Nov 02 01:37:20 user nova-compute[74996]:   <model type="virtio"/>
Nov 02 01:37:20 user nova-compute[74996]:   <mtu size="1442"/>
Nov 02 01:37:20 user nova-compute[74996]:   <target dev="tapd1504136-cb"/>
Nov 02 01:37:20 user nova-compute[74996]: </interface>
Nov 02 01:37:20 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 01:37:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:21 user nova-compute[74996]: DEBUG nova.compute.manager [req-47549317-232f-4845-a860-7234de8d3a96 req-2ee7917b-32ca-48bc-809a-74a1821b4ac3 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Received event network-vif-plugged-d1504136-cb23-4cfd-981b-5f4a46f71bb1 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:37:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-47549317-232f-4845-a860-7234de8d3a96 req-2ee7917b-32ca-48bc-809a-74a1821b4ac3 service nova] Acquiring lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:37:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-47549317-232f-4845-a860-7234de8d3a96 req-2ee7917b-32ca-48bc-809a-74a1821b4ac3 service nova] Lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:37:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-47549317-232f-4845-a860-7234de8d3a96 req-2ee7917b-32ca-48bc-809a-74a1821b4ac3 service nova] Lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:37:21 user nova-compute[74996]: DEBUG nova.compute.manager [req-47549317-232f-4845-a860-7234de8d3a96 req-2ee7917b-32ca-48bc-809a-74a1821b4ac3 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] No waiting events found dispatching network-vif-plugged-d1504136-cb23-4cfd-981b-5f4a46f71bb1 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:37:21 user nova-compute[74996]: WARNING nova.compute.manager [req-47549317-232f-4845-a860-7234de8d3a96 req-2ee7917b-32ca-48bc-809a-74a1821b4ac3 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Received unexpected event network-vif-plugged-d1504136-cb23-4cfd-981b-5f4a46f71bb1 for instance with vm_state active and task_state None.
Nov 02 01:37:21 user nova-compute[74996]: DEBUG nova.network.neutron [req-37f2a729-a5a7-405d-b39b-2107c578903d req-1bf549ab-8b0b-412d-bb4a-f0e28000739e service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Updated VIF entry in instance network info cache for port d1504136-cb23-4cfd-981b-5f4a46f71bb1. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:37:21 user nova-compute[74996]: DEBUG nova.network.neutron [req-37f2a729-a5a7-405d-b39b-2107c578903d req-1bf549ab-8b0b-412d-bb4a-f0e28000739e service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Updating instance_info_cache with network_info: [{"id": "fbf546f3-964c-4816-84c1-20d11b5ed544", "address": "fa:16:3e:e1:e1:a7", "network": {"id": "2cb390f5-5458-4e64-bf80-887d5f41bdf8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1475294747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7981230c517e493883bb048b1cfa7907", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf546f3-96", "ovs_interfaceid": "fbf546f3-964c-4816-84c1-20d11b5ed544", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d1504136-cb23-4cfd-981b-5f4a46f71bb1", "address": "fa:16:3e:fd:76:d8", "network": {"id": "d7c8d7c4-4b9d-4903-bdaf-c3db1f11a6dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1241834085", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7981230c517e493883bb048b1cfa7907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1504136-cb", "ovs_interfaceid": "d1504136-cb23-4cfd-981b-5f4a46f71bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:37:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-88dd28ae-60f5-4678-9542-a849bf890ed7 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:37:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-88dd28ae-60f5-4678-9542-a849bf890ed7 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] No BDM found with device name hda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:37:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-88dd28ae-60f5-4678-9542-a849bf890ed7 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] No VIF found with MAC fa:16:3e:e1:e1:a7, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:37:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-37f2a729-a5a7-405d-b39b-2107c578903d req-1bf549ab-8b0b-412d-bb4a-f0e28000739e service nova] Releasing lock "refresh_cache-f44d0b13-9dae-40c9-83d0-0b84699b1cc2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:37:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-88dd28ae-60f5-4678-9542-a849bf890ed7 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:37:21 user nova-compute[74996]:   <nova:package version="0.0.0"/>
Nov 02 01:37:21 user nova-compute[74996]:   <nova:name>tempest-device-tagging-server-2111239639</nova:name>
Nov 02 01:37:21 user nova-compute[74996]:   <nova:creationTime>2023-11-02 01:37:21</nova:creationTime>
Nov 02 01:37:21 user nova-compute[74996]:   <nova:flavor name="m1.tiny">
Nov 02 01:37:21 user nova-compute[74996]:     <nova:memory>512</nova:memory>
Nov 02 01:37:21 user nova-compute[74996]:     <nova:disk>1</nova:disk>
Nov 02 01:37:21 user nova-compute[74996]:     <nova:swap>0</nova:swap>
Nov 02 01:37:21 user nova-compute[74996]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:37:21 user nova-compute[74996]:     <nova:vcpus>1</nova:vcpus>
Nov 02 01:37:21 user nova-compute[74996]:   </nova:flavor>
Nov 02 01:37:21 user nova-compute[74996]:   <nova:owner>
Nov 02 01:37:21 user nova-compute[74996]:     <nova:user uuid="1bb72dff3f614017b0ddc032ac15cd7b">tempest-TaggedAttachmentsTest-722286534-project-member</nova:user>
Nov 02 01:37:21 user nova-compute[74996]:     <nova:project uuid="7981230c517e493883bb048b1cfa7907">tempest-TaggedAttachmentsTest-722286534</nova:project>
Nov 02 01:37:21 user nova-compute[74996]:   </nova:owner>
Nov 02 01:37:21 user nova-compute[74996]:   <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:37:21 user nova-compute[74996]:   <nova:ports>
Nov 02 01:37:21 user nova-compute[74996]:     <nova:port uuid="fbf546f3-964c-4816-84c1-20d11b5ed544">
Nov 02 01:37:21 user nova-compute[74996]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 01:37:21 user nova-compute[74996]:     </nova:port>
Nov 02 01:37:21 user nova-compute[74996]:     <nova:port uuid="d1504136-cb23-4cfd-981b-5f4a46f71bb1">
Nov 02 01:37:21 user nova-compute[74996]:       <nova:ip type="fixed" address="10.10.10.180" ipVersion="4"/>
Nov 02 01:37:21 user nova-compute[74996]:     </nova:port>
Nov 02 01:37:21 user nova-compute[74996]:   </nova:ports>
Nov 02 01:37:21 user nova-compute[74996]: </nova:instance>
Nov 02 01:37:21 user nova-compute[74996]:  {{(pid=74996) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 02 01:37:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-88dd28ae-60f5-4678-9542-a849bf890ed7 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "interface-f44d0b13-9dae-40c9-83d0-0b84699b1cc2-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.049s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:37:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Acquiring lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:37:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:37:21 user nova-compute[74996]: DEBUG nova.objects.instance [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lazy-loading 'flavor' on Instance uuid f44d0b13-9dae-40c9-83d0-0b84699b1cc2 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:37:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:37:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Acquiring lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:37:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:37:21 user nova-compute[74996]: INFO nova.compute.manager [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Attaching volume 6336836f-4059-41bb-b86d-6ae54b4de611 to /dev/vdb
Nov 02 01:37:21 user nova-compute[74996]: DEBUG os_brick.utils [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:37:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:37:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:37:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20b962a-5376-4e94-b858-9bce00ce813e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:37:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:37:22 user nova-compute[74996]: INFO nova.compute.manager [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Took 24.25 seconds to detach 1 volumes for instance.
Nov 02 01:37:22 user nova-compute[74996]: DEBUG nova.compute.manager [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a] Deleting volume: fe5410d6-f096-4581-aec0-48a7fd8bab01 {{(pid=74996) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 01:37:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:37:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcfbbfe-3532-4d9b-85f5-97587e2be30e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:37:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:37:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:37:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[244c954d-aded-4235-9eab-a1f639cc3ac6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:37:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec27fd6-88d7-4f26-8ec6-f2580be745fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:37:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:37:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:37:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:37:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:37:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:37:22 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:37:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cc36a7-a0fc-4475-a62c-58c75614ed40]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:37:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:37:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:37:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:37:22 user nova-compute[74996]: DEBUG os_brick.utils [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:37:22 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Updating existing volume attachment record: 4d920353-a7ad-4ad4-8043-6319e07d99e4 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:37:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:37:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:37:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:22 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:37:22 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:37:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.598s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:37:23 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Deleted allocations for instance 12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a
Nov 02 01:37:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b6266103-9575-4008-83d5-e26238acce92 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "12f3dc5e-ff4f-4dc6-9e1a-d53ead46dd3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 27.210s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:37:23 user nova-compute[74996]: DEBUG nova.compute.manager [req-71770434-7a38-4d0d-bed5-b2b331302ac4 req-d91acfa0-642d-4f19-922f-e617c4ae9135 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Received event network-vif-plugged-d1504136-cb23-4cfd-981b-5f4a46f71bb1 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:37:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-71770434-7a38-4d0d-bed5-b2b331302ac4 req-d91acfa0-642d-4f19-922f-e617c4ae9135 service nova] Acquiring lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:37:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-71770434-7a38-4d0d-bed5-b2b331302ac4 req-d91acfa0-642d-4f19-922f-e617c4ae9135 service nova] Lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:37:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-71770434-7a38-4d0d-bed5-b2b331302ac4 req-d91acfa0-642d-4f19-922f-e617c4ae9135 service nova] Lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:37:23 user nova-compute[74996]: DEBUG nova.compute.manager [req-71770434-7a38-4d0d-bed5-b2b331302ac4 req-d91acfa0-642d-4f19-922f-e617c4ae9135 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] No waiting events found dispatching network-vif-plugged-d1504136-cb23-4cfd-981b-5f4a46f71bb1 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:37:23 user nova-compute[74996]: WARNING nova.compute.manager [req-71770434-7a38-4d0d-bed5-b2b331302ac4 req-d91acfa0-642d-4f19-922f-e617c4ae9135 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Received unexpected event network-vif-plugged-d1504136-cb23-4cfd-981b-5f4a46f71bb1 for instance with vm_state active and task_state None.
Nov 02 01:37:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:37:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 01:37:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:37:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:37:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:46 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "9d706c1a-883b-4b26-8972-4083df064e93" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:37:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "9d706c1a-883b-4b26-8972-4083df064e93" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:37:48 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:37:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:37:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:37:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:37:48 user nova-compute[74996]: INFO nova.compute.claims [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Claim successful on node user
Nov 02 01:37:49 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:37:49 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:37:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.525s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:37:49 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:37:49 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:37:49 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:37:49 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:37:49 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:37:49 user nova-compute[74996]: INFO nova.virt.block_device [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Booting with volume-backed-image f544db05-269f-4ce2-a9db-e2f89ecf2dd8 at /dev/vda
Nov 02 01:37:49 user nova-compute[74996]: DEBUG nova.policy [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15affb427e9b4fb8873accf286510e14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142161c2fae44bdea848619580195795', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:37:50 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Successfully created port: 9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:37:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:51 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Successfully updated port: 9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:37:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "refresh_cache-9d706c1a-883b-4b26-8972-4083df064e93" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:37:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquired lock "refresh_cache-9d706c1a-883b-4b26-8972-4083df064e93" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:37:51 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:37:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-5b9ed770-6438-49e0-bc2d-8ef00ca2050f req-acc2954b-c18b-48b0-9b57-979e5db82b54 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Received event network-changed-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:37:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-5b9ed770-6438-49e0-bc2d-8ef00ca2050f req-acc2954b-c18b-48b0-9b57-979e5db82b54 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Refreshing instance network info cache due to event network-changed-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:37:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5b9ed770-6438-49e0-bc2d-8ef00ca2050f req-acc2954b-c18b-48b0-9b57-979e5db82b54 service nova] Acquiring lock "refresh_cache-9d706c1a-883b-4b26-8972-4083df064e93" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:37:51 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:37:51 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Updating instance_info_cache with network_info: [{"id": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "address": "fa:16:3e:f0:bd:77", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9071ad51-8c", "ovs_interfaceid": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:37:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Releasing lock "refresh_cache-9d706c1a-883b-4b26-8972-4083df064e93" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:37:52 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Instance network_info: |[{"id": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "address": "fa:16:3e:f0:bd:77", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9071ad51-8c", "ovs_interfaceid": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:37:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5b9ed770-6438-49e0-bc2d-8ef00ca2050f req-acc2954b-c18b-48b0-9b57-979e5db82b54 service nova] Acquired lock "refresh_cache-9d706c1a-883b-4b26-8972-4083df064e93" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:37:52 user nova-compute[74996]: DEBUG nova.network.neutron [req-5b9ed770-6438-49e0-bc2d-8ef00ca2050f req-acc2954b-c18b-48b0-9b57-979e5db82b54 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Refreshing network info cache for port 9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:37:52 user nova-compute[74996]: DEBUG nova.network.neutron [req-5b9ed770-6438-49e0-bc2d-8ef00ca2050f req-acc2954b-c18b-48b0-9b57-979e5db82b54 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Updated VIF entry in instance network info cache for port 9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:37:52 user nova-compute[74996]: DEBUG nova.network.neutron [req-5b9ed770-6438-49e0-bc2d-8ef00ca2050f req-acc2954b-c18b-48b0-9b57-979e5db82b54 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Updating instance_info_cache with network_info: [{"id": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "address": "fa:16:3e:f0:bd:77", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9071ad51-8c", "ovs_interfaceid": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:37:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5b9ed770-6438-49e0-bc2d-8ef00ca2050f req-acc2954b-c18b-48b0-9b57-979e5db82b54 service nova] Releasing lock "refresh_cache-9d706c1a-883b-4b26-8972-4083df064e93" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:37:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:55 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:55 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:37:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:08 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:38:09 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:38:10 user nova-compute[74996]: DEBUG os_brick.utils [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:38:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:10 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a6791e-bbbb-424a-b8ff-2519b66f13a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:10 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a59351-cce2-489f-af81-0cf3438e5d73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:10 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0766f699-dc26-4d3c-9635-41f78f5fecbf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:10 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[988eae16-f266-4d0b-9891-4a9f855f0d86]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:38:10 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:38:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:38:10 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:38:10 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f952cfe-91ca-484c-a1b4-5bcefe145709]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:10 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:38:10 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:38:10 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:38:10 user nova-compute[74996]: DEBUG os_brick.utils [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:38:10 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Updating existing volume attachment record: 6b6832f4-84cf-4ea0-8baa-75ff12d655d8 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:38:10 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "fa6400fb-9e90-4f94-9da7-238b91276f41" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.005s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:11 user nova-compute[74996]: INFO nova.compute.manager [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Detaching volume a249585d-899f-41ad-ab90-28d47b08fcf1
Nov 02 01:38:11 user nova-compute[74996]: INFO nova.virt.block_device [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Attempting to driver detach volume a249585d-899f-41ad-ab90-28d47b08fcf1 from mountpoint /dev/vdb
Nov 02 01:38:11 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Attempting to detach device vdb from instance fa6400fb-9e90-4f94-9da7-238b91276f41 from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 01:38:11 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 01:38:11 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:38:11 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 01:38:11 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:38:11 user nova-compute[74996]:   <serial>a249585d-899f-41ad-ab90-28d47b08fcf1</serial>
Nov 02 01:38:11 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 01:38:11 user nova-compute[74996]: </disk>
Nov 02 01:38:11 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:38:11 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Successfully detached device vdb from instance fa6400fb-9e90-4f94-9da7-238b91276f41 from the persistent domain config.
Nov 02 01:38:11 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fa6400fb-9e90-4f94-9da7-238b91276f41 from the live domain config. {{(pid=74996) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 01:38:11 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 01:38:11 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:38:11 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 01:38:11 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:38:11 user nova-compute[74996]:   <serial>a249585d-899f-41ad-ab90-28d47b08fcf1</serial>
Nov 02 01:38:11 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 01:38:11 user nova-compute[74996]: </disk>
Nov 02 01:38:11 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:38:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fa6400fb-9e90-4f94-9da7-238b91276f41 {{(pid=74996) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 01:38:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:13 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:38:13 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:38:14 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:38:14 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:38:14 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:38:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:14 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:38:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:14 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:38:14 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:38:14 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:38:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:15 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:38:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac04bff6-90a5-439d-b07d-68e172485456/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac04bff6-90a5-439d-b07d-68e172485456/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac04bff6-90a5-439d-b07d-68e172485456/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac04bff6-90a5-439d-b07d-68e172485456/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:38:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:18 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:38:18 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:38:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=7392MB free_disk=25.197460174560547GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:38:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance fea802b7-64d9-4c77-87a7-eaba1dce5c22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:38:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7307f3a3-1ad1-43f7-be49-9cd03a626cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:38:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance fa6400fb-9e90-4f94-9da7-238b91276f41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:38:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance c04b39dd-3961-4e23-ad43-34a218f4a472 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:38:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 6b79aa2f-02c7-492e-b27e-7481e41f8d2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:38:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance d8f51f7d-c9de-4914-883e-7a875d3d73ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:38:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance adfc9441-d607-4b9f-8008-95e42f1ac51e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:38:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance f44d0b13-9dae-40c9-83d0-0b84699b1cc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:38:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance da10dadd-b04a-4f3b-92bd-fcaa18b51fce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:38:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance ac04bff6-90a5-439d-b07d-68e172485456 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:38:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 9d706c1a-883b-4b26-8972-4083df064e93 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:38:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:38:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:38:18 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:38:18 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:38:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:38:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.556s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:19 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:38:19 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:38:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-7307f3a3-1ad1-43f7-be49-9cd03a626cd7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:38:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-7307f3a3-1ad1-43f7-be49-9cd03a626cd7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:38:20 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 01:38:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:20 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Updating instance_info_cache with network_info: [{"id": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "address": "fa:16:3e:97:27:02", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb645a26c-6f", "ovs_interfaceid": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:38:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-7307f3a3-1ad1-43f7-be49-9cd03a626cd7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:38:20 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 01:38:20 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:38:20 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:38:24 user nova-compute[74996]: DEBUG nova.compute.manager [req-18e5042b-266a-4534-9b5e-8633e510d902 req-028768e1-dd1f-4245-9259-3792a7726807 service nova] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Received event network-changed-63a93574-ffa2-45a1-9a42-b93779f1d7bb {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:24 user nova-compute[74996]: DEBUG nova.compute.manager [req-18e5042b-266a-4534-9b5e-8633e510d902 req-028768e1-dd1f-4245-9259-3792a7726807 service nova] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Refreshing instance network info cache due to event network-changed-63a93574-ffa2-45a1-9a42-b93779f1d7bb. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:38:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-18e5042b-266a-4534-9b5e-8633e510d902 req-028768e1-dd1f-4245-9259-3792a7726807 service nova] Acquiring lock "refresh_cache-da10dadd-b04a-4f3b-92bd-fcaa18b51fce" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:38:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-18e5042b-266a-4534-9b5e-8633e510d902 req-028768e1-dd1f-4245-9259-3792a7726807 service nova] Acquired lock "refresh_cache-da10dadd-b04a-4f3b-92bd-fcaa18b51fce" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:38:24 user nova-compute[74996]: DEBUG nova.network.neutron [req-18e5042b-266a-4534-9b5e-8633e510d902 req-028768e1-dd1f-4245-9259-3792a7726807 service nova] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Refreshing network info cache for port 63a93574-ffa2-45a1-9a42-b93779f1d7bb {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:38:24 user nova-compute[74996]: DEBUG nova.network.neutron [req-18e5042b-266a-4534-9b5e-8633e510d902 req-028768e1-dd1f-4245-9259-3792a7726807 service nova] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Updated VIF entry in instance network info cache for port 63a93574-ffa2-45a1-9a42-b93779f1d7bb. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:38:24 user nova-compute[74996]: DEBUG nova.network.neutron [req-18e5042b-266a-4534-9b5e-8633e510d902 req-028768e1-dd1f-4245-9259-3792a7726807 service nova] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Updating instance_info_cache with network_info: [{"id": "63a93574-ffa2-45a1-9a42-b93779f1d7bb", "address": "fa:16:3e:f8:1e:be", "network": {"id": "2a051be1-8b15-49b1-8686-7da5c3825033", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1021749906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4094553af48241d9896971038ca4560c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63a93574-ff", "ovs_interfaceid": "63a93574-ffa2-45a1-9a42-b93779f1d7bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:38:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-18e5042b-266a-4534-9b5e-8633e510d902 req-028768e1-dd1f-4245-9259-3792a7726807 service nova] Releasing lock "refresh_cache-da10dadd-b04a-4f3b-92bd-fcaa18b51fce" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:38:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Acquiring lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:24 user nova-compute[74996]: DEBUG nova.objects.instance [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lazy-loading 'flavor' on Instance uuid da10dadd-b04a-4f3b-92bd-fcaa18b51fce {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:38:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Acquiring lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:25 user nova-compute[74996]: INFO nova.compute.manager [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Attaching volume 93e3e6fa-4c8c-43f0-9138-e4bac5747855 to /dev/vdb
Nov 02 01:38:25 user nova-compute[74996]: DEBUG os_brick.utils [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:38:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:25 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f2a4fc-ed6a-49c8-8e58-5e38809325ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:25 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7727fa09-d33e-4702-b6b8-dce73e488b36]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:25 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[47133b7b-95c6-40d6-a467-7a8be8c10861]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:25 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1c865a-fa89-4884-b1a3-78918c53ef48]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:38:25 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:38:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:38:25 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:38:25 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94e966f-e7ee-4e0c-83e3-860e394dda78]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:25 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:38:25 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:38:25 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:38:25 user nova-compute[74996]: DEBUG os_brick.utils [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:38:25 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Updating existing volume attachment record: 401ec023-028f-491c-8fe2-4963a3e2abd3 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:38:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:30 user nova-compute[74996]: DEBUG nova.compute.manager [req-cb88c37b-eebe-4773-a31c-d420d294b613 req-20ab9c10-fa1c-4832-87e6-9374fd8fcba2 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-changed-863ea8b0-7e3d-459a-bfb7-435e3e5001bf {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:30 user nova-compute[74996]: DEBUG nova.compute.manager [req-cb88c37b-eebe-4773-a31c-d420d294b613 req-20ab9c10-fa1c-4832-87e6-9374fd8fcba2 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Refreshing instance network info cache due to event network-changed-863ea8b0-7e3d-459a-bfb7-435e3e5001bf. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:38:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cb88c37b-eebe-4773-a31c-d420d294b613 req-20ab9c10-fa1c-4832-87e6-9374fd8fcba2 service nova] Acquiring lock "refresh_cache-adfc9441-d607-4b9f-8008-95e42f1ac51e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:38:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cb88c37b-eebe-4773-a31c-d420d294b613 req-20ab9c10-fa1c-4832-87e6-9374fd8fcba2 service nova] Acquired lock "refresh_cache-adfc9441-d607-4b9f-8008-95e42f1ac51e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:38:30 user nova-compute[74996]: DEBUG nova.network.neutron [req-cb88c37b-eebe-4773-a31c-d420d294b613 req-20ab9c10-fa1c-4832-87e6-9374fd8fcba2 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Refreshing network info cache for port 863ea8b0-7e3d-459a-bfb7-435e3e5001bf {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:38:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG nova.network.neutron [req-cb88c37b-eebe-4773-a31c-d420d294b613 req-20ab9c10-fa1c-4832-87e6-9374fd8fcba2 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Updated VIF entry in instance network info cache for port 863ea8b0-7e3d-459a-bfb7-435e3e5001bf. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG nova.network.neutron [req-cb88c37b-eebe-4773-a31c-d420d294b613 req-20ab9c10-fa1c-4832-87e6-9374fd8fcba2 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Updating instance_info_cache with network_info: [{"id": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "address": "fa:16:3e:17:b8:62", "network": {"id": "45d38091-67e6-414b-9989-e308ebdcf57d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1896108595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap863ea8b0-7e", "ovs_interfaceid": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62492819-8da0-4a9f-9f78-facaaa194017", "address": "fa:16:3e:ac:91:39", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62492819-8d", "ovs_interfaceid": "62492819-8da0-4a9f-9f78-facaaa194017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "019034ca-6f89-400f-b47a-61e1157f860f", "address": "fa:16:3e:7f:67:62", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap019034ca-6f", "ovs_interfaceid": "019034ca-6f89-400f-b47a-61e1157f860f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "37104018-4ea0-4b2f-b507-8887a4f7348a", "address": "fa:16:3e:8a:b6:d9", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37104018-4e", "ovs_interfaceid": "37104018-4ea0-4b2f-b507-8887a4f7348a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ade5deb-e2db-4310-b1a6-df399639eb00", "address": "fa:16:3e:22:42:a5", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ade5deb-e2", "ovs_interfaceid": "3ade5deb-e2db-4310-b1a6-df399639eb00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9042d944-67c5-4e39-9232-72ff23c6f1e0", "address": "fa:16:3e:05:b8:e8", "network": {"id": "9778b912-7b91-4a57-a5d6-fa3e8fd1016c", "bridge": "br-int", "label": "tempest-device-tagging-net2-519483991", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9042d944-67", "ovs_interfaceid": "9042d944-67c5-4e39-9232-72ff23c6f1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87bf8398-6ede-4465-9555-1000f74e75ff", "address": "fa:16:3e:67:28:a7", "network": {"id": "9778b912-7b91-4a57-a5d6-fa3e8fd1016c", "bridge": "br-int", "label": "tempest-device-tagging-net2-519483991", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87bf8398-6e", "ovs_interfaceid": "87bf8398-6ede-4465-9555-1000f74e75ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cb88c37b-eebe-4773-a31c-d420d294b613 req-20ab9c10-fa1c-4832-87e6-9374fd8fcba2 service nova] Releasing lock "refresh_cache-adfc9441-d607-4b9f-8008-95e42f1ac51e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixIUuWLZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:38:31 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:38:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:38:31 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:38:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:38:31 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[96693b43-ceb8-45f0-bd39-d71c46b28fbc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:38:31 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0454f565-4c5e-4943-9136-da1c9cfaf983]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611] added
Nov 02 01:38:31 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ac3c74-548a-4ba0-bdf0-e74bb441889c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ab59c2-e257-49a8-a6a2-f7e9496a6e54]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ixIUuWLZ {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ixIUuWLZ" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f0477d-b83d-4042-817d-bdfe925c4845]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ixIUuWLZ'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2ab851-c4a4-49f3-9467-5611cbcaaf85]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f865022a-6f61-4e17-b37d-6305e332050c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:38:31 user nova-compute[74996]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)
Nov 02 01:38:31 user nova-compute[74996]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:38:31 user nova-compute[74996]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:38:31 user nova-compute[74996]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)
Nov 02 01:38:31 user nova-compute[74996]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:38:31 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:38:31 user nova-compute[74996]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)
Nov 02 01:38:31 user nova-compute[74996]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:38:31 user nova-compute[74996]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:38:31 user nova-compute[74996]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)
Nov 02 01:38:31 user nova-compute[74996]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:38:31 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0213c45b-a26f-4299-93a4-24f5d7dbd2f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611, portal: 172.16.0.220,3260]
Nov 02 01:38:31 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611, portal: 172.16.0.220,3260] successful.
Nov 02 01:38:31 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5abd59-513f-46bf-a60e-4711123a9b67]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b73d536-5a55-471a-90cb-b2de0ca047b9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:38:31 user nova-compute[74996]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)
Nov 02 01:38:31 user nova-compute[74996]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:38:31 user nova-compute[74996]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:38:31 user nova-compute[74996]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)
Nov 02 01:38:31 user nova-compute[74996]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:38:31 user nova-compute[74996]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)
Nov 02 01:38:31 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:38:31 user nova-compute[74996]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)
Nov 02 01:38:31 user nova-compute[74996]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:38:31 user nova-compute[74996]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:38:31 user nova-compute[74996]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)
Nov 02 01:38:31 user nova-compute[74996]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:38:31 user nova-compute[74996]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)
Nov 02 01:38:31 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.419s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0484ab3c-c7be-4688-9576-33d0e2aa9199]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:31 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: None {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:38:32 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fa6400fb-9e90-4f94-9da7-238b91276f41 is timed out.
Nov 02 01:38:32 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Successfully detached device vdb from instance fa6400fb-9e90-4f94-9da7-238b91276f41 from the live domain config.
Nov 02 01:38:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMBCqxAQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:38:32 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:38:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixIUuWLZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.456s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] <== connect_volume: return (1458ms) {'type': 'block', 'scsi_wwn': '26532643165386635', 'path': '/dev/sdd'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532643165386635', 'path': '/dev/sdd'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.399s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG nova.objects.instance [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lazy-loading 'flavor' on Instance uuid f44d0b13-9dae-40c9-83d0-0b84699b1cc2 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ce7175-f70d-48f7-a792-f9667ede45c4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:38:32 user nova-compute[74996]: No targets found.
Nov 02 01:38:32 user nova-compute[74996]: iSNS:
Nov 02 01:38:32 user nova-compute[74996]: No targets found.
Nov 02 01:38:32 user nova-compute[74996]: STATIC:
Nov 02 01:38:32 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1
Nov 02 01:38:32 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:32 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:32 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0
Nov 02 01:38:32 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:32 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:32 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611
Nov 02 01:38:32 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:32 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:32 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84
Nov 02 01:38:32 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:32 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:32 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873
Nov 02 01:38:32 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:32 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:32 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8
Nov 02 01:38:32 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:32 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:32 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181
Nov 02 01:38:32 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:32 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:32 user nova-compute[74996]: FIRMWARE:
Nov 02 01:38:32 user nova-compute[74996]: No targets found.
Nov 02 01:38:32 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:38:32 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:38:32 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 01:38:32 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:38:32 user nova-compute[74996]:   <source dev="/dev/sdd"/>
Nov 02 01:38:32 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:38:32 user nova-compute[74996]:   <serial>6336836f-4059-41bb-b86d-6ae54b4de611</serial>
Nov 02 01:38:32 user nova-compute[74996]: </disk>
Nov 02 01:38:32 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa378ca-c34e-46f2-86c4-26916f282724]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2adba3-26fc-4908-94fd-e52fc1b5f1ea]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:38:32 user nova-compute[74996]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)
Nov 02 01:38:32 user nova-compute[74996]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:38:32 user nova-compute[74996]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:38:32 user nova-compute[74996]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)
Nov 02 01:38:32 user nova-compute[74996]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:38:32 user nova-compute[74996]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)
Nov 02 01:38:32 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 (non-flash)
Nov 02 01:38:32 user nova-compute[74996]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)
Nov 02 01:38:32 user nova-compute[74996]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:38:32 user nova-compute[74996]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:38:32 user nova-compute[74996]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)
Nov 02 01:38:32 user nova-compute[74996]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:38:32 user nova-compute[74996]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)
Nov 02 01:38:32 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e852c280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1'): ({'sdb'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Removing single pathed devices sdb {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[57da448a-bcfc-4754-b201-16d27acc64d5]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[52815f09-cd5a-4842-b483-53b5471b7094]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Flushing IO for device /dev/sdb {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cceb64-f032-41d9-a5cb-708e7ffbf719]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:38:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[88480fc4-dc34-42d3-b7d5-530e9188d495]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5693f86c-5189-4532-8250-8dbfa5aef66b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.104s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63732b6-3f19-4987-bb69-c6b656027f7f]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1, portal: 172.16.0.220,3260]
Nov 02 01:38:33 user nova-compute[74996]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1, portal: 172.16.0.220,3260] successful.
Nov 02 01:38:33 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:33 user nova-compute[74996]: INFO nova.compute.manager [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Terminating instance
Nov 02 01:38:33 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249585d-899f-41ad-ab90-28d47b08fcf1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68138fa-705f-4385-a1e6-dfe387823521]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.430s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] <== disconnect_volume: return (830ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] No BDM found with device name hda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] No VIF found with MAC fa:16:3e:e1:e1:a7, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-7e851b41-e06c-4183-9a8e-7a682309fef6 req-b00ba6ab-14c7-4156-87ad-ec9be3a174af service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-unplugged-863ea8b0-7e3d-459a-bfb7-435e3e5001bf {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7e851b41-e06c-4183-9a8e-7a682309fef6 req-b00ba6ab-14c7-4156-87ad-ec9be3a174af service nova] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7e851b41-e06c-4183-9a8e-7a682309fef6 req-b00ba6ab-14c7-4156-87ad-ec9be3a174af service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7e851b41-e06c-4183-9a8e-7a682309fef6 req-b00ba6ab-14c7-4156-87ad-ec9be3a174af service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-7e851b41-e06c-4183-9a8e-7a682309fef6 req-b00ba6ab-14c7-4156-87ad-ec9be3a174af service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] No waiting events found dispatching network-vif-unplugged-863ea8b0-7e3d-459a-bfb7-435e3e5001bf {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-7e851b41-e06c-4183-9a8e-7a682309fef6 req-b00ba6ab-14c7-4156-87ad-ec9be3a174af service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-unplugged-863ea8b0-7e3d-459a-bfb7-435e3e5001bf for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-84e0da3a-8bea-4916-9dec-349ff20fb29a req-1b467a5f-eb78-4364-9f4e-46fb9bdca935 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-unplugged-62492819-8da0-4a9f-9f78-facaaa194017 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-84e0da3a-8bea-4916-9dec-349ff20fb29a req-1b467a5f-eb78-4364-9f4e-46fb9bdca935 service nova] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-84e0da3a-8bea-4916-9dec-349ff20fb29a req-1b467a5f-eb78-4364-9f4e-46fb9bdca935 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-84e0da3a-8bea-4916-9dec-349ff20fb29a req-1b467a5f-eb78-4364-9f4e-46fb9bdca935 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-84e0da3a-8bea-4916-9dec-349ff20fb29a req-1b467a5f-eb78-4364-9f4e-46fb9bdca935 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] No waiting events found dispatching network-vif-unplugged-62492819-8da0-4a9f-9f78-facaaa194017 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-84e0da3a-8bea-4916-9dec-349ff20fb29a req-1b467a5f-eb78-4364-9f4e-46fb9bdca935 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-unplugged-62492819-8da0-4a9f-9f78-facaaa194017 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-08a3ee69-8c0b-44c8-ab47-75dfb6621fa0 req-3119abac-c44e-4986-886c-8ebfad8bd98f service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-unplugged-019034ca-6f89-400f-b47a-61e1157f860f {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-08a3ee69-8c0b-44c8-ab47-75dfb6621fa0 req-3119abac-c44e-4986-886c-8ebfad8bd98f service nova] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-08a3ee69-8c0b-44c8-ab47-75dfb6621fa0 req-3119abac-c44e-4986-886c-8ebfad8bd98f service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-08a3ee69-8c0b-44c8-ab47-75dfb6621fa0 req-3119abac-c44e-4986-886c-8ebfad8bd98f service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-08a3ee69-8c0b-44c8-ab47-75dfb6621fa0 req-3119abac-c44e-4986-886c-8ebfad8bd98f service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] No waiting events found dispatching network-vif-unplugged-019034ca-6f89-400f-b47a-61e1157f860f {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-08a3ee69-8c0b-44c8-ab47-75dfb6621fa0 req-3119abac-c44e-4986-886c-8ebfad8bd98f service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-unplugged-019034ca-6f89-400f-b47a-61e1157f860f for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Instance destroyed successfully.
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.objects.instance [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lazy-loading 'resources' on Instance uuid adfc9441-d607-4b9f-8008-95e42f1ac51e {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2013159103',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2013159103',id=16,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjPh1tYKHTOH/pGrIpH4Vnubbyf2JsMVF1j+/2RGvozo0HqHWCbSS+Du5081BPYO/UtSiHfiCCf4AM6VV/EbbE3fWTf+keq4ZAqlefVkN1Xv7HHB/RbZQGr5ddsosvM3Q==',key_name='tempest-keypair-130817105',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:36:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f98a3a508c5c4966806cb9352c4b9090',ramdisk_id='',reservation_id='r-h1s4ky3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-997890989',owner_user_name='tempest-TaggedBootDevicesTest-997890989-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:36:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47029fcd5f04869ab686e226867793c',uuid=adfc9441-d607-4b9f-8008-95e42f1ac51e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "address": "fa:16:3e:17:b8:62", "network": {"id": "45d38091-67e6-414b-9989-e308ebdcf57d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1896108595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap863ea8b0-7e", "ovs_interfaceid": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converting VIF {"id": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "address": "fa:16:3e:17:b8:62", "network": {"id": "45d38091-67e6-414b-9989-e308ebdcf57d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1896108595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap863ea8b0-7e", "ovs_interfaceid": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:b8:62,bridge_name='br-int',has_traffic_filtering=True,id=863ea8b0-7e3d-459a-bfb7-435e3e5001bf,network=Network(45d38091-67e6-414b-9989-e308ebdcf57d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap863ea8b0-7e') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG os_vif [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:b8:62,bridge_name='br-int',has_traffic_filtering=True,id=863ea8b0-7e3d-459a-bfb7-435e3e5001bf,network=Network(45d38091-67e6-414b-9989-e308ebdcf57d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap863ea8b0-7e') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap863ea8b0-7e, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ebbde07e-13ff-41f2-b2ef-15b026001648) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: INFO os_vif [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:b8:62,bridge_name='br-int',has_traffic_filtering=True,id=863ea8b0-7e3d-459a-bfb7-435e3e5001bf,network=Network(45d38091-67e6-414b-9989-e308ebdcf57d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap863ea8b0-7e')
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2013159103',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2013159103',id=16,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjPh1tYKHTOH/pGrIpH4Vnubbyf2JsMVF1j+/2RGvozo0HqHWCbSS+Du5081BPYO/UtSiHfiCCf4AM6VV/EbbE3fWTf+keq4ZAqlefVkN1Xv7HHB/RbZQGr5ddsosvM3Q==',key_name='tempest-keypair-130817105',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:36:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f98a3a508c5c4966806cb9352c4b9090',ramdisk_id='',reservation_id='r-h1s4ky3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-997890989',owner_user_name='tempest-TaggedBootDevicesTest-997890989-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:36:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47029fcd5f04869ab686e226867793c',uuid=adfc9441-d607-4b9f-8008-95e42f1ac51e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62492819-8da0-4a9f-9f78-facaaa194017", "address": "fa:16:3e:ac:91:39", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62492819-8d", "ovs_interfaceid": "62492819-8da0-4a9f-9f78-facaaa194017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converting VIF {"id": "62492819-8da0-4a9f-9f78-facaaa194017", "address": "fa:16:3e:ac:91:39", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62492819-8d", "ovs_interfaceid": "62492819-8da0-4a9f-9f78-facaaa194017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:91:39,bridge_name='br-int',has_traffic_filtering=True,id=62492819-8da0-4a9f-9f78-facaaa194017,network=Network(a16e25af-6044-4089-8641-2b184d9e13b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap62492819-8d') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG os_vif [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:91:39,bridge_name='br-int',has_traffic_filtering=True,id=62492819-8da0-4a9f-9f78-facaaa194017,network=Network(a16e25af-6044-4089-8641-2b184d9e13b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap62492819-8d') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62492819-8d, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb0d3920-ee20-4c33-bd6c-fe722ef6353b) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: INFO os_vif [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:91:39,bridge_name='br-int',has_traffic_filtering=True,id=62492819-8da0-4a9f-9f78-facaaa194017,network=Network(a16e25af-6044-4089-8641-2b184d9e13b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap62492819-8d')
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2013159103',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2013159103',id=16,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjPh1tYKHTOH/pGrIpH4Vnubbyf2JsMVF1j+/2RGvozo0HqHWCbSS+Du5081BPYO/UtSiHfiCCf4AM6VV/EbbE3fWTf+keq4ZAqlefVkN1Xv7HHB/RbZQGr5ddsosvM3Q==',key_name='tempest-keypair-130817105',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:36:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f98a3a508c5c4966806cb9352c4b9090',ramdisk_id='',reservation_id='r-h1s4ky3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-997890989',owner_user_name='tempest-TaggedBootDevicesTest-997890989-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:36:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47029fcd5f04869ab686e226867793c',uuid=adfc9441-d607-4b9f-8008-95e42f1ac51e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "019034ca-6f89-400f-b47a-61e1157f860f", "address": "fa:16:3e:7f:67:62", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap019034ca-6f", "ovs_interfaceid": "019034ca-6f89-400f-b47a-61e1157f860f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converting VIF {"id": "019034ca-6f89-400f-b47a-61e1157f860f", "address": "fa:16:3e:7f:67:62", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap019034ca-6f", "ovs_interfaceid": "019034ca-6f89-400f-b47a-61e1157f860f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:67:62,bridge_name='br-int',has_traffic_filtering=True,id=019034ca-6f89-400f-b47a-61e1157f860f,network=Network(a16e25af-6044-4089-8641-2b184d9e13b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap019034ca-6f') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG os_vif [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:67:62,bridge_name='br-int',has_traffic_filtering=True,id=019034ca-6f89-400f-b47a-61e1157f860f,network=Network(a16e25af-6044-4089-8641-2b184d9e13b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap019034ca-6f') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap019034ca-6f, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=acbf9c0f-4b6f-4ed0-b6d0-b98e4eddeb6d) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: INFO os_vif [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:67:62,bridge_name='br-int',has_traffic_filtering=True,id=019034ca-6f89-400f-b47a-61e1157f860f,network=Network(a16e25af-6044-4089-8641-2b184d9e13b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap019034ca-6f')
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2013159103',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2013159103',id=16,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjPh1tYKHTOH/pGrIpH4Vnubbyf2JsMVF1j+/2RGvozo0HqHWCbSS+Du5081BPYO/UtSiHfiCCf4AM6VV/EbbE3fWTf+keq4ZAqlefVkN1Xv7HHB/RbZQGr5ddsosvM3Q==',key_name='tempest-keypair-130817105',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:36:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f98a3a508c5c4966806cb9352c4b9090',ramdisk_id='',reservation_id='r-h1s4ky3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-997890989',owner_user_name='tempest-TaggedBootDevicesTest-997890989-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:36:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47029fcd5f04869ab686e226867793c',uuid=adfc9441-d607-4b9f-8008-95e42f1ac51e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37104018-4ea0-4b2f-b507-8887a4f7348a", "address": "fa:16:3e:8a:b6:d9", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37104018-4e", "ovs_interfaceid": "37104018-4ea0-4b2f-b507-8887a4f7348a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converting VIF {"id": "37104018-4ea0-4b2f-b507-8887a4f7348a", "address": "fa:16:3e:8a:b6:d9", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37104018-4e", "ovs_interfaceid": "37104018-4ea0-4b2f-b507-8887a4f7348a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:b6:d9,bridge_name='br-int',has_traffic_filtering=True,id=37104018-4ea0-4b2f-b507-8887a4f7348a,network=Network(a16e25af-6044-4089-8641-2b184d9e13b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37104018-4e') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG os_vif [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:b6:d9,bridge_name='br-int',has_traffic_filtering=True,id=37104018-4ea0-4b2f-b507-8887a4f7348a,network=Network(a16e25af-6044-4089-8641-2b184d9e13b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37104018-4e') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37104018-4e, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cbf0ff94-2588-4321-893f-ee702eea49e4 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 73.656s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4fb3003-4974-487f-be26-561befefc704) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: INFO os_vif [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:b6:d9,bridge_name='br-int',has_traffic_filtering=True,id=37104018-4ea0-4b2f-b507-8887a4f7348a,network=Network(a16e25af-6044-4089-8641-2b184d9e13b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37104018-4e')
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2013159103',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2013159103',id=16,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjPh1tYKHTOH/pGrIpH4Vnubbyf2JsMVF1j+/2RGvozo0HqHWCbSS+Du5081BPYO/UtSiHfiCCf4AM6VV/EbbE3fWTf+keq4ZAqlefVkN1Xv7HHB/RbZQGr5ddsosvM3Q==',key_name='tempest-keypair-130817105',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:36:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f98a3a508c5c4966806cb9352c4b9090',ramdisk_id='',reservation_id='r-h1s4ky3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-997890989',owner_user_name='tempest-TaggedBootDevicesTest-997890989-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:36:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47029fcd5f04869ab686e226867793c',uuid=adfc9441-d607-4b9f-8008-95e42f1ac51e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ade5deb-e2db-4310-b1a6-df399639eb00", "address": "fa:16:3e:22:42:a5", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ade5deb-e2", "ovs_interfaceid": "3ade5deb-e2db-4310-b1a6-df399639eb00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converting VIF {"id": "3ade5deb-e2db-4310-b1a6-df399639eb00", "address": "fa:16:3e:22:42:a5", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ade5deb-e2", "ovs_interfaceid": "3ade5deb-e2db-4310-b1a6-df399639eb00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:42:a5,bridge_name='br-int',has_traffic_filtering=True,id=3ade5deb-e2db-4310-b1a6-df399639eb00,network=Network(a16e25af-6044-4089-8641-2b184d9e13b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ade5deb-e2') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG os_vif [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:42:a5,bridge_name='br-int',has_traffic_filtering=True,id=3ade5deb-e2db-4310-b1a6-df399639eb00,network=Network(a16e25af-6044-4089-8641-2b184d9e13b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ade5deb-e2') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ade5deb-e2, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dfc9dc6c-a2b8-4f55-9ab5-6eeeaaf700ac) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: INFO os_vif [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:42:a5,bridge_name='br-int',has_traffic_filtering=True,id=3ade5deb-e2db-4310-b1a6-df399639eb00,network=Network(a16e25af-6044-4089-8641-2b184d9e13b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ade5deb-e2')
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2013159103',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2013159103',id=16,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjPh1tYKHTOH/pGrIpH4Vnubbyf2JsMVF1j+/2RGvozo0HqHWCbSS+Du5081BPYO/UtSiHfiCCf4AM6VV/EbbE3fWTf+keq4ZAqlefVkN1Xv7HHB/RbZQGr5ddsosvM3Q==',key_name='tempest-keypair-130817105',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:36:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f98a3a508c5c4966806cb9352c4b9090',ramdisk_id='',reservation_id='r-h1s4ky3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-997890989',owner_user_name='tempest-TaggedBootDevicesTest-997890989-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:36:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47029fcd5f04869ab686e226867793c',uuid=adfc9441-d607-4b9f-8008-95e42f1ac51e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9042d944-67c5-4e39-9232-72ff23c6f1e0", "address": "fa:16:3e:05:b8:e8", "network": {"id": "9778b912-7b91-4a57-a5d6-fa3e8fd1016c", "bridge": "br-int", "label": "tempest-device-tagging-net2-519483991", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9042d944-67", "ovs_interfaceid": "9042d944-67c5-4e39-9232-72ff23c6f1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converting VIF {"id": "9042d944-67c5-4e39-9232-72ff23c6f1e0", "address": "fa:16:3e:05:b8:e8", "network": {"id": "9778b912-7b91-4a57-a5d6-fa3e8fd1016c", "bridge": "br-int", "label": "tempest-device-tagging-net2-519483991", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9042d944-67", "ovs_interfaceid": "9042d944-67c5-4e39-9232-72ff23c6f1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:b8:e8,bridge_name='br-int',has_traffic_filtering=True,id=9042d944-67c5-4e39-9232-72ff23c6f1e0,network=Network(9778b912-7b91-4a57-a5d6-fa3e8fd1016c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9042d944-67') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG os_vif [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:b8:e8,bridge_name='br-int',has_traffic_filtering=True,id=9042d944-67c5-4e39-9232-72ff23c6f1e0,network=Network(9778b912-7b91-4a57-a5d6-fa3e8fd1016c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9042d944-67') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9042d944-67, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cd4a4b92-796b-47ac-ad97-64c20b7ea856) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: INFO os_vif [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:b8:e8,bridge_name='br-int',has_traffic_filtering=True,id=9042d944-67c5-4e39-9232-72ff23c6f1e0,network=Network(9778b912-7b91-4a57-a5d6-fa3e8fd1016c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9042d944-67')
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2013159103',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2013159103',id=16,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjPh1tYKHTOH/pGrIpH4Vnubbyf2JsMVF1j+/2RGvozo0HqHWCbSS+Du5081BPYO/UtSiHfiCCf4AM6VV/EbbE3fWTf+keq4ZAqlefVkN1Xv7HHB/RbZQGr5ddsosvM3Q==',key_name='tempest-keypair-130817105',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:36:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f98a3a508c5c4966806cb9352c4b9090',ramdisk_id='',reservation_id='r-h1s4ky3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-997890989',owner_user_name='tempest-TaggedBootDevicesTest-997890989-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:36:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a47029fcd5f04869ab686e226867793c',uuid=adfc9441-d607-4b9f-8008-95e42f1ac51e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87bf8398-6ede-4465-9555-1000f74e75ff", "address": "fa:16:3e:67:28:a7", "network": {"id": "9778b912-7b91-4a57-a5d6-fa3e8fd1016c", "bridge": "br-int", "label": "tempest-device-tagging-net2-519483991", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87bf8398-6e", "ovs_interfaceid": "87bf8398-6ede-4465-9555-1000f74e75ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converting VIF {"id": "87bf8398-6ede-4465-9555-1000f74e75ff", "address": "fa:16:3e:67:28:a7", "network": {"id": "9778b912-7b91-4a57-a5d6-fa3e8fd1016c", "bridge": "br-int", "label": "tempest-device-tagging-net2-519483991", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87bf8398-6e", "ovs_interfaceid": "87bf8398-6ede-4465-9555-1000f74e75ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:28:a7,bridge_name='br-int',has_traffic_filtering=True,id=87bf8398-6ede-4465-9555-1000f74e75ff,network=Network(9778b912-7b91-4a57-a5d6-fa3e8fd1016c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87bf8398-6e') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG os_vif [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:28:a7,bridge_name='br-int',has_traffic_filtering=True,id=87bf8398-6ede-4465-9555-1000f74e75ff,network=Network(9778b912-7b91-4a57-a5d6-fa3e8fd1016c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87bf8398-6e') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87bf8398-6e, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:38:35 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Creating image(s)
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Did not create local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Ensure instance console log exists: /opt/stack/data/nova/instances/9d706c1a-883b-4b26-8972-4083df064e93/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Start _get_guest_xml network_info=[{"id": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "address": "fa:16:3e:f0:bd:77", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9071ad51-8c", "ovs_interfaceid": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6b6832f4-84cf-4ea0-8baa-75ff12d655d8', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEHAcMyI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9d706c1a-883b-4b26-8972-4083df064e93', 'attached_at': '', 'detached_at': '', 'volume_id': '056998b8-61e1-46e5-b497-c0ee61ae9ff7', 'serial': '056998b8-61e1-46e5-b497-c0ee61ae9ff7'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.compute.manager [req-a9872574-de7b-4a2a-a285-3cba3c4bcb7e req-4a4056d1-8d62-47b7-880d-4a88e58944e4 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-plugged-863ea8b0-7e3d-459a-bfb7-435e3e5001bf {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a9872574-de7b-4a2a-a285-3cba3c4bcb7e req-4a4056d1-8d62-47b7-880d-4a88e58944e4 service nova] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a9872574-de7b-4a2a-a285-3cba3c4bcb7e req-4a4056d1-8d62-47b7-880d-4a88e58944e4 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a9872574-de7b-4a2a-a285-3cba3c4bcb7e req-4a4056d1-8d62-47b7-880d-4a88e58944e4 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.compute.manager [req-a9872574-de7b-4a2a-a285-3cba3c4bcb7e req-4a4056d1-8d62-47b7-880d-4a88e58944e4 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] No waiting events found dispatching network-vif-plugged-863ea8b0-7e3d-459a-bfb7-435e3e5001bf {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:38:35 user nova-compute[74996]: WARNING nova.compute.manager [req-a9872574-de7b-4a2a-a285-3cba3c4bcb7e req-4a4056d1-8d62-47b7-880d-4a88e58944e4 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received unexpected event network-vif-plugged-863ea8b0-7e3d-459a-bfb7-435e3e5001bf for instance with vm_state active and task_state deleting.
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.compute.manager [req-a9872574-de7b-4a2a-a285-3cba3c4bcb7e req-4a4056d1-8d62-47b7-880d-4a88e58944e4 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-unplugged-3ade5deb-e2db-4310-b1a6-df399639eb00 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a9872574-de7b-4a2a-a285-3cba3c4bcb7e req-4a4056d1-8d62-47b7-880d-4a88e58944e4 service nova] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a9872574-de7b-4a2a-a285-3cba3c4bcb7e req-4a4056d1-8d62-47b7-880d-4a88e58944e4 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a9872574-de7b-4a2a-a285-3cba3c4bcb7e req-4a4056d1-8d62-47b7-880d-4a88e58944e4 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.compute.manager [req-a9872574-de7b-4a2a-a285-3cba3c4bcb7e req-4a4056d1-8d62-47b7-880d-4a88e58944e4 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] No waiting events found dispatching network-vif-unplugged-3ade5deb-e2db-4310-b1a6-df399639eb00 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.compute.manager [req-a9872574-de7b-4a2a-a285-3cba3c4bcb7e req-4a4056d1-8d62-47b7-880d-4a88e58944e4 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-unplugged-3ade5deb-e2db-4310-b1a6-df399639eb00 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.compute.manager [req-a9872574-de7b-4a2a-a285-3cba3c4bcb7e req-4a4056d1-8d62-47b7-880d-4a88e58944e4 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-plugged-3ade5deb-e2db-4310-b1a6-df399639eb00 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a9872574-de7b-4a2a-a285-3cba3c4bcb7e req-4a4056d1-8d62-47b7-880d-4a88e58944e4 service nova] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a9872574-de7b-4a2a-a285-3cba3c4bcb7e req-4a4056d1-8d62-47b7-880d-4a88e58944e4 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a9872574-de7b-4a2a-a285-3cba3c4bcb7e req-4a4056d1-8d62-47b7-880d-4a88e58944e4 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.compute.manager [req-a9872574-de7b-4a2a-a285-3cba3c4bcb7e req-4a4056d1-8d62-47b7-880d-4a88e58944e4 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] No waiting events found dispatching network-vif-plugged-3ade5deb-e2db-4310-b1a6-df399639eb00 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:38:35 user nova-compute[74996]: WARNING nova.compute.manager [req-a9872574-de7b-4a2a-a285-3cba3c4bcb7e req-4a4056d1-8d62-47b7-880d-4a88e58944e4 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received unexpected event network-vif-plugged-3ade5deb-e2db-4310-b1a6-df399639eb00 for instance with vm_state active and task_state deleting.
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.compute.manager [req-a9872574-de7b-4a2a-a285-3cba3c4bcb7e req-4a4056d1-8d62-47b7-880d-4a88e58944e4 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-unplugged-9042d944-67c5-4e39-9232-72ff23c6f1e0 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a9872574-de7b-4a2a-a285-3cba3c4bcb7e req-4a4056d1-8d62-47b7-880d-4a88e58944e4 service nova] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a9872574-de7b-4a2a-a285-3cba3c4bcb7e req-4a4056d1-8d62-47b7-880d-4a88e58944e4 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a9872574-de7b-4a2a-a285-3cba3c4bcb7e req-4a4056d1-8d62-47b7-880d-4a88e58944e4 service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.compute.manager [req-a9872574-de7b-4a2a-a285-3cba3c4bcb7e req-4a4056d1-8d62-47b7-880d-4a88e58944e4 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] No waiting events found dispatching network-vif-unplugged-9042d944-67c5-4e39-9232-72ff23c6f1e0 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.compute.manager [req-a9872574-de7b-4a2a-a285-3cba3c4bcb7e req-4a4056d1-8d62-47b7-880d-4a88e58944e4 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-unplugged-9042d944-67c5-4e39-9232-72ff23c6f1e0 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b0cb9ad-9e60-40cd-8b22-4f960909d468) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:35 user nova-compute[74996]: INFO os_vif [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:28:a7,bridge_name='br-int',has_traffic_filtering=True,id=87bf8398-6ede-4465-9555-1000f74e75ff,network=Network(9778b912-7b91-4a57-a5d6-fa3e8fd1016c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87bf8398-6e')
Nov 02 01:38:35 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:38:35 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCytujwU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:38:35 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:38:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEHAcMyI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:38:35 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:38:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b314c57-3069-4caa-a076-cd4dff153879]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:38:35 user nova-compute[74996]: No targets found.
Nov 02 01:38:35 user nova-compute[74996]: iSNS:
Nov 02 01:38:35 user nova-compute[74996]: No targets found.
Nov 02 01:38:35 user nova-compute[74996]: STATIC:
Nov 02 01:38:35 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0
Nov 02 01:38:35 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:35 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:35 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611
Nov 02 01:38:35 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:35 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:35 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84
Nov 02 01:38:35 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:35 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:35 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873
Nov 02 01:38:35 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:35 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:35 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8
Nov 02 01:38:35 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:35 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:35 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181
Nov 02 01:38:35 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:35 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:35 user nova-compute[74996]: FIRMWARE:
Nov 02 01:38:35 user nova-compute[74996]: No targets found.
Nov 02 01:38:35 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:38:35 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:38:35 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0091a790-d975-4648-978b-2afe3eabfc59]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-0e7f86a0-13b3-4c32-8d31-c878459f8f46 req-bab5abef-afc3-488c-8b97-53317cc5f57e service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-plugged-62492819-8da0-4a9f-9f78-facaaa194017 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0e7f86a0-13b3-4c32-8d31-c878459f8f46 req-bab5abef-afc3-488c-8b97-53317cc5f57e service nova] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0e7f86a0-13b3-4c32-8d31-c878459f8f46 req-bab5abef-afc3-488c-8b97-53317cc5f57e service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0e7f86a0-13b3-4c32-8d31-c878459f8f46 req-bab5abef-afc3-488c-8b97-53317cc5f57e service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-0e7f86a0-13b3-4c32-8d31-c878459f8f46 req-bab5abef-afc3-488c-8b97-53317cc5f57e service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] No waiting events found dispatching network-vif-plugged-62492819-8da0-4a9f-9f78-facaaa194017 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:38:36 user nova-compute[74996]: WARNING nova.compute.manager [req-0e7f86a0-13b3-4c32-8d31-c878459f8f46 req-bab5abef-afc3-488c-8b97-53317cc5f57e service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received unexpected event network-vif-plugged-62492819-8da0-4a9f-9f78-facaaa194017 for instance with vm_state active and task_state deleting.
Nov 02 01:38:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-0e7f86a0-13b3-4c32-8d31-c878459f8f46 req-bab5abef-afc3-488c-8b97-53317cc5f57e service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-unplugged-37104018-4ea0-4b2f-b507-8887a4f7348a {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0e7f86a0-13b3-4c32-8d31-c878459f8f46 req-bab5abef-afc3-488c-8b97-53317cc5f57e service nova] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0e7f86a0-13b3-4c32-8d31-c878459f8f46 req-bab5abef-afc3-488c-8b97-53317cc5f57e service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0e7f86a0-13b3-4c32-8d31-c878459f8f46 req-bab5abef-afc3-488c-8b97-53317cc5f57e service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-0e7f86a0-13b3-4c32-8d31-c878459f8f46 req-bab5abef-afc3-488c-8b97-53317cc5f57e service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] No waiting events found dispatching network-vif-unplugged-37104018-4ea0-4b2f-b507-8887a4f7348a {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-0e7f86a0-13b3-4c32-8d31-c878459f8f46 req-bab5abef-afc3-488c-8b97-53317cc5f57e service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-unplugged-37104018-4ea0-4b2f-b507-8887a4f7348a for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-0e7f86a0-13b3-4c32-8d31-c878459f8f46 req-bab5abef-afc3-488c-8b97-53317cc5f57e service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-plugged-37104018-4ea0-4b2f-b507-8887a4f7348a {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0e7f86a0-13b3-4c32-8d31-c878459f8f46 req-bab5abef-afc3-488c-8b97-53317cc5f57e service nova] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0e7f86a0-13b3-4c32-8d31-c878459f8f46 req-bab5abef-afc3-488c-8b97-53317cc5f57e service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0e7f86a0-13b3-4c32-8d31-c878459f8f46 req-bab5abef-afc3-488c-8b97-53317cc5f57e service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-0e7f86a0-13b3-4c32-8d31-c878459f8f46 req-bab5abef-afc3-488c-8b97-53317cc5f57e service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] No waiting events found dispatching network-vif-plugged-37104018-4ea0-4b2f-b507-8887a4f7348a {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:38:36 user nova-compute[74996]: WARNING nova.compute.manager [req-0e7f86a0-13b3-4c32-8d31-c878459f8f46 req-bab5abef-afc3-488c-8b97-53317cc5f57e service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received unexpected event network-vif-plugged-37104018-4ea0-4b2f-b507-8887a4f7348a for instance with vm_state active and task_state deleting.
Nov 02 01:38:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-7f9c3f36-b903-44fa-9e26-b98910727e1b req-ca23ff9c-a792-4d4d-9fbd-611ef2dbd32b service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-plugged-019034ca-6f89-400f-b47a-61e1157f860f {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7f9c3f36-b903-44fa-9e26-b98910727e1b req-ca23ff9c-a792-4d4d-9fbd-611ef2dbd32b service nova] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7f9c3f36-b903-44fa-9e26-b98910727e1b req-ca23ff9c-a792-4d4d-9fbd-611ef2dbd32b service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7f9c3f36-b903-44fa-9e26-b98910727e1b req-ca23ff9c-a792-4d4d-9fbd-611ef2dbd32b service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-7f9c3f36-b903-44fa-9e26-b98910727e1b req-ca23ff9c-a792-4d4d-9fbd-611ef2dbd32b service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] No waiting events found dispatching network-vif-plugged-019034ca-6f89-400f-b47a-61e1157f860f {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:38:36 user nova-compute[74996]: WARNING nova.compute.manager [req-7f9c3f36-b903-44fa-9e26-b98910727e1b req-ca23ff9c-a792-4d4d-9fbd-611ef2dbd32b service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received unexpected event network-vif-plugged-019034ca-6f89-400f-b47a-61e1157f860f for instance with vm_state active and task_state deleting.
Nov 02 01:38:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-7f9c3f36-b903-44fa-9e26-b98910727e1b req-ca23ff9c-a792-4d4d-9fbd-611ef2dbd32b service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-unplugged-87bf8398-6ede-4465-9555-1000f74e75ff {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7f9c3f36-b903-44fa-9e26-b98910727e1b req-ca23ff9c-a792-4d4d-9fbd-611ef2dbd32b service nova] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7f9c3f36-b903-44fa-9e26-b98910727e1b req-ca23ff9c-a792-4d4d-9fbd-611ef2dbd32b service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7f9c3f36-b903-44fa-9e26-b98910727e1b req-ca23ff9c-a792-4d4d-9fbd-611ef2dbd32b service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-7f9c3f36-b903-44fa-9e26-b98910727e1b req-ca23ff9c-a792-4d4d-9fbd-611ef2dbd32b service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] No waiting events found dispatching network-vif-unplugged-87bf8398-6ede-4465-9555-1000f74e75ff {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-7f9c3f36-b903-44fa-9e26-b98910727e1b req-ca23ff9c-a792-4d4d-9fbd-611ef2dbd32b service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-unplugged-87bf8398-6ede-4465-9555-1000f74e75ff for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-7f9c3f36-b903-44fa-9e26-b98910727e1b req-ca23ff9c-a792-4d4d-9fbd-611ef2dbd32b service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-plugged-87bf8398-6ede-4465-9555-1000f74e75ff {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7f9c3f36-b903-44fa-9e26-b98910727e1b req-ca23ff9c-a792-4d4d-9fbd-611ef2dbd32b service nova] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7f9c3f36-b903-44fa-9e26-b98910727e1b req-ca23ff9c-a792-4d4d-9fbd-611ef2dbd32b service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7f9c3f36-b903-44fa-9e26-b98910727e1b req-ca23ff9c-a792-4d4d-9fbd-611ef2dbd32b service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-7f9c3f36-b903-44fa-9e26-b98910727e1b req-ca23ff9c-a792-4d4d-9fbd-611ef2dbd32b service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] No waiting events found dispatching network-vif-plugged-87bf8398-6ede-4465-9555-1000f74e75ff {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:38:36 user nova-compute[74996]: WARNING nova.compute.manager [req-7f9c3f36-b903-44fa-9e26-b98910727e1b req-ca23ff9c-a792-4d4d-9fbd-611ef2dbd32b service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received unexpected event network-vif-plugged-87bf8398-6ede-4465-9555-1000f74e75ff for instance with vm_state active and task_state deleting.
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adaccfb-f546-4c10-8467-94eba175496e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e85a4550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0'): ({'sdc'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Removing single pathed devices sdc {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdbffb2-ff76-4a30-9873-0e013971a634]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c233f9e-73f2-4fd3-8c13-15daef426f39]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Flushing IO for device /dev/sdc {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e63a0c-3a2d-441f-b670-0396e9c42701]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[897df32e-e988-4791-babd-70559f8ae4b0]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2f34e8-ea3d-4286-bde6-81e2d003ad1d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[746d785f-abb4-4f99-8401-589a6d967fce]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0, portal: 172.16.0.220,3260]
Nov 02 01:38:36 user nova-compute[74996]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0, portal: 172.16.0.220,3260] successful.
Nov 02 01:38:36 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d40ffcc9-49b2-4ea4-b422-5b07631491e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[93571b6a-dcef-4830-a9df-f106f3182aa2]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.407s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] <== disconnect_volume: return (409ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.364s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:38:36 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:38:36 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NqdufOnx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:38:36 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b5a519-fdd9-406d-8f0b-c5372169ff96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:38:36 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[980b7b84-c83c-4491-8154-fde0a1e441e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7] added
Nov 02 01:38:36 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[297bef93-b6bf-42df-b4d3-16567bcbb207]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d55f3d-8da4-40e2-9374-183a691d948d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DEHAcMyI {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DEHAcMyI" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d45797c-4309-4cad-bddf-284f28f21c59]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DEHAcMyI'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25bb8d1-f967-4bc1-8352-9b7bd4d280c8]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c7eaff-938f-4f02-ad2c-fd3818532abe]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6906197c-42b2-4406-907c-faa93eaed649]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7, portal: 172.16.0.220,3260]
Nov 02 01:38:36 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7, portal: 172.16.0.220,3260] successful.
Nov 02 01:38:36 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec43319c-b168-4bd6-8cbe-76bfe78e7ad6]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[04406dbd-9021-4d80-aa73-c58d10746701]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:38:36 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef763d2-c669-454a-9c2c-2876f4610052]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEHAcMyI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-352a17a5-95ef-4f96-83c5-4756fe7e4157 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "ac04bff6-90a5-439d-b07d-68e172485456" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-352a17a5-95ef-4f96-83c5-4756fe7e4157 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "ac04bff6-90a5-439d-b07d-68e172485456" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-352a17a5-95ef-4f96-83c5-4756fe7e4157 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "ac04bff6-90a5-439d-b07d-68e172485456-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-352a17a5-95ef-4f96-83c5-4756fe7e4157 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "ac04bff6-90a5-439d-b07d-68e172485456-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-352a17a5-95ef-4f96-83c5-4756fe7e4157 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "ac04bff6-90a5-439d-b07d-68e172485456-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:36 user nova-compute[74996]: INFO nova.compute.manager [None req-352a17a5-95ef-4f96-83c5-4756fe7e4157 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Terminating instance
Nov 02 01:38:36 user nova-compute[74996]: DEBUG nova.compute.manager [None req-352a17a5-95ef-4f96-83c5-4756fe7e4157 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Acquiring lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:37 user nova-compute[74996]: INFO nova.compute.manager [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Detaching volume 6336836f-4059-41bb-b86d-6ae54b4de611
Nov 02 01:38:37 user nova-compute[74996]: INFO nova.virt.block_device [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Attempting to driver detach volume 6336836f-4059-41bb-b86d-6ae54b4de611 from mountpoint /dev/vdb
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Attempting to detach device vdb from instance f44d0b13-9dae-40c9-83d0-0b84699b1cc2 from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 01:38:37 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:38:37 user nova-compute[74996]:   <source dev="/dev/sdd"/>
Nov 02 01:38:37 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:38:37 user nova-compute[74996]:   <serial>6336836f-4059-41bb-b86d-6ae54b4de611</serial>
Nov 02 01:38:37 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 02 01:38:37 user nova-compute[74996]: </disk>
Nov 02 01:38:37 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:38:37 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Successfully detached device vdb from instance f44d0b13-9dae-40c9-83d0-0b84699b1cc2 from the persistent domain config.
Nov 02 01:38:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f44d0b13-9dae-40c9-83d0-0b84699b1cc2 from the live domain config. {{(pid=74996) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 01:38:37 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:38:37 user nova-compute[74996]:   <source dev="/dev/sdd"/>
Nov 02 01:38:37 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:38:37 user nova-compute[74996]:   <serial>6336836f-4059-41bb-b86d-6ae54b4de611</serial>
Nov 02 01:38:37 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 02 01:38:37 user nova-compute[74996]: </disk>
Nov 02 01:38:37 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] <== connect_volume: return (1747ms) {'type': 'block', 'scsi_wwn': '23637306137383036', 'path': '/dev/sdb'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637306137383036', 'path': '/dev/sdb'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.373s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:37:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-94790749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-94790749',id=20,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='142161c2fae44bdea848619580195795',ramdisk_id='',reservation_id='r-cla6iv6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1294190560',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:37:50Z,user_data=None,user_id='15affb427e9b4fb8873accf286510e14',uuid=9d706c1a-883b-4b26-8972-4083df064e93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "address": "fa:16:3e:f0:bd:77", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9071ad51-8c", "ovs_interfaceid": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Converting VIF {"id": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "address": "fa:16:3e:f0:bd:77", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9071ad51-8c", "ovs_interfaceid": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:bd:77,bridge_name='br-int',has_traffic_filtering=True,id=9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c,network=Network(b5218514-0348-4dcc-8ecf-4595a87e204a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9071ad51-8c') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG nova.objects.instance [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d706c1a-883b-4b26-8972-4083df064e93 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a6a9d2-4dc9-4402-8aef-36b4eaebfced]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:38:37 user nova-compute[74996]: No targets found.
Nov 02 01:38:37 user nova-compute[74996]: iSNS:
Nov 02 01:38:37 user nova-compute[74996]: No targets found.
Nov 02 01:38:37 user nova-compute[74996]: STATIC:
Nov 02 01:38:37 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611
Nov 02 01:38:37 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:37 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:37 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7
Nov 02 01:38:37 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:37 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:37 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84
Nov 02 01:38:37 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:37 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:37 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873
Nov 02 01:38:37 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:37 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:37 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8
Nov 02 01:38:37 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:37 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:37 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181
Nov 02 01:38:37 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:37 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:37 user nova-compute[74996]: FIRMWARE:
Nov 02 01:38:37 user nova-compute[74996]: No targets found.
Nov 02 01:38:37 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:38:37 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:38:37 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:38:37 user nova-compute[74996]:   <uuid>9d706c1a-883b-4b26-8972-4083df064e93</uuid>
Nov 02 01:38:37 user nova-compute[74996]:   <name>instance-00000014</name>
Nov 02 01:38:37 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:38:37 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:38:37 user nova-compute[74996]:   <metadata>
Nov 02 01:38:37 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:38:37 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:38:37 user nova-compute[74996]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-94790749</nova:name>
Nov 02 01:38:37 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:38:35</nova:creationTime>
Nov 02 01:38:37 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:38:37 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:38:37 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:38:37 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:38:37 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:38:37 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:38:37 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:38:37 user nova-compute[74996]:       <nova:owner>
Nov 02 01:38:37 user nova-compute[74996]:         <nova:user uuid="15affb427e9b4fb8873accf286510e14">tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member</nova:user>
Nov 02 01:38:37 user nova-compute[74996]:         <nova:project uuid="142161c2fae44bdea848619580195795">tempest-ServerBootFromVolumeStableRescueTest-1294190560</nova:project>
Nov 02 01:38:37 user nova-compute[74996]:       </nova:owner>
Nov 02 01:38:37 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:38:37 user nova-compute[74996]:       <nova:ports>
Nov 02 01:38:37 user nova-compute[74996]:         <nova:port uuid="9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c">
Nov 02 01:38:37 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 01:38:37 user nova-compute[74996]:         </nova:port>
Nov 02 01:38:37 user nova-compute[74996]:       </nova:ports>
Nov 02 01:38:37 user nova-compute[74996]:     </nova:instance>
Nov 02 01:38:37 user nova-compute[74996]:   </metadata>
Nov 02 01:38:37 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:38:37 user nova-compute[74996]:     <system>
Nov 02 01:38:37 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:38:37 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:38:37 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:38:37 user nova-compute[74996]:       <entry name="serial">9d706c1a-883b-4b26-8972-4083df064e93</entry>
Nov 02 01:38:37 user nova-compute[74996]:       <entry name="uuid">9d706c1a-883b-4b26-8972-4083df064e93</entry>
Nov 02 01:38:37 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:38:37 user nova-compute[74996]:     </system>
Nov 02 01:38:37 user nova-compute[74996]:   </sysinfo>
Nov 02 01:38:37 user nova-compute[74996]:   <os>
Nov 02 01:38:37 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:38:37 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:38:37 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:38:37 user nova-compute[74996]:   </os>
Nov 02 01:38:37 user nova-compute[74996]:   <features>
Nov 02 01:38:37 user nova-compute[74996]:     <acpi/>
Nov 02 01:38:37 user nova-compute[74996]:     <apic/>
Nov 02 01:38:37 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:38:37 user nova-compute[74996]:   </features>
Nov 02 01:38:37 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:38:37 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:38:37 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:38:37 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:38:37 user nova-compute[74996]:   </clock>
Nov 02 01:38:37 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:38:37 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:38:37 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:38:37 user nova-compute[74996]:   </cpu>
Nov 02 01:38:37 user nova-compute[74996]:   <devices>
Nov 02 01:38:37 user nova-compute[74996]:     <disk type="block" device="disk">
Nov 02 01:38:37 user nova-compute[74996]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:38:37 user nova-compute[74996]:       <source dev="/dev/sdb"/>
Nov 02 01:38:37 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:38:37 user nova-compute[74996]:       <serial>056998b8-61e1-46e5-b497-c0ee61ae9ff7</serial>
Nov 02 01:38:37 user nova-compute[74996]:     </disk>
Nov 02 01:38:37 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:38:37 user nova-compute[74996]:       <mac address="fa:16:3e:f0:bd:77"/>
Nov 02 01:38:37 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:38:37 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:38:37 user nova-compute[74996]:       <target dev="tap9071ad51-8c"/>
Nov 02 01:38:37 user nova-compute[74996]:     </interface>
Nov 02 01:38:37 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:38:37 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/9d706c1a-883b-4b26-8972-4083df064e93/console.log" append="off"/>
Nov 02 01:38:37 user nova-compute[74996]:     </serial>
Nov 02 01:38:37 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:38:37 user nova-compute[74996]:     <video>
Nov 02 01:38:37 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:38:37 user nova-compute[74996]:     </video>
Nov 02 01:38:37 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:38:37 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:38:37 user nova-compute[74996]:     </rng>
Nov 02 01:38:37 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:38:37 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:38:37 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:38:37 user nova-compute[74996]:     </memballoon>
Nov 02 01:38:37 user nova-compute[74996]:   </devices>
Nov 02 01:38:37 user nova-compute[74996]: </domain>
Nov 02 01:38:37 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:37:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-94790749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-94790749',id=20,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='142161c2fae44bdea848619580195795',ramdisk_id='',reservation_id='r-cla6iv6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1294190560',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:37:50Z,user_data=None,user_id='15affb427e9b4fb8873accf286510e14',uuid=9d706c1a-883b-4b26-8972-4083df064e93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "address": "fa:16:3e:f0:bd:77", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9071ad51-8c", "ovs_interfaceid": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Converting VIF {"id": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "address": "fa:16:3e:f0:bd:77", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9071ad51-8c", "ovs_interfaceid": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:bd:77,bridge_name='br-int',has_traffic_filtering=True,id=9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c,network=Network(b5218514-0348-4dcc-8ecf-4595a87e204a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9071ad51-8c') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG os_vif [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:bd:77,bridge_name='br-int',has_traffic_filtering=True,id=9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c,network=Network(b5218514-0348-4dcc-8ecf-4595a87e204a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9071ad51-8c') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cebcac21-be94-5bcb-91ee-dc4bbbd42fa0', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3ac062-b1b5-49df-b0de-cc696b5c15b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[090a67f4-7ff7-4189-a585-fde1833e53e3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:38:37 user nova-compute[74996]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:38:37 user nova-compute[74996]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)
Nov 02 01:38:37 user nova-compute[74996]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:38:37 user nova-compute[74996]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)
Nov 02 01:38:37 user nova-compute[74996]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:38:37 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 (non-flash)
Nov 02 01:38:37 user nova-compute[74996]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:38:37 user nova-compute[74996]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)
Nov 02 01:38:37 user nova-compute[74996]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:38:37 user nova-compute[74996]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)
Nov 02 01:38:37 user nova-compute[74996]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:38:37 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e852d900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181'): ({'sde'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Removing single pathed devices sde {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9071ad51-8c, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9071ad51-8c, col_values=(('qos', UUID('a023faff-e34a-47e0-a5d4-fac5b8e22848')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9071ad51-8c, col_values=(('external_ids', {'iface-id': '9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:bd:77', 'vm-uuid': '9d706c1a-883b-4b26-8972-4083df064e93'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2ac1bf-0577-40d5-8391-279fbe0de17c]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:37 user nova-compute[74996]: INFO os_vif [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:bd:77,bridge_name='br-int',has_traffic_filtering=True,id=9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c,network=Network(b5218514-0348-4dcc-8ecf-4595a87e204a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9071ad51-8c')
Nov 02 01:38:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[09998c5c-5b39-42be-a3ba-4d35caa08720]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Flushing IO for device /dev/sde {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2086983-dec1-4078-af1b-d6c229d7b47d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f44d0b13-9dae-40c9-83d0-0b84699b1cc2 {{(pid=74996) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 01:38:37 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Instance destroyed successfully.
Nov 02 01:38:37 user nova-compute[74996]: DEBUG nova.objects.instance [None req-352a17a5-95ef-4f96-83c5-4756fe7e4157 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lazy-loading 'resources' on Instance uuid ac04bff6-90a5-439d-b07d-68e172485456 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG nova.compute.manager [req-e6ae9bf0-b032-4d1f-8bbf-4bb7af6aa705 req-139b3fe3-df3f-40e3-999f-660ddb7f1dbe service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-plugged-9042d944-67c5-4e39-9232-72ff23c6f1e0 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-e6ae9bf0-b032-4d1f-8bbf-4bb7af6aa705 req-139b3fe3-df3f-40e3-999f-660ddb7f1dbe service nova] Acquiring lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-e6ae9bf0-b032-4d1f-8bbf-4bb7af6aa705 req-139b3fe3-df3f-40e3-999f-660ddb7f1dbe service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-e6ae9bf0-b032-4d1f-8bbf-4bb7af6aa705 req-139b3fe3-df3f-40e3-999f-660ddb7f1dbe service nova] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG nova.compute.manager [req-e6ae9bf0-b032-4d1f-8bbf-4bb7af6aa705 req-139b3fe3-df3f-40e3-999f-660ddb7f1dbe service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] No waiting events found dispatching network-vif-plugged-9042d944-67c5-4e39-9232-72ff23c6f1e0 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:38:37 user nova-compute[74996]: WARNING nova.compute.manager [req-e6ae9bf0-b032-4d1f-8bbf-4bb7af6aa705 req-139b3fe3-df3f-40e3-999f-660ddb7f1dbe service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received unexpected event network-vif-plugged-9042d944-67c5-4e39-9232-72ff23c6f1e0 for instance with vm_state active and task_state deleting.
Nov 02 01:38:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-352a17a5-95ef-4f96-83c5-4756fe7e4157 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:36:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-103058351',display_name='tempest-AttachVolumeNegativeTest-server-103058351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-103058351',id=19,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRiroOJUGOVJzZXOF+/vAB/kDwa1hdAeROEWJbWxar46GZkPbf06aJnCQeRVGfaN+njK9+nVT//F3XGaTgENpCjTzMO/momoYAKAOdUQReKbJD14VggbMznrVkwVM9nJg==',key_name='tempest-keypair-929854003',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:36:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b6b2c4a38374459b73fa76b8dde9db4',ramdisk_id='',reservation_id='r-7pxmv37i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1395123327',owner_user_name='tempest-AttachVolumeNegativeTest-1395123327-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:36:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='700d6c84a40547e99f3e364d6447ad4e',uuid=ac04bff6-90a5-439d-b07d-68e172485456,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd0b81f2-2c9d-4c2b-8d29-2d295c521219", "address": "fa:16:3e:3a:e5:40", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0b81f2-2c", "ovs_interfaceid": "bd0b81f2-2c9d-4c2b-8d29-2d295c521219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-352a17a5-95ef-4f96-83c5-4756fe7e4157 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Converting VIF {"id": "bd0b81f2-2c9d-4c2b-8d29-2d295c521219", "address": "fa:16:3e:3a:e5:40", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0b81f2-2c", "ovs_interfaceid": "bd0b81f2-2c9d-4c2b-8d29-2d295c521219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-352a17a5-95ef-4f96-83c5-4756fe7e4157 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:e5:40,bridge_name='br-int',has_traffic_filtering=True,id=bd0b81f2-2c9d-4c2b-8d29-2d295c521219,network=Network(d18bfd38-1454-4665-a175-2c7d0e2002ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd0b81f2-2c') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG os_vif [None req-352a17a5-95ef-4f96-83c5-4756fe7e4157 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:e5:40,bridge_name='br-int',has_traffic_filtering=True,id=bd0b81f2-2c9d-4c2b-8d29-2d295c521219,network=Network(d18bfd38-1454-4665-a175-2c7d0e2002ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd0b81f2-2c') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ca6798-cfdf-4c85-8c0f-7b874df2289a]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd0b81f2-2c, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] SCSI volumes sde have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] No VIF found with MAC fa:16:3e:f0:bd:77, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b97f09e-dcf8-47fb-9405-6a88ddd7b6ec) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:38:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:38 user nova-compute[74996]: INFO os_vif [None req-352a17a5-95ef-4f96-83c5-4756fe7e4157 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:e5:40,bridge_name='br-int',has_traffic_filtering=True,id=bd0b81f2-2c9d-4c2b-8d29-2d295c521219,network=Network(d18bfd38-1454-4665-a175-2c7d0e2002ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd0b81f2-2c')
Nov 02 01:38:38 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-352a17a5-95ef-4f96-83c5-4756fe7e4157 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Deleting instance files /opt/stack/data/nova/instances/ac04bff6-90a5-439d-b07d-68e172485456_del
Nov 02 01:38:38 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-352a17a5-95ef-4f96-83c5-4756fe7e4157 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Deletion of /opt/stack/data/nova/instances/ac04bff6-90a5-439d-b07d-68e172485456_del complete
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd88bc9a-07b7-4a75-9ba4-2485a56905d9]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:38 user nova-compute[74996]: INFO nova.compute.manager [None req-352a17a5-95ef-4f96-83c5-4756fe7e4157 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-352a17a5-95ef-4f96-83c5-4756fe7e4157 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: ac04bff6-90a5-439d-b07d-68e172485456] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG nova.compute.manager [req-34a4fbb6-7dcb-4414-a748-ec31c6bcac3f req-49a2da11-ce82-4856-a56e-569945716497 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Received event network-changed-bd0b81f2-2c9d-4c2b-8d29-2d295c521219 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG nova.compute.manager [req-34a4fbb6-7dcb-4414-a748-ec31c6bcac3f req-49a2da11-ce82-4856-a56e-569945716497 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Refreshing instance network info cache due to event network-changed-bd0b81f2-2c9d-4c2b-8d29-2d295c521219. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-34a4fbb6-7dcb-4414-a748-ec31c6bcac3f req-49a2da11-ce82-4856-a56e-569945716497 service nova] Acquiring lock "refresh_cache-ac04bff6-90a5-439d-b07d-68e172485456" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-34a4fbb6-7dcb-4414-a748-ec31c6bcac3f req-49a2da11-ce82-4856-a56e-569945716497 service nova] Acquired lock "refresh_cache-ac04bff6-90a5-439d-b07d-68e172485456" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG nova.network.neutron [req-34a4fbb6-7dcb-4414-a748-ec31c6bcac3f req-49a2da11-ce82-4856-a56e-569945716497 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Refreshing network info cache for port bd0b81f2-2c9d-4c2b-8d29-2d295c521219 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 -p 172.16.0.220:3260 --logout" returned: 0 in 0.099s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[791d3d92-54a9-403c-a5f0-0532e5d81f50]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181, portal: 172.16.0.220,3260]
Nov 02 01:38:38 user nova-compute[74996]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181, portal: 172.16.0.220,3260] successful.
Nov 02 01:38:38 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1814f6c5-9658-4fc5-a5bd-3dc79fcf7181 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d13bc3-ba02-46da-8e7b-563cde8a7d55]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.480s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] <== disconnect_volume: return (1854ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcnsaRWu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:38:38 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:38:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[82555035-1b8c-4934-a8b5-f7178b62be50]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:38:38 user nova-compute[74996]: No targets found.
Nov 02 01:38:38 user nova-compute[74996]: iSNS:
Nov 02 01:38:38 user nova-compute[74996]: No targets found.
Nov 02 01:38:38 user nova-compute[74996]: STATIC:
Nov 02 01:38:38 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611
Nov 02 01:38:38 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:38 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:38 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7
Nov 02 01:38:38 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:38 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:38 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84
Nov 02 01:38:38 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:38 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:38 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873
Nov 02 01:38:38 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:38 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:38 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8
Nov 02 01:38:38 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:38 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:38 user nova-compute[74996]: FIRMWARE:
Nov 02 01:38:38 user nova-compute[74996]: No targets found.
Nov 02 01:38:38 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:38:38 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:38:38 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88f67d1-6907-4b9e-8cf0-1d14900c1c98]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Acquiring lock "31da007b-1f16-4d01-8b1a-b41f60cd08f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Lock "31da007b-1f16-4d01-8b1a-b41f60cd08f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b90e729-2123-4f1f-b826-d65bd8e0eb1b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:38:38 user nova-compute[74996]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)
Nov 02 01:38:38 user nova-compute[74996]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:38:38 user nova-compute[74996]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)
Nov 02 01:38:38 user nova-compute[74996]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:38:38 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:38:38 user nova-compute[74996]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 (non-flash)
Nov 02 01:38:38 user nova-compute[74996]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:38:38 user nova-compute[74996]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)
Nov 02 01:38:38 user nova-compute[74996]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:38:38 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e852f2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873'): ({'sdg'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Removing single pathed devices sdg {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.035s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d9a31b-ac2b-49d4-9d4f-05a41dc25b88]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b8d8f6-398f-40df-a105-a5cd2beffa04]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Flushing IO for device /dev/sdg {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c80970-f5c4-4cbc-9b8b-3ff1ef49fa03]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.036s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c88ffa7-db28-4f5f-8a70-5038939ce5e3]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] SCSI volumes sdg have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9008d3f-13fd-497a-9459-c6a5966e00a3]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:38:38 user nova-compute[74996]: INFO nova.compute.claims [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Claim successful on node user
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[752dc785-cfbd-4957-a71a-5860a37c4ec6]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873, portal: 172.16.0.220,3260]
Nov 02 01:38:38 user nova-compute[74996]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873, portal: 172.16.0.220,3260] successful.
Nov 02 01:38:38 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec3ba29d-5a27-4f3c-be18-2d9d10bba873 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[17de5ec1-0616-4c28-868f-539499cff648]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] <== disconnect_volume: return (388ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:38:38 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Deleting instance files /opt/stack/data/nova/instances/adfc9441-d607-4b9f-8008-95e42f1ac51e_del
Nov 02 01:38:38 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Deletion of /opt/stack/data/nova/instances/adfc9441-d607-4b9f-8008-95e42f1ac51e_del complete
Nov 02 01:38:38 user nova-compute[74996]: INFO nova.compute.manager [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Took 5.49 seconds to destroy the instance on the hypervisor.
Nov 02 01:38:38 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:38:38 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG nova.network.neutron [req-34a4fbb6-7dcb-4414-a748-ec31c6bcac3f req-49a2da11-ce82-4856-a56e-569945716497 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Updated VIF entry in instance network info cache for port bd0b81f2-2c9d-4c2b-8d29-2d295c521219. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG nova.network.neutron [req-34a4fbb6-7dcb-4414-a748-ec31c6bcac3f req-49a2da11-ce82-4856-a56e-569945716497 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Updating instance_info_cache with network_info: [{"id": "bd0b81f2-2c9d-4c2b-8d29-2d295c521219", "address": "fa:16:3e:3a:e5:40", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0b81f2-2c", "ovs_interfaceid": "bd0b81f2-2c9d-4c2b-8d29-2d295c521219", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-34a4fbb6-7dcb-4414-a748-ec31c6bcac3f req-49a2da11-ce82-4856-a56e-569945716497 service nova] Releasing lock "refresh_cache-ac04bff6-90a5-439d-b07d-68e172485456" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG nova.compute.manager [req-34a4fbb6-7dcb-4414-a748-ec31c6bcac3f req-49a2da11-ce82-4856-a56e-569945716497 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Received event network-vif-unplugged-bd0b81f2-2c9d-4c2b-8d29-2d295c521219 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-34a4fbb6-7dcb-4414-a748-ec31c6bcac3f req-49a2da11-ce82-4856-a56e-569945716497 service nova] Acquiring lock "ac04bff6-90a5-439d-b07d-68e172485456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-34a4fbb6-7dcb-4414-a748-ec31c6bcac3f req-49a2da11-ce82-4856-a56e-569945716497 service nova] Lock "ac04bff6-90a5-439d-b07d-68e172485456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-34a4fbb6-7dcb-4414-a748-ec31c6bcac3f req-49a2da11-ce82-4856-a56e-569945716497 service nova] Lock "ac04bff6-90a5-439d-b07d-68e172485456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG nova.compute.manager [req-34a4fbb6-7dcb-4414-a748-ec31c6bcac3f req-49a2da11-ce82-4856-a56e-569945716497 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] No waiting events found dispatching network-vif-unplugged-bd0b81f2-2c9d-4c2b-8d29-2d295c521219 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG nova.compute.manager [req-34a4fbb6-7dcb-4414-a748-ec31c6bcac3f req-49a2da11-ce82-4856-a56e-569945716497 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Received event network-vif-unplugged-bd0b81f2-2c9d-4c2b-8d29-2d295c521219 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG nova.compute.manager [req-34a4fbb6-7dcb-4414-a748-ec31c6bcac3f req-49a2da11-ce82-4856-a56e-569945716497 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Received event network-vif-plugged-bd0b81f2-2c9d-4c2b-8d29-2d295c521219 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-34a4fbb6-7dcb-4414-a748-ec31c6bcac3f req-49a2da11-ce82-4856-a56e-569945716497 service nova] Acquiring lock "ac04bff6-90a5-439d-b07d-68e172485456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-34a4fbb6-7dcb-4414-a748-ec31c6bcac3f req-49a2da11-ce82-4856-a56e-569945716497 service nova] Lock "ac04bff6-90a5-439d-b07d-68e172485456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-34a4fbb6-7dcb-4414-a748-ec31c6bcac3f req-49a2da11-ce82-4856-a56e-569945716497 service nova] Lock "ac04bff6-90a5-439d-b07d-68e172485456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG nova.compute.manager [req-34a4fbb6-7dcb-4414-a748-ec31c6bcac3f req-49a2da11-ce82-4856-a56e-569945716497 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] No waiting events found dispatching network-vif-plugged-bd0b81f2-2c9d-4c2b-8d29-2d295c521219 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:38:39 user nova-compute[74996]: WARNING nova.compute.manager [req-34a4fbb6-7dcb-4414-a748-ec31c6bcac3f req-49a2da11-ce82-4856-a56e-569945716497 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Received unexpected event network-vif-plugged-bd0b81f2-2c9d-4c2b-8d29-2d295c521219 for instance with vm_state active and task_state deleting.
Nov 02 01:38:39 user nova-compute[74996]: DEBUG nova.compute.manager [req-34a4fbb6-7dcb-4414-a748-ec31c6bcac3f req-49a2da11-ce82-4856-a56e-569945716497 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Received event network-vif-plugged-bd0b81f2-2c9d-4c2b-8d29-2d295c521219 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-34a4fbb6-7dcb-4414-a748-ec31c6bcac3f req-49a2da11-ce82-4856-a56e-569945716497 service nova] Acquiring lock "ac04bff6-90a5-439d-b07d-68e172485456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-34a4fbb6-7dcb-4414-a748-ec31c6bcac3f req-49a2da11-ce82-4856-a56e-569945716497 service nova] Lock "ac04bff6-90a5-439d-b07d-68e172485456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-34a4fbb6-7dcb-4414-a748-ec31c6bcac3f req-49a2da11-ce82-4856-a56e-569945716497 service nova] Lock "ac04bff6-90a5-439d-b07d-68e172485456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG nova.compute.manager [req-34a4fbb6-7dcb-4414-a748-ec31c6bcac3f req-49a2da11-ce82-4856-a56e-569945716497 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] No waiting events found dispatching network-vif-plugged-bd0b81f2-2c9d-4c2b-8d29-2d295c521219 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:38:39 user nova-compute[74996]: WARNING nova.compute.manager [req-34a4fbb6-7dcb-4414-a748-ec31c6bcac3f req-49a2da11-ce82-4856-a56e-569945716497 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Received unexpected event network-vif-plugged-bd0b81f2-2c9d-4c2b-8d29-2d295c521219 for instance with vm_state active and task_state deleting.
Nov 02 01:38:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.693s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:38:39 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Took 1.13 seconds to deallocate network for instance.
Nov 02 01:38:39 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:38:39 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:38:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-352a17a5-95ef-4f96-83c5-4756fe7e4157 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-352a17a5-95ef-4f96-83c5-4756fe7e4157 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:39 user nova-compute[74996]: INFO nova.virt.block_device [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Booting with volume feadcde3-d4d2-40b6-808a-c8973b54f3ce at /dev/vda
Nov 02 01:38:39 user nova-compute[74996]: DEBUG nova.policy [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49d9ec7a63074b45829c5733f9701ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '064ef9744af64b01b7b5cac9615eb13f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG os_brick.utils [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1181e09f-14a0-4eca-8fd2-9e717b859c80]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1e4946-9fd1-48a0-9671-45c817ce19d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[724e2c11-e3d8-47ec-be08-aa24d224ff67]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f48bf75-62d7-4406-ae0f-ba8b19afb800]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:38:39 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:38:39 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6167ff4a-e6d4-4656-a02b-75c4edddfc9c]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG os_brick.utils [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Updating existing volume attachment record: f59d693b-6565-4331-b1d1-5c25c6908156 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:38:39 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-352a17a5-95ef-4f96-83c5-4756fe7e4157 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:38:40 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-352a17a5-95ef-4f96-83c5-4756fe7e4157 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:38:40 user nova-compute[74996]: DEBUG nova.compute.manager [req-2c8ead4c-03eb-43cd-b142-dc702e5742bd req-d46b7a62-154b-4512-8618-6b8e3c6ec305 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Received event network-vif-deleted-bd0b81f2-2c9d-4c2b-8d29-2d295c521219 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:40 user nova-compute[74996]: DEBUG nova.compute.manager [req-2c8ead4c-03eb-43cd-b142-dc702e5742bd req-d46b7a62-154b-4512-8618-6b8e3c6ec305 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Received event network-vif-plugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2c8ead4c-03eb-43cd-b142-dc702e5742bd req-d46b7a62-154b-4512-8618-6b8e3c6ec305 service nova] Acquiring lock "9d706c1a-883b-4b26-8972-4083df064e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2c8ead4c-03eb-43cd-b142-dc702e5742bd req-d46b7a62-154b-4512-8618-6b8e3c6ec305 service nova] Lock "9d706c1a-883b-4b26-8972-4083df064e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2c8ead4c-03eb-43cd-b142-dc702e5742bd req-d46b7a62-154b-4512-8618-6b8e3c6ec305 service nova] Lock "9d706c1a-883b-4b26-8972-4083df064e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:40 user nova-compute[74996]: DEBUG nova.compute.manager [req-2c8ead4c-03eb-43cd-b142-dc702e5742bd req-d46b7a62-154b-4512-8618-6b8e3c6ec305 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] No waiting events found dispatching network-vif-plugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:38:40 user nova-compute[74996]: WARNING nova.compute.manager [req-2c8ead4c-03eb-43cd-b142-dc702e5742bd req-d46b7a62-154b-4512-8618-6b8e3c6ec305 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Received unexpected event network-vif-plugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c for instance with vm_state building and task_state spawning.
Nov 02 01:38:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-352a17a5-95ef-4f96-83c5-4756fe7e4157 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.754s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:40 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-352a17a5-95ef-4f96-83c5-4756fe7e4157 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Deleted allocations for instance ac04bff6-90a5-439d-b07d-68e172485456
Nov 02 01:38:40 user nova-compute[74996]: DEBUG nova.compute.manager [req-fdc536d0-255c-49a8-aa2a-73447626fa8a req-3948e5fc-adfc-4b40-8547-231e8e70d442 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Received event network-vif-plugged-bd0b81f2-2c9d-4c2b-8d29-2d295c521219 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-fdc536d0-255c-49a8-aa2a-73447626fa8a req-3948e5fc-adfc-4b40-8547-231e8e70d442 service nova] Acquiring lock "ac04bff6-90a5-439d-b07d-68e172485456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-fdc536d0-255c-49a8-aa2a-73447626fa8a req-3948e5fc-adfc-4b40-8547-231e8e70d442 service nova] Lock "ac04bff6-90a5-439d-b07d-68e172485456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-fdc536d0-255c-49a8-aa2a-73447626fa8a req-3948e5fc-adfc-4b40-8547-231e8e70d442 service nova] Lock "ac04bff6-90a5-439d-b07d-68e172485456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:40 user nova-compute[74996]: DEBUG nova.compute.manager [req-fdc536d0-255c-49a8-aa2a-73447626fa8a req-3948e5fc-adfc-4b40-8547-231e8e70d442 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] No waiting events found dispatching network-vif-plugged-bd0b81f2-2c9d-4c2b-8d29-2d295c521219 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:38:40 user nova-compute[74996]: WARNING nova.compute.manager [req-fdc536d0-255c-49a8-aa2a-73447626fa8a req-3948e5fc-adfc-4b40-8547-231e8e70d442 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Received unexpected event network-vif-plugged-bd0b81f2-2c9d-4c2b-8d29-2d295c521219 for instance with vm_state deleted and task_state None.
Nov 02 01:38:40 user nova-compute[74996]: DEBUG nova.compute.manager [req-fdc536d0-255c-49a8-aa2a-73447626fa8a req-3948e5fc-adfc-4b40-8547-231e8e70d442 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Received event network-vif-unplugged-bd0b81f2-2c9d-4c2b-8d29-2d295c521219 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-fdc536d0-255c-49a8-aa2a-73447626fa8a req-3948e5fc-adfc-4b40-8547-231e8e70d442 service nova] Acquiring lock "ac04bff6-90a5-439d-b07d-68e172485456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-fdc536d0-255c-49a8-aa2a-73447626fa8a req-3948e5fc-adfc-4b40-8547-231e8e70d442 service nova] Lock "ac04bff6-90a5-439d-b07d-68e172485456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-fdc536d0-255c-49a8-aa2a-73447626fa8a req-3948e5fc-adfc-4b40-8547-231e8e70d442 service nova] Lock "ac04bff6-90a5-439d-b07d-68e172485456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:40 user nova-compute[74996]: DEBUG nova.compute.manager [req-fdc536d0-255c-49a8-aa2a-73447626fa8a req-3948e5fc-adfc-4b40-8547-231e8e70d442 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] No waiting events found dispatching network-vif-unplugged-bd0b81f2-2c9d-4c2b-8d29-2d295c521219 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:38:40 user nova-compute[74996]: WARNING nova.compute.manager [req-fdc536d0-255c-49a8-aa2a-73447626fa8a req-3948e5fc-adfc-4b40-8547-231e8e70d442 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Received unexpected event network-vif-unplugged-bd0b81f2-2c9d-4c2b-8d29-2d295c521219 for instance with vm_state deleted and task_state None.
Nov 02 01:38:40 user nova-compute[74996]: DEBUG nova.compute.manager [req-fdc536d0-255c-49a8-aa2a-73447626fa8a req-3948e5fc-adfc-4b40-8547-231e8e70d442 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Received event network-vif-plugged-bd0b81f2-2c9d-4c2b-8d29-2d295c521219 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-fdc536d0-255c-49a8-aa2a-73447626fa8a req-3948e5fc-adfc-4b40-8547-231e8e70d442 service nova] Acquiring lock "ac04bff6-90a5-439d-b07d-68e172485456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-fdc536d0-255c-49a8-aa2a-73447626fa8a req-3948e5fc-adfc-4b40-8547-231e8e70d442 service nova] Lock "ac04bff6-90a5-439d-b07d-68e172485456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-fdc536d0-255c-49a8-aa2a-73447626fa8a req-3948e5fc-adfc-4b40-8547-231e8e70d442 service nova] Lock "ac04bff6-90a5-439d-b07d-68e172485456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:40 user nova-compute[74996]: DEBUG nova.compute.manager [req-fdc536d0-255c-49a8-aa2a-73447626fa8a req-3948e5fc-adfc-4b40-8547-231e8e70d442 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] No waiting events found dispatching network-vif-plugged-bd0b81f2-2c9d-4c2b-8d29-2d295c521219 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:38:40 user nova-compute[74996]: WARNING nova.compute.manager [req-fdc536d0-255c-49a8-aa2a-73447626fa8a req-3948e5fc-adfc-4b40-8547-231e8e70d442 service nova] [instance: ac04bff6-90a5-439d-b07d-68e172485456] Received unexpected event network-vif-plugged-bd0b81f2-2c9d-4c2b-8d29-2d295c521219 for instance with vm_state deleted and task_state None.
Nov 02 01:38:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-352a17a5-95ef-4f96-83c5-4756fe7e4157 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "ac04bff6-90a5-439d-b07d-68e172485456" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.504s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:40 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Successfully created port: d837c1b5-c0e8-46bc-b31b-cd25ac7bf884 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:38:41 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Successfully created port: 004e2b4b-86f0-4b1f-861a-db8f99a272ab {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:38:41 user nova-compute[74996]: DEBUG nova.compute.manager [req-0537097a-61a7-4301-a25f-c7369cf62303 req-eab52a51-1a9a-4ff3-85d2-bbb31b67aa58 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-deleted-37104018-4ea0-4b2f-b507-8887a4f7348a {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:41 user nova-compute[74996]: INFO nova.compute.manager [req-0537097a-61a7-4301-a25f-c7369cf62303 req-eab52a51-1a9a-4ff3-85d2-bbb31b67aa58 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Neutron deleted interface 37104018-4ea0-4b2f-b507-8887a4f7348a; detaching it from the instance and deleting it from the info cache
Nov 02 01:38:41 user nova-compute[74996]: DEBUG nova.network.neutron [req-0537097a-61a7-4301-a25f-c7369cf62303 req-eab52a51-1a9a-4ff3-85d2-bbb31b67aa58 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Updating instance_info_cache with network_info: [{"id": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "address": "fa:16:3e:17:b8:62", "network": {"id": "45d38091-67e6-414b-9989-e308ebdcf57d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1896108595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap863ea8b0-7e", "ovs_interfaceid": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62492819-8da0-4a9f-9f78-facaaa194017", "address": "fa:16:3e:ac:91:39", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62492819-8d", "ovs_interfaceid": "62492819-8da0-4a9f-9f78-facaaa194017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "019034ca-6f89-400f-b47a-61e1157f860f", "address": "fa:16:3e:7f:67:62", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap019034ca-6f", "ovs_interfaceid": "019034ca-6f89-400f-b47a-61e1157f860f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3ade5deb-e2db-4310-b1a6-df399639eb00", "address": "fa:16:3e:22:42:a5", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ade5deb-e2", "ovs_interfaceid": "3ade5deb-e2db-4310-b1a6-df399639eb00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9042d944-67c5-4e39-9232-72ff23c6f1e0", "address": "fa:16:3e:05:b8:e8", "network": {"id": "9778b912-7b91-4a57-a5d6-fa3e8fd1016c", "bridge": "br-int", "label": "tempest-device-tagging-net2-519483991", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9042d944-67", "ovs_interfaceid": "9042d944-67c5-4e39-9232-72ff23c6f1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87bf8398-6ede-4465-9555-1000f74e75ff", "address": "fa:16:3e:67:28:a7", "network": {"id": "9778b912-7b91-4a57-a5d6-fa3e8fd1016c", "bridge": "br-int", "label": "tempest-device-tagging-net2-519483991", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87bf8398-6e", "ovs_interfaceid": "87bf8398-6ede-4465-9555-1000f74e75ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:38:42 user nova-compute[74996]: DEBUG nova.compute.manager [req-0537097a-61a7-4301-a25f-c7369cf62303 req-eab52a51-1a9a-4ff3-85d2-bbb31b67aa58 service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Detach interface failed, port_id=37104018-4ea0-4b2f-b507-8887a4f7348a, reason: Instance adfc9441-d607-4b9f-8008-95e42f1ac51e could not be found. {{(pid=74996) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 01:38:42 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Successfully created port: efb2f61a-fe66-48e0-a067-35d06f375412 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:38:42 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:38:42 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:38:42 user nova-compute[74996]: DEBUG nova.compute.manager [req-472eff89-d637-40b6-a1e9-a19815ba414f req-7fc8a2c3-eea8-4c7d-b61a-954c09b1e73d service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Received event network-vif-plugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-472eff89-d637-40b6-a1e9-a19815ba414f req-7fc8a2c3-eea8-4c7d-b61a-954c09b1e73d service nova] Acquiring lock "9d706c1a-883b-4b26-8972-4083df064e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-472eff89-d637-40b6-a1e9-a19815ba414f req-7fc8a2c3-eea8-4c7d-b61a-954c09b1e73d service nova] Lock "9d706c1a-883b-4b26-8972-4083df064e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-472eff89-d637-40b6-a1e9-a19815ba414f req-7fc8a2c3-eea8-4c7d-b61a-954c09b1e73d service nova] Lock "9d706c1a-883b-4b26-8972-4083df064e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:42 user nova-compute[74996]: DEBUG nova.compute.manager [req-472eff89-d637-40b6-a1e9-a19815ba414f req-7fc8a2c3-eea8-4c7d-b61a-954c09b1e73d service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] No waiting events found dispatching network-vif-plugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:38:42 user nova-compute[74996]: WARNING nova.compute.manager [req-472eff89-d637-40b6-a1e9-a19815ba414f req-7fc8a2c3-eea8-4c7d-b61a-954c09b1e73d service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Received unexpected event network-vif-plugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c for instance with vm_state building and task_state spawning.
Nov 02 01:38:42 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Instance spawned successfully.
Nov 02 01:38:42 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:38:42 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:38:42 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:38:42 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:38:42 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:38:42 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:38:42 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:38:42 user nova-compute[74996]: INFO nova.compute.manager [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Took 6.44 seconds to spawn the instance on the hypervisor.
Nov 02 01:38:42 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:38:42 user nova-compute[74996]: INFO nova.compute.manager [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Took 53.51 seconds to build instance.
Nov 02 01:38:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ec42da96-60eb-4502-96a5-c47af2efb9b5 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "9d706c1a-883b-4b26-8972-4083df064e93" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 53.626s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:42 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Successfully created port: b0a9d6f7-f2c1-41b7-9e90-04df4f23f8c3 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:38:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:43 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Successfully created port: b5d41e0b-52ab-46ba-8783-9f88087cecf8 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:38:44 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:38:44 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Took 5.34 seconds to deallocate network for instance.
Nov 02 01:38:44 user nova-compute[74996]: DEBUG nova.compute.manager [req-e3b86032-c6db-495a-8e62-57566170fbf9 req-60e34fec-4c6f-4633-9f96-ef37b50139ee service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-deleted-87bf8398-6ede-4465-9555-1000f74e75ff {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:44 user nova-compute[74996]: INFO nova.compute.manager [req-e3b86032-c6db-495a-8e62-57566170fbf9 req-60e34fec-4c6f-4633-9f96-ef37b50139ee service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Neutron deleted interface 87bf8398-6ede-4465-9555-1000f74e75ff; detaching it from the instance and deleting it from the info cache
Nov 02 01:38:44 user nova-compute[74996]: DEBUG nova.network.neutron [req-e3b86032-c6db-495a-8e62-57566170fbf9 req-60e34fec-4c6f-4633-9f96-ef37b50139ee service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Updating instance_info_cache with network_info: [{"id": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "address": "fa:16:3e:17:b8:62", "network": {"id": "45d38091-67e6-414b-9989-e308ebdcf57d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1896108595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap863ea8b0-7e", "ovs_interfaceid": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62492819-8da0-4a9f-9f78-facaaa194017", "address": "fa:16:3e:ac:91:39", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62492819-8d", "ovs_interfaceid": "62492819-8da0-4a9f-9f78-facaaa194017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "019034ca-6f89-400f-b47a-61e1157f860f", "address": "fa:16:3e:7f:67:62", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap019034ca-6f", "ovs_interfaceid": "019034ca-6f89-400f-b47a-61e1157f860f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3ade5deb-e2db-4310-b1a6-df399639eb00", "address": "fa:16:3e:22:42:a5", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ade5deb-e2", "ovs_interfaceid": "3ade5deb-e2db-4310-b1a6-df399639eb00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9042d944-67c5-4e39-9232-72ff23c6f1e0", "address": "fa:16:3e:05:b8:e8", "network": {"id": "9778b912-7b91-4a57-a5d6-fa3e8fd1016c", "bridge": "br-int", "label": "tempest-device-tagging-net2-519483991", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9042d944-67", "ovs_interfaceid": "9042d944-67c5-4e39-9232-72ff23c6f1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:38:44 user nova-compute[74996]: DEBUG nova.compute.manager [req-e3b86032-c6db-495a-8e62-57566170fbf9 req-60e34fec-4c6f-4633-9f96-ef37b50139ee service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Detach interface failed, port_id=87bf8398-6ede-4465-9555-1000f74e75ff, reason: Instance adfc9441-d607-4b9f-8008-95e42f1ac51e could not be found. {{(pid=74996) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 01:38:44 user nova-compute[74996]: DEBUG nova.compute.manager [req-e3b86032-c6db-495a-8e62-57566170fbf9 req-60e34fec-4c6f-4633-9f96-ef37b50139ee service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-deleted-3ade5deb-e2db-4310-b1a6-df399639eb00 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:44 user nova-compute[74996]: INFO nova.compute.manager [req-e3b86032-c6db-495a-8e62-57566170fbf9 req-60e34fec-4c6f-4633-9f96-ef37b50139ee service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Neutron deleted interface 3ade5deb-e2db-4310-b1a6-df399639eb00; detaching it from the instance and deleting it from the info cache
Nov 02 01:38:44 user nova-compute[74996]: DEBUG nova.network.neutron [req-e3b86032-c6db-495a-8e62-57566170fbf9 req-60e34fec-4c6f-4633-9f96-ef37b50139ee service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Updating instance_info_cache with network_info: [{"id": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "address": "fa:16:3e:17:b8:62", "network": {"id": "45d38091-67e6-414b-9989-e308ebdcf57d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1896108595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap863ea8b0-7e", "ovs_interfaceid": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62492819-8da0-4a9f-9f78-facaaa194017", "address": "fa:16:3e:ac:91:39", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62492819-8d", "ovs_interfaceid": "62492819-8da0-4a9f-9f78-facaaa194017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "019034ca-6f89-400f-b47a-61e1157f860f", "address": "fa:16:3e:7f:67:62", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap019034ca-6f", "ovs_interfaceid": "019034ca-6f89-400f-b47a-61e1157f860f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9042d944-67c5-4e39-9232-72ff23c6f1e0", "address": "fa:16:3e:05:b8:e8", "network": {"id": "9778b912-7b91-4a57-a5d6-fa3e8fd1016c", "bridge": "br-int", "label": "tempest-device-tagging-net2-519483991", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9042d944-67", "ovs_interfaceid": "9042d944-67c5-4e39-9232-72ff23c6f1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:38:44 user nova-compute[74996]: DEBUG nova.compute.manager [req-e3b86032-c6db-495a-8e62-57566170fbf9 req-60e34fec-4c6f-4633-9f96-ef37b50139ee service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Detach interface failed, port_id=3ade5deb-e2db-4310-b1a6-df399639eb00, reason: Instance adfc9441-d607-4b9f-8008-95e42f1ac51e could not be found. {{(pid=74996) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 01:38:44 user nova-compute[74996]: DEBUG nova.compute.manager [req-e3b86032-c6db-495a-8e62-57566170fbf9 req-60e34fec-4c6f-4633-9f96-ef37b50139ee service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-deleted-9042d944-67c5-4e39-9232-72ff23c6f1e0 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:44 user nova-compute[74996]: INFO nova.compute.manager [req-e3b86032-c6db-495a-8e62-57566170fbf9 req-60e34fec-4c6f-4633-9f96-ef37b50139ee service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Neutron deleted interface 9042d944-67c5-4e39-9232-72ff23c6f1e0; detaching it from the instance and deleting it from the info cache
Nov 02 01:38:44 user nova-compute[74996]: DEBUG nova.network.neutron [req-e3b86032-c6db-495a-8e62-57566170fbf9 req-60e34fec-4c6f-4633-9f96-ef37b50139ee service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Updating instance_info_cache with network_info: [{"id": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "address": "fa:16:3e:17:b8:62", "network": {"id": "45d38091-67e6-414b-9989-e308ebdcf57d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1896108595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap863ea8b0-7e", "ovs_interfaceid": "863ea8b0-7e3d-459a-bfb7-435e3e5001bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "62492819-8da0-4a9f-9f78-facaaa194017", "address": "fa:16:3e:ac:91:39", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62492819-8d", "ovs_interfaceid": "62492819-8da0-4a9f-9f78-facaaa194017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "019034ca-6f89-400f-b47a-61e1157f860f", "address": "fa:16:3e:7f:67:62", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap019034ca-6f", "ovs_interfaceid": "019034ca-6f89-400f-b47a-61e1157f860f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:38:44 user nova-compute[74996]: DEBUG nova.compute.manager [req-e3b86032-c6db-495a-8e62-57566170fbf9 req-60e34fec-4c6f-4633-9f96-ef37b50139ee service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Detach interface failed, port_id=9042d944-67c5-4e39-9232-72ff23c6f1e0, reason: Instance adfc9441-d607-4b9f-8008-95e42f1ac51e could not be found. {{(pid=74996) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 01:38:44 user nova-compute[74996]: DEBUG nova.compute.manager [req-e3b86032-c6db-495a-8e62-57566170fbf9 req-60e34fec-4c6f-4633-9f96-ef37b50139ee service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Received event network-vif-deleted-863ea8b0-7e3d-459a-bfb7-435e3e5001bf {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:44 user nova-compute[74996]: INFO nova.compute.manager [req-e3b86032-c6db-495a-8e62-57566170fbf9 req-60e34fec-4c6f-4633-9f96-ef37b50139ee service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Neutron deleted interface 863ea8b0-7e3d-459a-bfb7-435e3e5001bf; detaching it from the instance and deleting it from the info cache
Nov 02 01:38:44 user nova-compute[74996]: DEBUG nova.network.neutron [req-e3b86032-c6db-495a-8e62-57566170fbf9 req-60e34fec-4c6f-4633-9f96-ef37b50139ee service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Updating instance_info_cache with network_info: [{"id": "62492819-8da0-4a9f-9f78-facaaa194017", "address": "fa:16:3e:ac:91:39", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62492819-8d", "ovs_interfaceid": "62492819-8da0-4a9f-9f78-facaaa194017", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "019034ca-6f89-400f-b47a-61e1157f860f", "address": "fa:16:3e:7f:67:62", "network": {"id": "a16e25af-6044-4089-8641-2b184d9e13b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-312532071", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f98a3a508c5c4966806cb9352c4b9090", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap019034ca-6f", "ovs_interfaceid": "019034ca-6f89-400f-b47a-61e1157f860f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:38:44 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Successfully updated port: d837c1b5-c0e8-46bc-b31b-cd25ac7bf884 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:38:44 user nova-compute[74996]: DEBUG nova.compute.manager [req-e3b86032-c6db-495a-8e62-57566170fbf9 req-60e34fec-4c6f-4633-9f96-ef37b50139ee service nova] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Detach interface failed, port_id=863ea8b0-7e3d-459a-bfb7-435e3e5001bf, reason: Instance adfc9441-d607-4b9f-8008-95e42f1ac51e could not be found. {{(pid=74996) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 01:38:44 user nova-compute[74996]: DEBUG nova.compute.manager [req-0c522b15-49b5-489b-a803-cf5e1427b830 req-64844d28-7c11-4b65-bae5-24bd265f0c28 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Received event network-changed-d837c1b5-c0e8-46bc-b31b-cd25ac7bf884 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:44 user nova-compute[74996]: DEBUG nova.compute.manager [req-0c522b15-49b5-489b-a803-cf5e1427b830 req-64844d28-7c11-4b65-bae5-24bd265f0c28 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Refreshing instance network info cache due to event network-changed-d837c1b5-c0e8-46bc-b31b-cd25ac7bf884. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:38:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0c522b15-49b5-489b-a803-cf5e1427b830 req-64844d28-7c11-4b65-bae5-24bd265f0c28 service nova] Acquiring lock "refresh_cache-31da007b-1f16-4d01-8b1a-b41f60cd08f2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:38:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0c522b15-49b5-489b-a803-cf5e1427b830 req-64844d28-7c11-4b65-bae5-24bd265f0c28 service nova] Acquired lock "refresh_cache-31da007b-1f16-4d01-8b1a-b41f60cd08f2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:38:44 user nova-compute[74996]: DEBUG nova.network.neutron [req-0c522b15-49b5-489b-a803-cf5e1427b830 req-64844d28-7c11-4b65-bae5-24bd265f0c28 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Refreshing network info cache for port d837c1b5-c0e8-46bc-b31b-cd25ac7bf884 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:38:44 user nova-compute[74996]: DEBUG nova.network.neutron [req-0c522b15-49b5-489b-a803-cf5e1427b830 req-64844d28-7c11-4b65-bae5-24bd265f0c28 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:38:44 user nova-compute[74996]: DEBUG nova.network.neutron [req-0c522b15-49b5-489b-a803-cf5e1427b830 req-64844d28-7c11-4b65-bae5-24bd265f0c28 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:38:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0c522b15-49b5-489b-a803-cf5e1427b830 req-64844d28-7c11-4b65-bae5-24bd265f0c28 service nova] Releasing lock "refresh_cache-31da007b-1f16-4d01-8b1a-b41f60cd08f2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:38:45 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Successfully updated port: 1b3e28db-0c25-4f45-9d6b-5119a577ad29 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:38:46 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Successfully updated port: 5a245d2c-253d-473b-834c-83420dd6d91f {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:38:46 user nova-compute[74996]: DEBUG nova.compute.manager [req-1ed0f682-6197-4296-8ada-52e03862866b req-6132482f-495e-47b7-9f53-0508f6c06204 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Received event network-changed-1b3e28db-0c25-4f45-9d6b-5119a577ad29 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:46 user nova-compute[74996]: DEBUG nova.compute.manager [req-1ed0f682-6197-4296-8ada-52e03862866b req-6132482f-495e-47b7-9f53-0508f6c06204 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Refreshing instance network info cache due to event network-changed-1b3e28db-0c25-4f45-9d6b-5119a577ad29. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:38:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1ed0f682-6197-4296-8ada-52e03862866b req-6132482f-495e-47b7-9f53-0508f6c06204 service nova] Acquiring lock "refresh_cache-31da007b-1f16-4d01-8b1a-b41f60cd08f2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:38:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1ed0f682-6197-4296-8ada-52e03862866b req-6132482f-495e-47b7-9f53-0508f6c06204 service nova] Acquired lock "refresh_cache-31da007b-1f16-4d01-8b1a-b41f60cd08f2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:38:46 user nova-compute[74996]: DEBUG nova.network.neutron [req-1ed0f682-6197-4296-8ada-52e03862866b req-6132482f-495e-47b7-9f53-0508f6c06204 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Refreshing network info cache for port 1b3e28db-0c25-4f45-9d6b-5119a577ad29 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:38:46 user nova-compute[74996]: DEBUG nova.network.neutron [req-1ed0f682-6197-4296-8ada-52e03862866b req-6132482f-495e-47b7-9f53-0508f6c06204 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:38:46 user nova-compute[74996]: DEBUG nova.network.neutron [req-1ed0f682-6197-4296-8ada-52e03862866b req-6132482f-495e-47b7-9f53-0508f6c06204 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:38:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1ed0f682-6197-4296-8ada-52e03862866b req-6132482f-495e-47b7-9f53-0508f6c06204 service nova] Releasing lock "refresh_cache-31da007b-1f16-4d01-8b1a-b41f60cd08f2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:38:46 user nova-compute[74996]: DEBUG nova.compute.manager [req-1ed0f682-6197-4296-8ada-52e03862866b req-6132482f-495e-47b7-9f53-0508f6c06204 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Received event network-changed-5a245d2c-253d-473b-834c-83420dd6d91f {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:46 user nova-compute[74996]: DEBUG nova.compute.manager [req-1ed0f682-6197-4296-8ada-52e03862866b req-6132482f-495e-47b7-9f53-0508f6c06204 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Refreshing instance network info cache due to event network-changed-5a245d2c-253d-473b-834c-83420dd6d91f. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:38:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1ed0f682-6197-4296-8ada-52e03862866b req-6132482f-495e-47b7-9f53-0508f6c06204 service nova] Acquiring lock "refresh_cache-31da007b-1f16-4d01-8b1a-b41f60cd08f2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:38:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1ed0f682-6197-4296-8ada-52e03862866b req-6132482f-495e-47b7-9f53-0508f6c06204 service nova] Acquired lock "refresh_cache-31da007b-1f16-4d01-8b1a-b41f60cd08f2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:38:46 user nova-compute[74996]: DEBUG nova.network.neutron [req-1ed0f682-6197-4296-8ada-52e03862866b req-6132482f-495e-47b7-9f53-0508f6c06204 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Refreshing network info cache for port 5a245d2c-253d-473b-834c-83420dd6d91f {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:38:47 user nova-compute[74996]: DEBUG nova.network.neutron [req-1ed0f682-6197-4296-8ada-52e03862866b req-6132482f-495e-47b7-9f53-0508f6c06204 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:38:47 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Successfully updated port: 004e2b4b-86f0-4b1f-861a-db8f99a272ab {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:38:47 user nova-compute[74996]: DEBUG nova.network.neutron [req-1ed0f682-6197-4296-8ada-52e03862866b req-6132482f-495e-47b7-9f53-0508f6c06204 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:38:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1ed0f682-6197-4296-8ada-52e03862866b req-6132482f-495e-47b7-9f53-0508f6c06204 service nova] Releasing lock "refresh_cache-31da007b-1f16-4d01-8b1a-b41f60cd08f2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:38:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "c04b39dd-3961-4e23-ad43-34a218f4a472" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:47 user nova-compute[74996]: INFO nova.compute.manager [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Terminating instance
Nov 02 01:38:47 user nova-compute[74996]: DEBUG nova.compute.manager [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:38:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:47 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Successfully updated port: efb2f61a-fe66-48e0-a067-35d06f375412 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:38:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG nova.compute.manager [req-0d20dbdb-630e-42de-9684-daa9bd3489f7 req-ee43e7de-4396-4aa2-877f-551f3f46b203 service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Received event network-vif-unplugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0d20dbdb-630e-42de-9684-daa9bd3489f7 req-ee43e7de-4396-4aa2-877f-551f3f46b203 service nova] Acquiring lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0d20dbdb-630e-42de-9684-daa9bd3489f7 req-ee43e7de-4396-4aa2-877f-551f3f46b203 service nova] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0d20dbdb-630e-42de-9684-daa9bd3489f7 req-ee43e7de-4396-4aa2-877f-551f3f46b203 service nova] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG nova.compute.manager [req-0d20dbdb-630e-42de-9684-daa9bd3489f7 req-ee43e7de-4396-4aa2-877f-551f3f46b203 service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] No waiting events found dispatching network-vif-unplugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG nova.compute.manager [req-0d20dbdb-630e-42de-9684-daa9bd3489f7 req-ee43e7de-4396-4aa2-877f-551f3f46b203 service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Received event network-vif-unplugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG nova.compute.manager [req-d6855297-9f8c-44a6-8144-976d02767318 req-c492b1d8-fd07-4a59-96ae-c8c1a49f0689 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Received event network-changed-004e2b4b-86f0-4b1f-861a-db8f99a272ab {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG nova.compute.manager [req-d6855297-9f8c-44a6-8144-976d02767318 req-c492b1d8-fd07-4a59-96ae-c8c1a49f0689 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Refreshing instance network info cache due to event network-changed-004e2b4b-86f0-4b1f-861a-db8f99a272ab. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d6855297-9f8c-44a6-8144-976d02767318 req-c492b1d8-fd07-4a59-96ae-c8c1a49f0689 service nova] Acquiring lock "refresh_cache-31da007b-1f16-4d01-8b1a-b41f60cd08f2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d6855297-9f8c-44a6-8144-976d02767318 req-c492b1d8-fd07-4a59-96ae-c8c1a49f0689 service nova] Acquired lock "refresh_cache-31da007b-1f16-4d01-8b1a-b41f60cd08f2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG nova.network.neutron [req-d6855297-9f8c-44a6-8144-976d02767318 req-c492b1d8-fd07-4a59-96ae-c8c1a49f0689 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Refreshing network info cache for port 004e2b4b-86f0-4b1f-861a-db8f99a272ab {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:38:48 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Instance destroyed successfully.
Nov 02 01:38:48 user nova-compute[74996]: DEBUG nova.objects.instance [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lazy-loading 'resources' on Instance uuid c04b39dd-3961-4e23-ad43-34a218f4a472 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-83700266',display_name='tempest-ServerActionsTestOtherB-server-83700266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-83700266',id=2,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+Qz/HK0D2SWfSjBSFTRJ1B5PKDz0As2T6IrqSYMkdjVvyXlNOPr+4jggbHQf8/h9wUb6gFXAyyFyjYzXEE9DdDVU1SAq0i/8zGeoZyzalitAxQC04YuAZwWq1fcoAvuw==',key_name='tempest-keypair-912688440',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:36:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28fc6b23ac2b4c7e82fd2a473ddc69c7',ramdisk_id='',reservation_id='r-8s5rn1jj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-539262669',owner_user_name='tempest-ServerActionsTestOtherB-539262669-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:36:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fbb633ea13724161916c7a7b0ca2c392',uuid=c04b39dd-3961-4e23-ad43-34a218f4a472,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Converting VIF {"id": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "address": "fa:16:3e:75:a5:8a", "network": {"id": "fb067344-da99-4071-93f6-a4f844b74341", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-545485614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28fc6b23ac2b4c7e82fd2a473ddc69c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a0d9417-e8", "ovs_interfaceid": "0a0d9417-e8c0-4392-ba9b-f1e27712adad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:a5:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a0d9417-e8c0-4392-ba9b-f1e27712adad,network=Network(fb067344-da99-4071-93f6-a4f844b74341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0d9417-e8') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG os_vif [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:a5:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a0d9417-e8c0-4392-ba9b-f1e27712adad,network=Network(fb067344-da99-4071-93f6-a4f844b74341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0d9417-e8') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a0d9417-e8, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8cabd521-bece-4ee8-a6d4-97b9119a0a5a) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:38:48 user nova-compute[74996]: INFO os_vif [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:a5:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a0d9417-e8c0-4392-ba9b-f1e27712adad,network=Network(fb067344-da99-4071-93f6-a4f844b74341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a0d9417-e8')
Nov 02 01:38:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EvZlqADN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:38:48 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:38:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG nova.network.neutron [req-d6855297-9f8c-44a6-8144-976d02767318 req-c492b1d8-fd07-4a59-96ae-c8c1a49f0689 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f510661e-c256-4f4a-a1f1-fd7bb402632c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:38:48 user nova-compute[74996]: No targets found.
Nov 02 01:38:48 user nova-compute[74996]: iSNS:
Nov 02 01:38:48 user nova-compute[74996]: No targets found.
Nov 02 01:38:48 user nova-compute[74996]: STATIC:
Nov 02 01:38:48 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611
Nov 02 01:38:48 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:48 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:48 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7
Nov 02 01:38:48 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:48 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:48 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84
Nov 02 01:38:48 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:48 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:48 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8
Nov 02 01:38:48 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:48 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:48 user nova-compute[74996]: FIRMWARE:
Nov 02 01:38:48 user nova-compute[74996]: No targets found.
Nov 02 01:38:48 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:38:48 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:38:48 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0602f138-7580-48e6-9d5d-663b6d99dafd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Successfully updated port: b0a9d6f7-f2c1-41b7-9e90-04df4f23f8c3 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a821bb67-97c1-4499-ad83-2184f7bbec0d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:38:48 user nova-compute[74996]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:38:48 user nova-compute[74996]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)
Nov 02 01:38:48 user nova-compute[74996]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:38:48 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 (non-flash)
Nov 02 01:38:48 user nova-compute[74996]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:38:48 user nova-compute[74996]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)
Nov 02 01:38:48 user nova-compute[74996]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:38:48 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830c7c0b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84'): ({'sdf'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Removing single pathed devices sdf {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa860da-1998-48a8-9bcc-2de9dfebea8d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.030s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc75e857-783d-47a1-90e3-f96986aad43d]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Flushing IO for device /dev/sdf {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f518ee-1d62-4f7d-98d8-172b530b9f52]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a5fd41-9a62-4f0e-ab35-dfeafbbdc532]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] SCSI volumes sdf have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG nova.network.neutron [req-d6855297-9f8c-44a6-8144-976d02767318 req-c492b1d8-fd07-4a59-96ae-c8c1a49f0689 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b20de5-e989-4917-a3bb-a5d995ebb805]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d6855297-9f8c-44a6-8144-976d02767318 req-c492b1d8-fd07-4a59-96ae-c8c1a49f0689 service nova] Releasing lock "refresh_cache-31da007b-1f16-4d01-8b1a-b41f60cd08f2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG nova.compute.manager [req-d6855297-9f8c-44a6-8144-976d02767318 req-c492b1d8-fd07-4a59-96ae-c8c1a49f0689 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Received event network-changed-efb2f61a-fe66-48e0-a067-35d06f375412 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG nova.compute.manager [req-d6855297-9f8c-44a6-8144-976d02767318 req-c492b1d8-fd07-4a59-96ae-c8c1a49f0689 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Refreshing instance network info cache due to event network-changed-efb2f61a-fe66-48e0-a067-35d06f375412. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d6855297-9f8c-44a6-8144-976d02767318 req-c492b1d8-fd07-4a59-96ae-c8c1a49f0689 service nova] Acquiring lock "refresh_cache-31da007b-1f16-4d01-8b1a-b41f60cd08f2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d6855297-9f8c-44a6-8144-976d02767318 req-c492b1d8-fd07-4a59-96ae-c8c1a49f0689 service nova] Acquired lock "refresh_cache-31da007b-1f16-4d01-8b1a-b41f60cd08f2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG nova.network.neutron [req-d6855297-9f8c-44a6-8144-976d02767318 req-c492b1d8-fd07-4a59-96ae-c8c1a49f0689 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Refreshing network info cache for port efb2f61a-fe66-48e0-a067-35d06f375412 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[57010190-f1ba-4146-b981-976a19481d1a]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84, portal: 172.16.0.220,3260]
Nov 02 01:38:48 user nova-compute[74996]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84, portal: 172.16.0.220,3260] successful.
Nov 02 01:38:48 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7eafb5-e19a-44f4-ba2b-38684fd2aa84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bf04ad-5db3-4ffe-878f-f3531d0380fd]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] <== disconnect_volume: return (386ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:38:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:38:49 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Deleting instance files /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472_del
Nov 02 01:38:49 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Deletion of /opt/stack/data/nova/instances/c04b39dd-3961-4e23-ad43-34a218f4a472_del complete
Nov 02 01:38:49 user nova-compute[74996]: DEBUG nova.network.neutron [req-d6855297-9f8c-44a6-8144-976d02767318 req-c492b1d8-fd07-4a59-96ae-c8c1a49f0689 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:38:49 user nova-compute[74996]: INFO nova.compute.manager [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 02 01:38:49 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:38:49 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:38:49 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:38:49 user nova-compute[74996]: DEBUG nova.network.neutron [req-d6855297-9f8c-44a6-8144-976d02767318 req-c492b1d8-fd07-4a59-96ae-c8c1a49f0689 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:38:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d6855297-9f8c-44a6-8144-976d02767318 req-c492b1d8-fd07-4a59-96ae-c8c1a49f0689 service nova] Releasing lock "refresh_cache-31da007b-1f16-4d01-8b1a-b41f60cd08f2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:38:49 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Successfully updated port: b5d41e0b-52ab-46ba-8783-9f88087cecf8 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:38:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Acquiring lock "refresh_cache-31da007b-1f16-4d01-8b1a-b41f60cd08f2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:38:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Acquired lock "refresh_cache-31da007b-1f16-4d01-8b1a-b41f60cd08f2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:38:49 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:38:49 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:38:49 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:38:49 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Took 0.77 seconds to deallocate network for instance.
Nov 02 01:38:49 user nova-compute[74996]: DEBUG nova.compute.manager [req-b345e5ce-2f55-43fa-92ee-3641f7807199 req-dfc95d92-7ba3-4682-849d-ce4d18eca1ae service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Received event network-vif-deleted-0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:50 user nova-compute[74996]: DEBUG nova.compute.manager [req-b07c6181-24c1-459b-9273-a7a6bee53300 req-2bf9bc9e-bd0e-4556-86f7-ad32707bc917 service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Received event network-vif-plugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b07c6181-24c1-459b-9273-a7a6bee53300 req-2bf9bc9e-bd0e-4556-86f7-ad32707bc917 service nova] Acquiring lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b07c6181-24c1-459b-9273-a7a6bee53300 req-2bf9bc9e-bd0e-4556-86f7-ad32707bc917 service nova] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b07c6181-24c1-459b-9273-a7a6bee53300 req-2bf9bc9e-bd0e-4556-86f7-ad32707bc917 service nova] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:50 user nova-compute[74996]: DEBUG nova.compute.manager [req-b07c6181-24c1-459b-9273-a7a6bee53300 req-2bf9bc9e-bd0e-4556-86f7-ad32707bc917 service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] No waiting events found dispatching network-vif-plugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:38:50 user nova-compute[74996]: WARNING nova.compute.manager [req-b07c6181-24c1-459b-9273-a7a6bee53300 req-2bf9bc9e-bd0e-4556-86f7-ad32707bc917 service nova] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Received unexpected event network-vif-plugged-0a0d9417-e8c0-4392-ba9b-f1e27712adad for instance with vm_state active and task_state deleting.
Nov 02 01:38:50 user nova-compute[74996]: DEBUG nova.compute.manager [req-ac7338a0-310b-4877-9de9-7de9e46e2d47 req-9c69e3bc-527f-4894-9d14-c2ea9c850cc4 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Received event network-changed-b0a9d6f7-f2c1-41b7-9e90-04df4f23f8c3 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:50 user nova-compute[74996]: DEBUG nova.compute.manager [req-ac7338a0-310b-4877-9de9-7de9e46e2d47 req-9c69e3bc-527f-4894-9d14-c2ea9c850cc4 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Refreshing instance network info cache due to event network-changed-b0a9d6f7-f2c1-41b7-9e90-04df4f23f8c3. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:38:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ac7338a0-310b-4877-9de9-7de9e46e2d47 req-9c69e3bc-527f-4894-9d14-c2ea9c850cc4 service nova] Acquiring lock "refresh_cache-31da007b-1f16-4d01-8b1a-b41f60cd08f2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Updating instance_info_cache with network_info: [{"id": "d837c1b5-c0e8-46bc-b31b-cd25ac7bf884", "address": "fa:16:3e:53:ec:35", "network": {"id": "db5aedf3-0932-451a-a663-f0d36982526f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1691884435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd837c1b5-c0", "ovs_interfaceid": "d837c1b5-c0e8-46bc-b31b-cd25ac7bf884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1b3e28db-0c25-4f45-9d6b-5119a577ad29", "address": "fa:16:3e:70:dd:9c", "network": {"id": "6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302", "bridge": "br-int", "label": "tempest-device-tagging-net1-1985151211", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3e28db-0c", "ovs_interfaceid": "1b3e28db-0c25-4f45-9d6b-5119a577ad29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5a245d2c-253d-473b-834c-83420dd6d91f", "address": "fa:16:3e:34:ab:62", "network": {"id": "6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302", "bridge": "br-int", "label": "tempest-device-tagging-net1-1985151211", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a245d2c-25", "ovs_interfaceid": "5a245d2c-253d-473b-834c-83420dd6d91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "004e2b4b-86f0-4b1f-861a-db8f99a272ab", "address": "fa:16:3e:4c:86:0b", "network": {"id": "6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302", "bridge": "br-int", "label": "tempest-device-tagging-net1-1985151211", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004e2b4b-86", "ovs_interfaceid": "004e2b4b-86f0-4b1f-861a-db8f99a272ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "efb2f61a-fe66-48e0-a067-35d06f375412", "address": "fa:16:3e:0f:88:f1", "network": {"id": "6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302", "bridge": "br-int", "label": "tempest-device-tagging-net1-1985151211", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb2f61a-fe", "ovs_interfaceid": "efb2f61a-fe66-48e0-a067-35d06f375412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0a9d6f7-f2c1-41b7-9e90-04df4f23f8c3", "address": "fa:16:3e:38:45:14", "network": {"id": "fd8151b8-a1ff-40ab-9118-7e6042226042", "bridge": "br-int", "label": "tempest-device-tagging-net2-1306882922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a9d6f7-f2", "ovs_interfaceid": "b0a9d6f7-f2c1-41b7-9e90-04df4f23f8c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b5d41e0b-52ab-46ba-8783-9f88087cecf8", "address": "fa:16:3e:8c:33:88", "network": {"id": "fd8151b8-a1ff-40ab-9118-7e6042226042", "bridge": "br-int", "label": "tempest-device-tagging-net2-1306882922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d41e0b-52", "ovs_interfaceid": "b5d41e0b-52ab-46ba-8783-9f88087cecf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Releasing lock "refresh_cache-31da007b-1f16-4d01-8b1a-b41f60cd08f2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Instance network_info: |[{"id": "d837c1b5-c0e8-46bc-b31b-cd25ac7bf884", "address": "fa:16:3e:53:ec:35", "network": {"id": "db5aedf3-0932-451a-a663-f0d36982526f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1691884435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd837c1b5-c0", "ovs_interfaceid": "d837c1b5-c0e8-46bc-b31b-cd25ac7bf884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1b3e28db-0c25-4f45-9d6b-5119a577ad29", "address": "fa:16:3e:70:dd:9c", "network": {"id": "6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302", "bridge": "br-int", "label": "tempest-device-tagging-net1-1985151211", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3e28db-0c", "ovs_interfaceid": "1b3e28db-0c25-4f45-9d6b-5119a577ad29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5a245d2c-253d-473b-834c-83420dd6d91f", "address": "fa:16:3e:34:ab:62", "network": {"id": "6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302", "bridge": "br-int", "label": "tempest-device-tagging-net1-1985151211", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a245d2c-25", "ovs_interfaceid": "5a245d2c-253d-473b-834c-83420dd6d91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "004e2b4b-86f0-4b1f-861a-db8f99a272ab", "address": "fa:16:3e:4c:86:0b", "network": {"id": "6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302", "bridge": "br-int", "label": "tempest-device-tagging-net1-1985151211", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004e2b4b-86", "ovs_interfaceid": "004e2b4b-86f0-4b1f-861a-db8f99a272ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "efb2f61a-fe66-48e0-a067-35d06f375412", "address": "fa:16:3e:0f:88:f1", "network": {"id": "6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302", "bridge": "br-int", "label": "tempest-device-tagging-net1-1985151211", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb2f61a-fe", "ovs_interfaceid": "efb2f61a-fe66-48e0-a067-35d06f375412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0a9d6f7-f2c1-41b7-9e90-04df4f23f8c3", "address": "fa:16:3e:38:45:14", "network": {"id": "fd8151b8-a1ff-40ab-9118-7e6042226042", "bridge": "br-int", "label": "tempest-device-tagging-net2-1306882922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a9d6f7-f2", "ovs_interfaceid": "b0a9d6f7-f2c1-41b7-9e90-04df4f23f8c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b5d41e0b-52ab-46ba-8783-9f88087cecf8", "address": "fa:16:3e:8c:33:88", "network": {"id": "fd8151b8-a1ff-40ab-9118-7e6042226042", "bridge": "br-int", "label": "tempest-device-tagging-net2-1306882922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d41e0b-52", "ovs_interfaceid": "b5d41e0b-52ab-46ba-8783-9f88087cecf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ac7338a0-310b-4877-9de9-7de9e46e2d47 req-9c69e3bc-527f-4894-9d14-c2ea9c850cc4 service nova] Acquired lock "refresh_cache-31da007b-1f16-4d01-8b1a-b41f60cd08f2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG nova.network.neutron [req-ac7338a0-310b-4877-9de9-7de9e46e2d47 req-9c69e3bc-527f-4894-9d14-c2ea9c850cc4 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Refreshing network info cache for port b0a9d6f7-f2c1-41b7-9e90-04df4f23f8c3 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuqzjEfF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:38:51 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:38:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:38:51 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:38:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:38:51 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4318f38-7818-4d81-ae91-e91b95c38874]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:38:51 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[65efaaa9-3088-464d-aeeb-eb4833b478c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855] added
Nov 02 01:38:51 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[031f8e51-d471-4af0-aa99-3d16368177b8]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ada5fb-762d-4877-aab1-ad70106488c5]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DuqzjEfF {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DuqzjEfF" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[879359a4-aebc-4cdd-9725-04988a04b26b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DuqzjEfF'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad25f39-dd14-4ef9-b74a-03046e8072fe]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d51919-a79c-4273-8171-1e8c99ed870b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:38:51 user nova-compute[74996]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)
Nov 02 01:38:51 user nova-compute[74996]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:38:51 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:38:51 user nova-compute[74996]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)
Nov 02 01:38:51 user nova-compute[74996]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:38:51 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG nova.objects.instance [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lazy-loading 'flavor' on Instance uuid fa6400fb-9e90-4f94-9da7-238b91276f41 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG nova.network.neutron [req-ac7338a0-310b-4877-9de9-7de9e46e2d47 req-9c69e3bc-527f-4894-9d14-c2ea9c850cc4 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Updated VIF entry in instance network info cache for port b0a9d6f7-f2c1-41b7-9e90-04df4f23f8c3. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG nova.network.neutron [req-ac7338a0-310b-4877-9de9-7de9e46e2d47 req-9c69e3bc-527f-4894-9d14-c2ea9c850cc4 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Updating instance_info_cache with network_info: [{"id": "d837c1b5-c0e8-46bc-b31b-cd25ac7bf884", "address": "fa:16:3e:53:ec:35", "network": {"id": "db5aedf3-0932-451a-a663-f0d36982526f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1691884435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd837c1b5-c0", "ovs_interfaceid": "d837c1b5-c0e8-46bc-b31b-cd25ac7bf884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1b3e28db-0c25-4f45-9d6b-5119a577ad29", "address": "fa:16:3e:70:dd:9c", "network": {"id": "6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302", "bridge": "br-int", "label": "tempest-device-tagging-net1-1985151211", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3e28db-0c", "ovs_interfaceid": "1b3e28db-0c25-4f45-9d6b-5119a577ad29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5a245d2c-253d-473b-834c-83420dd6d91f", "address": "fa:16:3e:34:ab:62", "network": {"id": "6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302", "bridge": "br-int", "label": "tempest-device-tagging-net1-1985151211", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a245d2c-25", "ovs_interfaceid": "5a245d2c-253d-473b-834c-83420dd6d91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "004e2b4b-86f0-4b1f-861a-db8f99a272ab", "address": "fa:16:3e:4c:86:0b", "network": {"id": "6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302", "bridge": "br-int", "label": "tempest-device-tagging-net1-1985151211", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004e2b4b-86", "ovs_interfaceid": "004e2b4b-86f0-4b1f-861a-db8f99a272ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "efb2f61a-fe66-48e0-a067-35d06f375412", "address": "fa:16:3e:0f:88:f1", "network": {"id": "6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302", "bridge": "br-int", "label": "tempest-device-tagging-net1-1985151211", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb2f61a-fe", "ovs_interfaceid": "efb2f61a-fe66-48e0-a067-35d06f375412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0a9d6f7-f2c1-41b7-9e90-04df4f23f8c3", "address": "fa:16:3e:38:45:14", "network": {"id": "fd8151b8-a1ff-40ab-9118-7e6042226042", "bridge": "br-int", "label": "tempest-device-tagging-net2-1306882922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a9d6f7-f2", "ovs_interfaceid": "b0a9d6f7-f2c1-41b7-9e90-04df4f23f8c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b5d41e0b-52ab-46ba-8783-9f88087cecf8", "address": "fa:16:3e:8c:33:88", "network": {"id": "fd8151b8-a1ff-40ab-9118-7e6042226042", "bridge": "br-int", "label": "tempest-device-tagging-net2-1306882922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d41e0b-52", "ovs_interfaceid": "b5d41e0b-52ab-46ba-8783-9f88087cecf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ac7338a0-310b-4877-9de9-7de9e46e2d47 req-9c69e3bc-527f-4894-9d14-c2ea9c850cc4 service nova] Releasing lock "refresh_cache-31da007b-1f16-4d01-8b1a-b41f60cd08f2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-ac7338a0-310b-4877-9de9-7de9e46e2d47 req-9c69e3bc-527f-4894-9d14-c2ea9c850cc4 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Received event network-changed-b5d41e0b-52ab-46ba-8783-9f88087cecf8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-ac7338a0-310b-4877-9de9-7de9e46e2d47 req-9c69e3bc-527f-4894-9d14-c2ea9c850cc4 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Refreshing instance network info cache due to event network-changed-b5d41e0b-52ab-46ba-8783-9f88087cecf8. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ac7338a0-310b-4877-9de9-7de9e46e2d47 req-9c69e3bc-527f-4894-9d14-c2ea9c850cc4 service nova] Acquiring lock "refresh_cache-31da007b-1f16-4d01-8b1a-b41f60cd08f2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ac7338a0-310b-4877-9de9-7de9e46e2d47 req-9c69e3bc-527f-4894-9d14-c2ea9c850cc4 service nova] Acquired lock "refresh_cache-31da007b-1f16-4d01-8b1a-b41f60cd08f2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG nova.network.neutron [req-ac7338a0-310b-4877-9de9-7de9e46e2d47 req-9c69e3bc-527f-4894-9d14-c2ea9c850cc4 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Refreshing network info cache for port b5d41e0b-52ab-46ba-8783-9f88087cecf8 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a992f409-051f-43d5-a8ef-ef4efbd23a73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855, portal: 172.16.0.220,3260]
Nov 02 01:38:51 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855, portal: 172.16.0.220,3260] successful.
Nov 02 01:38:51 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b46bb5a2-745a-4936-9533-89d7e850541e tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 40.172s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:52 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:52 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[666278ae-6b17-4a19-8327-bf02d5afb3c9]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:52 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:52 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:52 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:52 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[55743d40-380a-474a-9c47-43ed8a50d59b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:52 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:38:52 user nova-compute[74996]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)
Nov 02 01:38:52 user nova-compute[74996]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:38:52 user nova-compute[74996]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 (non-flash)
Nov 02 01:38:52 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:38:52 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:38:52 user nova-compute[74996]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)
Nov 02 01:38:52 user nova-compute[74996]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:38:52 user nova-compute[74996]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 (non-flash)
Nov 02 01:38:52 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:38:52 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:38:52 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:38:52 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:38:52 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:38:52 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:52 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:52 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3405c0-f3c8-47a9-b548-a5b8070ea843]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:52 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:38:52 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuqzjEfF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:38:52 user nova-compute[74996]: DEBUG nova.network.neutron [req-ac7338a0-310b-4877-9de9-7de9e46e2d47 req-9c69e3bc-527f-4894-9d14-c2ea9c850cc4 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Updated VIF entry in instance network info cache for port b5d41e0b-52ab-46ba-8783-9f88087cecf8. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:38:52 user nova-compute[74996]: DEBUG nova.network.neutron [req-ac7338a0-310b-4877-9de9-7de9e46e2d47 req-9c69e3bc-527f-4894-9d14-c2ea9c850cc4 service nova] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Updating instance_info_cache with network_info: [{"id": "d837c1b5-c0e8-46bc-b31b-cd25ac7bf884", "address": "fa:16:3e:53:ec:35", "network": {"id": "db5aedf3-0932-451a-a663-f0d36982526f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1691884435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd837c1b5-c0", "ovs_interfaceid": "d837c1b5-c0e8-46bc-b31b-cd25ac7bf884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1b3e28db-0c25-4f45-9d6b-5119a577ad29", "address": "fa:16:3e:70:dd:9c", "network": {"id": "6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302", "bridge": "br-int", "label": "tempest-device-tagging-net1-1985151211", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3e28db-0c", "ovs_interfaceid": "1b3e28db-0c25-4f45-9d6b-5119a577ad29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5a245d2c-253d-473b-834c-83420dd6d91f", "address": "fa:16:3e:34:ab:62", "network": {"id": "6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302", "bridge": "br-int", "label": "tempest-device-tagging-net1-1985151211", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a245d2c-25", "ovs_interfaceid": "5a245d2c-253d-473b-834c-83420dd6d91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "004e2b4b-86f0-4b1f-861a-db8f99a272ab", "address": "fa:16:3e:4c:86:0b", "network": {"id": "6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302", "bridge": "br-int", "label": "tempest-device-tagging-net1-1985151211", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004e2b4b-86", "ovs_interfaceid": "004e2b4b-86f0-4b1f-861a-db8f99a272ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "efb2f61a-fe66-48e0-a067-35d06f375412", "address": "fa:16:3e:0f:88:f1", "network": {"id": "6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302", "bridge": "br-int", "label": "tempest-device-tagging-net1-1985151211", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb2f61a-fe", "ovs_interfaceid": "efb2f61a-fe66-48e0-a067-35d06f375412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0a9d6f7-f2c1-41b7-9e90-04df4f23f8c3", "address": "fa:16:3e:38:45:14", "network": {"id": "fd8151b8-a1ff-40ab-9118-7e6042226042", "bridge": "br-int", "label": "tempest-device-tagging-net2-1306882922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a9d6f7-f2", "ovs_interfaceid": "b0a9d6f7-f2c1-41b7-9e90-04df4f23f8c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b5d41e0b-52ab-46ba-8783-9f88087cecf8", "address": "fa:16:3e:8c:33:88", "network": {"id": "fd8151b8-a1ff-40ab-9118-7e6042226042", "bridge": "br-int", "label": "tempest-device-tagging-net2-1306882922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d41e0b-52", "ovs_interfaceid": "b5d41e0b-52ab-46ba-8783-9f88087cecf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:38:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ac7338a0-310b-4877-9de9-7de9e46e2d47 req-9c69e3bc-527f-4894-9d14-c2ea9c850cc4 service nova] Releasing lock "refresh_cache-31da007b-1f16-4d01-8b1a-b41f60cd08f2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:38:52 user nova-compute[74996]: INFO nova.compute.manager [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] [instance: c04b39dd-3961-4e23-ad43-34a218f4a472] Took 2.99 seconds to detach 1 volumes for instance.
Nov 02 01:38:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:38:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23038383338333135', 'path': '/dev/sdc'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:38:53 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038383338333135', 'path': '/dev/sdc'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:38:53 user nova-compute[74996]: DEBUG nova.objects.instance [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lazy-loading 'flavor' on Instance uuid da10dadd-b04a-4f3b-92bd-fcaa18b51fce {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:38:53 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 01:38:53 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:38:53 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 01:38:53 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:38:53 user nova-compute[74996]:   <serial>93e3e6fa-4c8c-43f0-9138-e4bac5747855</serial>
Nov 02 01:38:53 user nova-compute[74996]: </disk>
Nov 02 01:38:53 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 01:38:53 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:38:53 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:38:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:53 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Deleted allocations for instance c04b39dd-3961-4e23-ad43-34a218f4a472
Nov 02 01:38:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-faedf0b4-8fc0-44dd-852b-41ceb1b76639 tempest-ServerActionsTestOtherB-539262669 tempest-ServerActionsTestOtherB-539262669-project-member] Lock "c04b39dd-3961-4e23-ad43-34a218f4a472" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.799s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:53 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:38:53 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:38:53 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] No VIF found with MAC fa:16:3e:f8:1e:be, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:38:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a1f51fe9-ac62-4ad3-a45e-44a90b14dd7b tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.653s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Acquiring lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG nova.objects.instance [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lazy-loading 'flavor' on Instance uuid da10dadd-b04a-4f3b-92bd-fcaa18b51fce {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.103s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Acquiring lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:38:57 user nova-compute[74996]: INFO nova.compute.manager [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Attaching volume bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 to /dev/vdc
Nov 02 01:38:57 user nova-compute[74996]: DEBUG os_brick.utils [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af54490-84b5-4a83-b8d6-ce01f3e8a8e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e9912f-778c-4572-ba97-59b2c02dbbd5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb8f24c-25d6-44a7-be76-af59b948a135]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e7630a-6e53-4ddf-8464-2d20445e6fb5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:57 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f44d0b13-9dae-40c9-83d0-0b84699b1cc2 is timed out.
Nov 02 01:38:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:38:57 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:38:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6890d19-6ac7-43fc-8cab-5cf5969c62b7]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG os_brick.utils [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Updating existing volume attachment record: a51244d3-7205-408e-bee6-7bd30f9e1fce {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:38:57 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Successfully detached device vdb from instance f44d0b13-9dae-40c9-83d0-0b84699b1cc2 from the live domain config.
Nov 02 01:38:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixIUuWLZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:38:57 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:38:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[900918da-b697-430b-b538-a6aff9f0bd68]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:38:57 user nova-compute[74996]: No targets found.
Nov 02 01:38:57 user nova-compute[74996]: iSNS:
Nov 02 01:38:57 user nova-compute[74996]: No targets found.
Nov 02 01:38:57 user nova-compute[74996]: STATIC:
Nov 02 01:38:57 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855
Nov 02 01:38:57 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:57 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:57 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611
Nov 02 01:38:57 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:57 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:57 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7
Nov 02 01:38:57 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:57 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:57 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8
Nov 02 01:38:57 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:38:57 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:38:57 user nova-compute[74996]: FIRMWARE:
Nov 02 01:38:57 user nova-compute[74996]: No targets found.
Nov 02 01:38:57 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:38:57 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:38:57 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:38:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c7ef43-5ec4-48fe-90a6-900dbc6be489]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d761a7-56f2-4719-a1d4-8c6998879f99]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:38:58 user nova-compute[74996]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)
Nov 02 01:38:58 user nova-compute[74996]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:38:58 user nova-compute[74996]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 (non-flash)
Nov 02 01:38:58 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:38:58 user nova-compute[74996]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 (non-flash)
Nov 02 01:38:58 user nova-compute[74996]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:38:58 user nova-compute[74996]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 (non-flash)
Nov 02 01:38:58 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f831428a9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611'): ({'sdd'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Removing single pathed devices sdd {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c2ea7e-6f87-4870-bcaf-9bc8131fa3d0]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[240b5fa2-0d4b-4915-a7d8-286ee4e688aa]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Flushing IO for device /dev/sdd {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f8bb66-be8c-47d8-a4f5-3e26035cd7e3]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f7f99c-00f3-492a-82a6-61a31f185093]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] SCSI volumes sdd have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8df700-9996-480c-8846-83d295f31547]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8732647-7a71-4d7a-94da-5a933b6ad141]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611, portal: 172.16.0.220,3260]
Nov 02 01:38:58 user nova-compute[74996]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611, portal: 172.16.0.220,3260] successful.
Nov 02 01:38:58 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6336836f-4059-41bb-b86d-6ae54b4de611 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e7f5ae-f0eb-4044-9472-628b6f5de592]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] <== disconnect_volume: return (374ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:38:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:00 user nova-compute[74996]: INFO nova.compute.manager [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] [instance: adfc9441-d607-4b9f-8008-95e42f1ac51e] Took 15.98 seconds to detach 3 volumes for instance.
Nov 02 01:39:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:39:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:39:00 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:39:00 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:39:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:39:00 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Deleted allocations for instance adfc9441-d607-4b9f-8008-95e42f1ac51e
Nov 02 01:39:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d9ac0592-160a-4201-8439-431261874765 tempest-TaggedBootDevicesTest-997890989 tempest-TaggedBootDevicesTest-997890989-project-member] Lock "adfc9441-d607-4b9f-8008-95e42f1ac51e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 27.406s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:39:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:04 user nova-compute[74996]: INFO nova.virt.block_device [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Booting with volume 1cf83048-4745-486f-b222-0a84a9e81cb6 at /dev/vdb
Nov 02 01:39:04 user nova-compute[74996]: DEBUG os_brick.utils [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86f5f0f-ce97-4283-8590-f3fe28f4f8d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9971689d-f0a8-4f52-bbd6-39f954509375]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a87ceb-9a6c-4c60-b9c6-83f33d108c89]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc2999e-5bcf-43fe-9ea2-fe687ed51d4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-10b4258f-98ab-42d5-b582-a3c757de064f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "fa6400fb-9e90-4f94-9da7-238b91276f41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-10b4258f-98ab-42d5-b582-a3c757de064f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-10b4258f-98ab-42d5-b582-a3c757de064f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "fa6400fb-9e90-4f94-9da7-238b91276f41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-10b4258f-98ab-42d5-b582-a3c757de064f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-10b4258f-98ab-42d5-b582-a3c757de064f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:39:04 user nova-compute[74996]: INFO nova.compute.manager [None req-10b4258f-98ab-42d5-b582-a3c757de064f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Terminating instance
Nov 02 01:39:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG nova.compute.manager [None req-10b4258f-98ab-42d5-b582-a3c757de064f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:39:04 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:39:04 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8965903-9dd8-488c-a22d-e5d8ca554c9c]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG os_brick.utils [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Updating existing volume attachment record: a8b6eea5-34da-46fe-bc85-5146eddd913d {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG nova.compute.manager [req-2edfc403-a95e-49f0-aca9-c91df13e98ff req-23a7e22c-91c1-462b-91b5-ab27566fd7cb service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Received event network-vif-unplugged-7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2edfc403-a95e-49f0-aca9-c91df13e98ff req-23a7e22c-91c1-462b-91b5-ab27566fd7cb service nova] Acquiring lock "fa6400fb-9e90-4f94-9da7-238b91276f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:39:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2edfc403-a95e-49f0-aca9-c91df13e98ff req-23a7e22c-91c1-462b-91b5-ab27566fd7cb service nova] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:39:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2edfc403-a95e-49f0-aca9-c91df13e98ff req-23a7e22c-91c1-462b-91b5-ab27566fd7cb service nova] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:39:05 user nova-compute[74996]: DEBUG nova.compute.manager [req-2edfc403-a95e-49f0-aca9-c91df13e98ff req-23a7e22c-91c1-462b-91b5-ab27566fd7cb service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] No waiting events found dispatching network-vif-unplugged-7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:39:05 user nova-compute[74996]: DEBUG nova.compute.manager [req-2edfc403-a95e-49f0-aca9-c91df13e98ff req-23a7e22c-91c1-462b-91b5-ab27566fd7cb service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Received event network-vif-unplugged-7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:39:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:05 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Instance destroyed successfully.
Nov 02 01:39:05 user nova-compute[74996]: DEBUG nova.objects.instance [None req-10b4258f-98ab-42d5-b582-a3c757de064f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lazy-loading 'resources' on Instance uuid fa6400fb-9e90-4f94-9da7-238b91276f41 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:39:05 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-10b4258f-98ab-42d5-b582-a3c757de064f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T01:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2134430177',display_name='tempest-ServerActionsTestOtherA-server-263817137',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2134430177',id=11,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNN6oJiXhFxdMwj/0co4qWNsZDCOOAm4cBGkxSrT+8SbME3yAUS7Lu3VoxNK9wQW0hSSDE/yVKt92SwOB9CarD6wWY/rtu715m22W1QHYAaorIXtxO2ABbriBx1V6vl75g==',key_name='tempest-keypair-884605409',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:36:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f462793d4eb4433c9c27d92f80518db1',ramdisk_id='',reservation_id='r-nwbxga7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-852070362',owner_user_name='tempest-ServerActionsTestOtherA-852070362-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:36:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0ac87391a0140ba83743c0a2cd193fe',uuid=fa6400fb-9e90-4f94-9da7-238b91276f41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "address": "fa:16:3e:8e:48:16", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3ba0fb-89", "ovs_interfaceid": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:39:05 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-10b4258f-98ab-42d5-b582-a3c757de064f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Converting VIF {"id": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "address": "fa:16:3e:8e:48:16", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3ba0fb-89", "ovs_interfaceid": "7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:39:05 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-10b4258f-98ab-42d5-b582-a3c757de064f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:48:16,bridge_name='br-int',has_traffic_filtering=True,id=7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3ba0fb-89') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:39:05 user nova-compute[74996]: DEBUG os_vif [None req-10b4258f-98ab-42d5-b582-a3c757de064f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:48:16,bridge_name='br-int',has_traffic_filtering=True,id=7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3ba0fb-89') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:39:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a3ba0fb-89, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:39:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:39:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=44d0931d-1374-4cfd-8ca4-893d2e78ed67) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:39:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:05 user nova-compute[74996]: INFO os_vif [None req-10b4258f-98ab-42d5-b582-a3c757de064f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:48:16,bridge_name='br-int',has_traffic_filtering=True,id=7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3ba0fb-89')
Nov 02 01:39:05 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-10b4258f-98ab-42d5-b582-a3c757de064f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Deleting instance files /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41_del
Nov 02 01:39:05 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-10b4258f-98ab-42d5-b582-a3c757de064f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Deletion of /opt/stack/data/nova/instances/fa6400fb-9e90-4f94-9da7-238b91276f41_del complete
Nov 02 01:39:05 user nova-compute[74996]: INFO nova.compute.manager [None req-10b4258f-98ab-42d5-b582-a3c757de064f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 02 01:39:05 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-10b4258f-98ab-42d5-b582-a3c757de064f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:39:05 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:39:05 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:39:06 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:39:06 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Took 0.81 seconds to deallocate network for instance.
Nov 02 01:39:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-10b4258f-98ab-42d5-b582-a3c757de064f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:39:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-10b4258f-98ab-42d5-b582-a3c757de064f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:39:06 user nova-compute[74996]: DEBUG nova.compute.manager [req-c5ead3a3-de28-4b5e-b8b3-3598964dfc93 req-0f4c9890-a595-4862-acd3-d99326bf10fc service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Received event network-vif-deleted-7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:39:06 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-10b4258f-98ab-42d5-b582-a3c757de064f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:39:06 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-10b4258f-98ab-42d5-b582-a3c757de064f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:39:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-10b4258f-98ab-42d5-b582-a3c757de064f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:39:06 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-10b4258f-98ab-42d5-b582-a3c757de064f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Deleted allocations for instance fa6400fb-9e90-4f94-9da7-238b91276f41
Nov 02 01:39:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-10b4258f-98ab-42d5-b582-a3c757de064f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.405s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:39:07 user nova-compute[74996]: DEBUG nova.compute.manager [req-18a1f52c-0bc4-4ab8-b0c7-55c9bcb90c4f req-81a02a38-fff9-4a42-a592-08d5d640b9da service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Received event network-vif-plugged-7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:39:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-18a1f52c-0bc4-4ab8-b0c7-55c9bcb90c4f req-81a02a38-fff9-4a42-a592-08d5d640b9da service nova] Acquiring lock "fa6400fb-9e90-4f94-9da7-238b91276f41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:39:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-18a1f52c-0bc4-4ab8-b0c7-55c9bcb90c4f req-81a02a38-fff9-4a42-a592-08d5d640b9da service nova] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:39:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-18a1f52c-0bc4-4ab8-b0c7-55c9bcb90c4f req-81a02a38-fff9-4a42-a592-08d5d640b9da service nova] Lock "fa6400fb-9e90-4f94-9da7-238b91276f41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:39:07 user nova-compute[74996]: DEBUG nova.compute.manager [req-18a1f52c-0bc4-4ab8-b0c7-55c9bcb90c4f req-81a02a38-fff9-4a42-a592-08d5d640b9da service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] No waiting events found dispatching network-vif-plugged-7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:39:07 user nova-compute[74996]: WARNING nova.compute.manager [req-18a1f52c-0bc4-4ab8-b0c7-55c9bcb90c4f req-81a02a38-fff9-4a42-a592-08d5d640b9da service nova] [instance: fa6400fb-9e90-4f94-9da7-238b91276f41] Received unexpected event network-vif-plugged-7a3ba0fb-8994-4d6e-bc82-b1f13c07c74e for instance with vm_state deleted and task_state None.
Nov 02 01:39:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:09 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:39:10 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:39:10 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:13 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:39:14 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:39:14 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:39:14 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:39:15 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:39:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:39:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:39:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:39:15 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:39:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:39:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:39:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:39:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:18 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:39:18 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:39:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=7833MB free_disk=25.267200469970703GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:39:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:39:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:39:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance fea802b7-64d9-4c77-87a7-eaba1dce5c22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:39:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7307f3a3-1ad1-43f7-be49-9cd03a626cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:39:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 6b79aa2f-02c7-492e-b27e-7481e41f8d2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:39:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance d8f51f7d-c9de-4914-883e-7a875d3d73ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:39:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance f44d0b13-9dae-40c9-83d0-0b84699b1cc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:39:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance da10dadd-b04a-4f3b-92bd-fcaa18b51fce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:39:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 9d706c1a-883b-4b26-8972-4083df064e93 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:39:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 31da007b-1f16-4d01-8b1a-b41f60cd08f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:39:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:39:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:39:18 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:39:18 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:39:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:39:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.419s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:39:19 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:39:19 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:39:19 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:39:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-6b79aa2f-02c7-492e-b27e-7481e41f8d2c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:39:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-6b79aa2f-02c7-492e-b27e-7481e41f8d2c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:39:19 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 01:39:20 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Updating instance_info_cache with network_info: [{"id": "eed60db2-70ab-4fd5-aa15-91c391740d1d", "address": "fa:16:3e:16:c6:b4", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed60db2-70", "ovs_interfaceid": "eed60db2-70ab-4fd5-aa15-91c391740d1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:39:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-6b79aa2f-02c7-492e-b27e-7481e41f8d2c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:39:20 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 01:39:20 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:39:20 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:39:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:21 user nova-compute[74996]: DEBUG nova.objects.instance [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lazy-loading 'flavor' on Instance uuid f44d0b13-9dae-40c9-83d0-0b84699b1cc2 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:39:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b47b4919-d0b9-465d-9ee4-8093c7e572ff tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 44.701s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:39:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Acquiring lock "interface-f44d0b13-9dae-40c9-83d0-0b84699b1cc2-d1504136-cb23-4cfd-981b-5f4a46f71bb1" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:39:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "interface-f44d0b13-9dae-40c9-83d0-0b84699b1cc2-d1504136-cb23-4cfd-981b-5f4a46f71bb1" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:39:21 user nova-compute[74996]: DEBUG nova.objects.instance [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lazy-loading 'flavor' on Instance uuid f44d0b13-9dae-40c9-83d0-0b84699b1cc2 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:39:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111239639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111239639',id=17,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLtwBp/DvHskyQXeHr37ezG4yqg/zTU4wDpo1xGzexMimgVBKyE7nsHF9zbcCIyqHw1sf3kCFQioLSlFRREV/mNyOI03M7/LCcKSZAW08/rLH78veAeoRHPxfQDNyUQqA==',key_name='tempest-keypair-876877355',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:35:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7981230c517e493883bb048b1cfa7907',ramdisk_id='',reservation_id='r-ccrouw9n',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-722286534',owner_user_name='tempest-TaggedAttachmentsTest-722286534-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:35:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bb72dff3f614017b0ddc032ac15cd7b',uuid=f44d0b13-9dae-40c9-83d0-0b84699b1cc2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1504136-cb23-4cfd-981b-5f4a46f71bb1", "address": "fa:16:3e:fd:76:d8", "network": {"id": "d7c8d7c4-4b9d-4903-bdaf-c3db1f11a6dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1241834085", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7981230c517e493883bb048b1cfa7907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1504136-cb", "ovs_interfaceid": "d1504136-cb23-4cfd-981b-5f4a46f71bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:39:21 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Converting VIF {"id": "d1504136-cb23-4cfd-981b-5f4a46f71bb1", "address": "fa:16:3e:fd:76:d8", "network": {"id": "d7c8d7c4-4b9d-4903-bdaf-c3db1f11a6dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1241834085", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7981230c517e493883bb048b1cfa7907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1504136-cb", "ovs_interfaceid": "d1504136-cb23-4cfd-981b-5f4a46f71bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:39:21 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:76:d8,bridge_name='br-int',has_traffic_filtering=True,id=d1504136-cb23-4cfd-981b-5f4a46f71bb1,network=Network(d7c8d7c4-4b9d-4903-bdaf-c3db1f11a6dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1504136-cb') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:39:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fd:76:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tapd1504136-cb"/></interface> {{(pid=74996) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 01:39:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fd:76:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tapd1504136-cb"/></interface> {{(pid=74996) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 01:39:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Attempting to detach device tapd1504136-cb from instance f44d0b13-9dae-40c9-83d0-0b84699b1cc2 from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 01:39:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] detach device xml: <interface type="ethernet">
Nov 02 01:39:21 user nova-compute[74996]:   <mac address="fa:16:3e:fd:76:d8"/>
Nov 02 01:39:21 user nova-compute[74996]:   <model type="virtio"/>
Nov 02 01:39:21 user nova-compute[74996]:   <mtu size="1442"/>
Nov 02 01:39:21 user nova-compute[74996]:   <target dev="tapd1504136-cb"/>
Nov 02 01:39:21 user nova-compute[74996]: </interface>
Nov 02 01:39:21 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:39:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fd:76:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tapd1504136-cb"/></interface> {{(pid=74996) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 01:39:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fd:76:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tapd1504136-cb"/></interface>not found in domain: <domain type='kvm' id='16'>
Nov 02 01:39:21 user nova-compute[74996]:   <name>instance-00000011</name>
Nov 02 01:39:21 user nova-compute[74996]:   <uuid>f44d0b13-9dae-40c9-83d0-0b84699b1cc2</uuid>
Nov 02 01:39:21 user nova-compute[74996]:   <metadata>
Nov 02 01:39:21 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:39:21 user nova-compute[74996]:   <nova:package version="0.0.0"/>
Nov 02 01:39:21 user nova-compute[74996]:   <nova:name>tempest-device-tagging-server-2111239639</nova:name>
Nov 02 01:39:21 user nova-compute[74996]:   <nova:creationTime>2023-11-02 01:37:21</nova:creationTime>
Nov 02 01:39:21 user nova-compute[74996]:   <nova:flavor name="m1.tiny">
Nov 02 01:39:21 user nova-compute[74996]:     <nova:memory>512</nova:memory>
Nov 02 01:39:21 user nova-compute[74996]:     <nova:disk>1</nova:disk>
Nov 02 01:39:21 user nova-compute[74996]:     <nova:swap>0</nova:swap>
Nov 02 01:39:21 user nova-compute[74996]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:39:21 user nova-compute[74996]:     <nova:vcpus>1</nova:vcpus>
Nov 02 01:39:21 user nova-compute[74996]:   </nova:flavor>
Nov 02 01:39:21 user nova-compute[74996]:   <nova:owner>
Nov 02 01:39:21 user nova-compute[74996]:     <nova:user uuid="1bb72dff3f614017b0ddc032ac15cd7b">tempest-TaggedAttachmentsTest-722286534-project-member</nova:user>
Nov 02 01:39:21 user nova-compute[74996]:     <nova:project uuid="7981230c517e493883bb048b1cfa7907">tempest-TaggedAttachmentsTest-722286534</nova:project>
Nov 02 01:39:21 user nova-compute[74996]:   </nova:owner>
Nov 02 01:39:21 user nova-compute[74996]:   <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:39:21 user nova-compute[74996]:   <nova:ports>
Nov 02 01:39:21 user nova-compute[74996]:     <nova:port uuid="fbf546f3-964c-4816-84c1-20d11b5ed544">
Nov 02 01:39:21 user nova-compute[74996]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 01:39:21 user nova-compute[74996]:     </nova:port>
Nov 02 01:39:21 user nova-compute[74996]:     <nova:port uuid="d1504136-cb23-4cfd-981b-5f4a46f71bb1">
Nov 02 01:39:21 user nova-compute[74996]:       <nova:ip type="fixed" address="10.10.10.180" ipVersion="4"/>
Nov 02 01:39:21 user nova-compute[74996]:     </nova:port>
Nov 02 01:39:21 user nova-compute[74996]:   </nova:ports>
Nov 02 01:39:21 user nova-compute[74996]: </nova:instance>
Nov 02 01:39:21 user nova-compute[74996]:   </metadata>
Nov 02 01:39:21 user nova-compute[74996]:   <memory unit='KiB'>524288</memory>
Nov 02 01:39:21 user nova-compute[74996]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 02 01:39:21 user nova-compute[74996]:   <vcpu placement='static'>1</vcpu>
Nov 02 01:39:21 user nova-compute[74996]:   <resource>
Nov 02 01:39:21 user nova-compute[74996]:     <partition>/machine</partition>
Nov 02 01:39:21 user nova-compute[74996]:   </resource>
Nov 02 01:39:21 user nova-compute[74996]:   <sysinfo type='smbios'>
Nov 02 01:39:21 user nova-compute[74996]:     <system>
Nov 02 01:39:21 user nova-compute[74996]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 02 01:39:21 user nova-compute[74996]:       <entry name='product'>OpenStack Nova</entry>
Nov 02 01:39:21 user nova-compute[74996]:       <entry name='version'>0.0.0</entry>
Nov 02 01:39:21 user nova-compute[74996]:       <entry name='serial'>f44d0b13-9dae-40c9-83d0-0b84699b1cc2</entry>
Nov 02 01:39:21 user nova-compute[74996]:       <entry name='uuid'>f44d0b13-9dae-40c9-83d0-0b84699b1cc2</entry>
Nov 02 01:39:21 user nova-compute[74996]:       <entry name='family'>Virtual Machine</entry>
Nov 02 01:39:21 user nova-compute[74996]:     </system>
Nov 02 01:39:21 user nova-compute[74996]:   </sysinfo>
Nov 02 01:39:21 user nova-compute[74996]:   <os>
Nov 02 01:39:21 user nova-compute[74996]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 02 01:39:21 user nova-compute[74996]:     <boot dev='hd'/>
Nov 02 01:39:21 user nova-compute[74996]:     <smbios mode='sysinfo'/>
Nov 02 01:39:21 user nova-compute[74996]:   </os>
Nov 02 01:39:21 user nova-compute[74996]:   <features>
Nov 02 01:39:21 user nova-compute[74996]:     <acpi/>
Nov 02 01:39:21 user nova-compute[74996]:     <apic/>
Nov 02 01:39:21 user nova-compute[74996]:     <vmcoreinfo state='on'/>
Nov 02 01:39:21 user nova-compute[74996]:   </features>
Nov 02 01:39:21 user nova-compute[74996]:   <cpu mode='custom' match='exact' check='full'>
Nov 02 01:39:21 user nova-compute[74996]:     <model fallback='forbid'>Nehalem</model>
Nov 02 01:39:21 user nova-compute[74996]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 02 01:39:21 user nova-compute[74996]:     <feature policy='require' name='vme'/>
Nov 02 01:39:21 user nova-compute[74996]:     <feature policy='require' name='x2apic'/>
Nov 02 01:39:21 user nova-compute[74996]:     <feature policy='require' name='hypervisor'/>
Nov 02 01:39:21 user nova-compute[74996]:   </cpu>
Nov 02 01:39:21 user nova-compute[74996]:   <clock offset='utc'>
Nov 02 01:39:21 user nova-compute[74996]:     <timer name='pit' tickpolicy='delay'/>
Nov 02 01:39:21 user nova-compute[74996]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 02 01:39:21 user nova-compute[74996]:     <timer name='hpet' present='no'/>
Nov 02 01:39:21 user nova-compute[74996]:   </clock>
Nov 02 01:39:21 user nova-compute[74996]:   <on_poweroff>destroy</on_poweroff>
Nov 02 01:39:21 user nova-compute[74996]:   <on_reboot>restart</on_reboot>
Nov 02 01:39:21 user nova-compute[74996]:   <on_crash>destroy</on_crash>
Nov 02 01:39:21 user nova-compute[74996]:   <devices>
Nov 02 01:39:21 user nova-compute[74996]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 02 01:39:21 user nova-compute[74996]:     <disk type='file' device='disk'>
Nov 02 01:39:21 user nova-compute[74996]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 02 01:39:21 user nova-compute[74996]:       <source file='/opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk' index='2'/>
Nov 02 01:39:21 user nova-compute[74996]:       <backingStore type='file' index='3'>
Nov 02 01:39:21 user nova-compute[74996]:         <format type='raw'/>
Nov 02 01:39:21 user nova-compute[74996]:         <source file='/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8'/>
Nov 02 01:39:21 user nova-compute[74996]:         <backingStore/>
Nov 02 01:39:21 user nova-compute[74996]:       </backingStore>
Nov 02 01:39:21 user nova-compute[74996]:       <target dev='vda' bus='virtio'/>
Nov 02 01:39:21 user nova-compute[74996]:       <alias name='virtio-disk0'/>
Nov 02 01:39:21 user nova-compute[74996]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 02 01:39:21 user nova-compute[74996]:     </disk>
Nov 02 01:39:21 user nova-compute[74996]:     <disk type='file' device='cdrom'>
Nov 02 01:39:21 user nova-compute[74996]:       <driver name='qemu' type='raw' cache='none'/>
Nov 02 01:39:21 user nova-compute[74996]:       <source file='/opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk.config' index='1'/>
Nov 02 01:39:21 user nova-compute[74996]:       <backingStore/>
Nov 02 01:39:21 user nova-compute[74996]:       <target dev='hda' bus='ide'/>
Nov 02 01:39:21 user nova-compute[74996]:       <readonly/>
Nov 02 01:39:21 user nova-compute[74996]:       <alias name='ide0-0-0'/>
Nov 02 01:39:21 user nova-compute[74996]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 02 01:39:21 user nova-compute[74996]:     </disk>
Nov 02 01:39:21 user nova-compute[74996]:     <controller type='usb' index='0' model='none'>
Nov 02 01:39:21 user nova-compute[74996]:       <alias name='usb'/>
Nov 02 01:39:21 user nova-compute[74996]:     </controller>
Nov 02 01:39:21 user nova-compute[74996]:     <controller type='pci' index='0' model='pci-root'>
Nov 02 01:39:21 user nova-compute[74996]:       <alias name='pci.0'/>
Nov 02 01:39:21 user nova-compute[74996]:     </controller>
Nov 02 01:39:21 user nova-compute[74996]:     <controller type='ide' index='0'>
Nov 02 01:39:21 user nova-compute[74996]:       <alias name='ide'/>
Nov 02 01:39:21 user nova-compute[74996]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 02 01:39:21 user nova-compute[74996]:     </controller>
Nov 02 01:39:21 user nova-compute[74996]:     <interface type='ethernet'>
Nov 02 01:39:21 user nova-compute[74996]:       <mac address='fa:16:3e:e1:e1:a7'/>
Nov 02 01:39:21 user nova-compute[74996]:       <target dev='tapfbf546f3-96'/>
Nov 02 01:39:21 user nova-compute[74996]:       <model type='virtio'/>
Nov 02 01:39:21 user nova-compute[74996]:       <mtu size='1442'/>
Nov 02 01:39:21 user nova-compute[74996]:       <alias name='net0'/>
Nov 02 01:39:21 user nova-compute[74996]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 02 01:39:21 user nova-compute[74996]:     </interface>
Nov 02 01:39:21 user nova-compute[74996]:     <interface type='ethernet'>
Nov 02 01:39:21 user nova-compute[74996]:       <mac address='fa:16:3e:fd:76:d8'/>
Nov 02 01:39:21 user nova-compute[74996]:       <target dev='tapd1504136-cb'/>
Nov 02 01:39:21 user nova-compute[74996]:       <model type='virtio'/>
Nov 02 01:39:21 user nova-compute[74996]:       <mtu size='1442'/>
Nov 02 01:39:21 user nova-compute[74996]:       <alias name='net1'/>
Nov 02 01:39:21 user nova-compute[74996]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 02 01:39:21 user nova-compute[74996]:     </interface>
Nov 02 01:39:21 user nova-compute[74996]:     <serial type='pty'>
Nov 02 01:39:21 user nova-compute[74996]:       <source path='/dev/pts/8'/>
Nov 02 01:39:21 user nova-compute[74996]:       <log file='/opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/console.log' append='off'/>
Nov 02 01:39:21 user nova-compute[74996]:       <target type='isa-serial' port='0'>
Nov 02 01:39:21 user nova-compute[74996]:         <model name='isa-serial'/>
Nov 02 01:39:21 user nova-compute[74996]:       </target>
Nov 02 01:39:21 user nova-compute[74996]:       <alias name='serial0'/>
Nov 02 01:39:21 user nova-compute[74996]:     </serial>
Nov 02 01:39:21 user nova-compute[74996]:     <console type='pty' tty='/dev/pts/8'>
Nov 02 01:39:21 user nova-compute[74996]:       <source path='/dev/pts/8'/>
Nov 02 01:39:21 user nova-compute[74996]:       <log file='/opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/console.log' append='off'/>
Nov 02 01:39:21 user nova-compute[74996]:       <target type='serial' port='0'/>
Nov 02 01:39:21 user nova-compute[74996]:       <alias name='serial0'/>
Nov 02 01:39:21 user nova-compute[74996]:     </console>
Nov 02 01:39:21 user nova-compute[74996]:     <input type='mouse' bus='ps2'>
Nov 02 01:39:21 user nova-compute[74996]:       <alias name='input0'/>
Nov 02 01:39:21 user nova-compute[74996]:     </input>
Nov 02 01:39:21 user nova-compute[74996]:     <input type='keyboard' bus='ps2'>
Nov 02 01:39:21 user nova-compute[74996]:       <alias name='input1'/>
Nov 02 01:39:21 user nova-compute[74996]:     </input>
Nov 02 01:39:21 user nova-compute[74996]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 02 01:39:21 user nova-compute[74996]:       <listen type='address' address='0.0.0.0'/>
Nov 02 01:39:21 user nova-compute[74996]:     </graphics>
Nov 02 01:39:21 user nova-compute[74996]:     <audio id='1' type='none'/>
Nov 02 01:39:21 user nova-compute[74996]:     <video>
Nov 02 01:39:21 user nova-compute[74996]:       <model type='virtio' heads='1' primary='yes'/>
Nov 02 01:39:21 user nova-compute[74996]:       <alias name='video0'/>
Nov 02 01:39:21 user nova-compute[74996]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 02 01:39:21 user nova-compute[74996]:     </video>
Nov 02 01:39:21 user nova-compute[74996]:     <memballoon model='virtio'>
Nov 02 01:39:21 user nova-compute[74996]:       <stats period='10'/>
Nov 02 01:39:21 user nova-compute[74996]:       <alias name='balloon0'/>
Nov 02 01:39:21 user nova-compute[74996]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 02 01:39:21 user nova-compute[74996]:     </memballoon>
Nov 02 01:39:21 user nova-compute[74996]:     <rng model='virtio'>
Nov 02 01:39:21 user nova-compute[74996]:       <backend model='random'>/dev/urandom</backend>
Nov 02 01:39:21 user nova-compute[74996]:       <alias name='rng0'/>
Nov 02 01:39:21 user nova-compute[74996]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 02 01:39:21 user nova-compute[74996]:     </rng>
Nov 02 01:39:21 user nova-compute[74996]:   </devices>
Nov 02 01:39:21 user nova-compute[74996]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 02 01:39:21 user nova-compute[74996]:     <label>libvirt-f44d0b13-9dae-40c9-83d0-0b84699b1cc2</label>
Nov 02 01:39:21 user nova-compute[74996]:     <imagelabel>libvirt-f44d0b13-9dae-40c9-83d0-0b84699b1cc2</imagelabel>
Nov 02 01:39:21 user nova-compute[74996]:   </seclabel>
Nov 02 01:39:21 user nova-compute[74996]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 02 01:39:21 user nova-compute[74996]:     <label>+64055:+108</label>
Nov 02 01:39:21 user nova-compute[74996]:     <imagelabel>+64055:+108</imagelabel>
Nov 02 01:39:21 user nova-compute[74996]:   </seclabel>
Nov 02 01:39:21 user nova-compute[74996]: </domain>
Nov 02 01:39:21 user nova-compute[74996]:  {{(pid=74996) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 02 01:39:21 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Successfully detached device tapd1504136-cb from instance f44d0b13-9dae-40c9-83d0-0b84699b1cc2 from the persistent domain config.
Nov 02 01:39:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] (1/8): Attempting to detach device tapd1504136-cb with device alias net1 from instance f44d0b13-9dae-40c9-83d0-0b84699b1cc2 from the live domain config. {{(pid=74996) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 01:39:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] detach device xml: <interface type="ethernet">
Nov 02 01:39:21 user nova-compute[74996]:   <mac address="fa:16:3e:fd:76:d8"/>
Nov 02 01:39:21 user nova-compute[74996]:   <model type="virtio"/>
Nov 02 01:39:21 user nova-compute[74996]:   <mtu size="1442"/>
Nov 02 01:39:21 user nova-compute[74996]:   <target dev="tapd1504136-cb"/>
Nov 02 01:39:21 user nova-compute[74996]: </interface>
Nov 02 01:39:21 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:39:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:39:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CsmvrMgz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:39:21 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:39:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:39:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:39:21 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:39:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:39:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:39:21 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:39:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bb7710-4fbb-4114-aa32-5791a6cd910c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:39:21 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:39:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24a0bd3-3fbc-4794-a835-d4d00228f155]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1] added
Nov 02 01:39:22 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f903b6bf-3797-4165-ba75-98adfeb9f414]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.volume.cinder [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Update attachment failed for attachment a8b6eea5-34da-46fe-bc85-5146eddd913d. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-32504ec8-f7c1-411b-8f6c-e29ea8a808b8) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-32504ec8-f7c1-411b-8f6c-e29ea8a808b8)
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[77665a05-66ca-4920-a817-0557ab2bec76]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CsmvrMgz {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-32504ec8-f7c1-411b-8f6c-e29ea8a808b8)
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Traceback (most recent call last):
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]     driver_block_device.attach_block_devices(
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]     _log_and_attach(device)
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]     bdm.attach(*attach_args, **attach_kwargs)
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]     ret_val = method(obj, context, *args, **kwargs)
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]     self._do_attach(context, instance, volume, volume_api,
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]     self._volume_attach(context, volume, connector, instance,
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]     connection_info = volume_api.attachment_update(
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]     res = method(self, ctx, *args, **kwargs)
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]     with excutils.save_and_reraise_exception():
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]     self.force_reraise()
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]     raise self.value
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]     context, '3.44', skip_version_check=True).attachments.update(
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]     return method.func(obj, *args, **kwargs)
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]     resp = self._update('/attachments/%s' % id, body)
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]     return self._cs_request(url, 'PUT', **kwargs)
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]     return self.request(url, method, **kwargs)
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2]     raise exceptions.from_response(resp, body)
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-32504ec8-f7c1-411b-8f6c-e29ea8a808b8)
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] 
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.compute.claims [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Aborting claim: <nova.compute.claims.Claim object at 0x7f82e85f7670> {{(pid=74996) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CsmvrMgz" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4907b74a-dd81-4afe-91b3-6a107d89b223]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CsmvrMgz'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9627c0-9c9e-4c48-b786-acad07c2fa83]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07c2a84-f35f-4b0d-8255-ecb2d2048710]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:39:22 user nova-compute[74996]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:39:22 user nova-compute[74996]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 (non-flash)
Nov 02 01:39:22 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:39:22 user nova-compute[74996]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:39:22 user nova-compute[74996]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 (non-flash)
Nov 02 01:39:22 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ce2cff-02e9-4753-bcc9-b7342a09636b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1, portal: 172.16.0.220,3260]
Nov 02 01:39:22 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1, portal: 172.16.0.220,3260] successful.
Nov 02 01:39:22 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Start waiting for the detach event from libvirt for device tapd1504136-cb with device alias net1 for instance f44d0b13-9dae-40c9-83d0-0b84699b1cc2 {{(pid=74996) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f83109-2379-40b7-916f-7d06ff775c11]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d62f4e3-89c9-4b16-9a66-a772f63943e6]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:39:22 user nova-compute[74996]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:39:22 user nova-compute[74996]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 (non-flash)
Nov 02 01:39:22 user nova-compute[74996]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 (non-flash)
Nov 02 01:39:22 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:39:22 user nova-compute[74996]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:39:22 user nova-compute[74996]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 (non-flash)
Nov 02 01:39:22 user nova-compute[74996]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 (non-flash)
Nov 02 01:39:22 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.029s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d098c95-84db-4d29-a268-9c57a1b022db]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CsmvrMgz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.compute.manager [req-ad543542-791c-40b2-b769-9efd7bf32a9d req-f3e3289e-2ab4-4288-ba82-d1b884459821 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Received event network-vif-unplugged-d1504136-cb23-4cfd-981b-5f4a46f71bb1 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ad543542-791c-40b2-b769-9efd7bf32a9d req-f3e3289e-2ab4-4288-ba82-d1b884459821 service nova] Acquiring lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ad543542-791c-40b2-b769-9efd7bf32a9d req-f3e3289e-2ab4-4288-ba82-d1b884459821 service nova] Lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ad543542-791c-40b2-b769-9efd7bf32a9d req-f3e3289e-2ab4-4288-ba82-d1b884459821 service nova] Lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.compute.manager [req-ad543542-791c-40b2-b769-9efd7bf32a9d req-f3e3289e-2ab4-4288-ba82-d1b884459821 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] No waiting events found dispatching network-vif-unplugged-d1504136-cb23-4cfd-981b-5f4a46f71bb1 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:39:22 user nova-compute[74996]: WARNING nova.compute.manager [req-ad543542-791c-40b2-b769-9efd7bf32a9d req-f3e3289e-2ab4-4288-ba82-d1b884459821 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Received unexpected event network-vif-unplugged-d1504136-cb23-4cfd-981b-5f4a46f71bb1 for instance with vm_state active and task_state None.
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.549s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Build of instance 31da007b-1f16-4d01-8b1a-b41f60cd08f2 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-32504ec8-f7c1-411b-8f6c-e29ea8a808b8) {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.compute.utils [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Build of instance 31da007b-1f16-4d01-8b1a-b41f60cd08f2 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=74996) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 02 01:39:22 user nova-compute[74996]: ERROR nova.compute.manager [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Build of instance 31da007b-1f16-4d01-8b1a-b41f60cd08f2 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-32504ec8-f7c1-411b-8f6c-e29ea8a808b8): nova.exception.BuildAbortException: Build of instance 31da007b-1f16-4d01-8b1a-b41f60cd08f2 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-32504ec8-f7c1-411b-8f6c-e29ea8a808b8)
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Unplugging VIFs for instance {{(pid=74996) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:38:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1933798296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1933798296',id=21,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQGCeY1dXf3BiDyaPj6Hr6kisRGRuoBVzgTVbr8/V1FepopQbYtc4G15Xrtyg4vIumaZPaAcYz+/16q816utlhna62jY/emoT5vwhtbgRH8s6puDNrFxDOpFrpnVi8YbQ==',key_name='tempest-keypair-229889969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='064ef9744af64b01b7b5cac9615eb13f',ramdisk_id='',reservation_id='r-mjj70xln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1627608408',owner_user_name='tempest-TaggedBootDevicesTest_v242-1627608408-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:38:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49d9ec7a63074b45829c5733f9701ab6',uuid=31da007b-1f16-4d01-8b1a-b41f60cd08f2,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d837c1b5-c0e8-46bc-b31b-cd25ac7bf884", "address": "fa:16:3e:53:ec:35", "network": {"id": "db5aedf3-0932-451a-a663-f0d36982526f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1691884435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd837c1b5-c0", "ovs_interfaceid": "d837c1b5-c0e8-46bc-b31b-cd25ac7bf884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Converting VIF {"id": "d837c1b5-c0e8-46bc-b31b-cd25ac7bf884", "address": "fa:16:3e:53:ec:35", "network": {"id": "db5aedf3-0932-451a-a663-f0d36982526f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1691884435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd837c1b5-c0", "ovs_interfaceid": "d837c1b5-c0e8-46bc-b31b-cd25ac7bf884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:ec:35,bridge_name='br-int',has_traffic_filtering=True,id=d837c1b5-c0e8-46bc-b31b-cd25ac7bf884,network=Network(db5aedf3-0932-451a-a663-f0d36982526f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd837c1b5-c0') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG os_vif [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:ec:35,bridge_name='br-int',has_traffic_filtering=True,id=d837c1b5-c0e8-46bc-b31b-cd25ac7bf884,network=Network(db5aedf3-0932-451a-a663-f0d36982526f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd837c1b5-c0') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd837c1b5-c0, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:39:22 user nova-compute[74996]: INFO os_vif [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:ec:35,bridge_name='br-int',has_traffic_filtering=True,id=d837c1b5-c0e8-46bc-b31b-cd25ac7bf884,network=Network(db5aedf3-0932-451a-a663-f0d36982526f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd837c1b5-c0')
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:38:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1933798296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1933798296',id=21,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQGCeY1dXf3BiDyaPj6Hr6kisRGRuoBVzgTVbr8/V1FepopQbYtc4G15Xrtyg4vIumaZPaAcYz+/16q816utlhna62jY/emoT5vwhtbgRH8s6puDNrFxDOpFrpnVi8YbQ==',key_name='tempest-keypair-229889969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='064ef9744af64b01b7b5cac9615eb13f',ramdisk_id='',reservation_id='r-mjj70xln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1627608408',owner_user_name='tempest-TaggedBootDevicesTest_v242-1627608408-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:38:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49d9ec7a63074b45829c5733f9701ab6',uuid=31da007b-1f16-4d01-8b1a-b41f60cd08f2,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b3e28db-0c25-4f45-9d6b-5119a577ad29", "address": "fa:16:3e:70:dd:9c", "network": {"id": "6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302", "bridge": "br-int", "label": "tempest-device-tagging-net1-1985151211", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3e28db-0c", "ovs_interfaceid": "1b3e28db-0c25-4f45-9d6b-5119a577ad29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Converting VIF {"id": "1b3e28db-0c25-4f45-9d6b-5119a577ad29", "address": "fa:16:3e:70:dd:9c", "network": {"id": "6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302", "bridge": "br-int", "label": "tempest-device-tagging-net1-1985151211", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b3e28db-0c", "ovs_interfaceid": "1b3e28db-0c25-4f45-9d6b-5119a577ad29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:dd:9c,bridge_name='br-int',has_traffic_filtering=True,id=1b3e28db-0c25-4f45-9d6b-5119a577ad29,network=Network(6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1b3e28db-0c') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG os_vif [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:dd:9c,bridge_name='br-int',has_traffic_filtering=True,id=1b3e28db-0c25-4f45-9d6b-5119a577ad29,network=Network(6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1b3e28db-0c') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b3e28db-0c, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:39:22 user nova-compute[74996]: INFO os_vif [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:dd:9c,bridge_name='br-int',has_traffic_filtering=True,id=1b3e28db-0c25-4f45-9d6b-5119a577ad29,network=Network(6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1b3e28db-0c')
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:38:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1933798296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1933798296',id=21,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQGCeY1dXf3BiDyaPj6Hr6kisRGRuoBVzgTVbr8/V1FepopQbYtc4G15Xrtyg4vIumaZPaAcYz+/16q816utlhna62jY/emoT5vwhtbgRH8s6puDNrFxDOpFrpnVi8YbQ==',key_name='tempest-keypair-229889969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='064ef9744af64b01b7b5cac9615eb13f',ramdisk_id='',reservation_id='r-mjj70xln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1627608408',owner_user_name='tempest-TaggedBootDevicesTest_v242-1627608408-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:38:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49d9ec7a63074b45829c5733f9701ab6',uuid=31da007b-1f16-4d01-8b1a-b41f60cd08f2,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a245d2c-253d-473b-834c-83420dd6d91f", "address": "fa:16:3e:34:ab:62", "network": {"id": "6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302", "bridge": "br-int", "label": "tempest-device-tagging-net1-1985151211", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a245d2c-25", "ovs_interfaceid": "5a245d2c-253d-473b-834c-83420dd6d91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Converting VIF {"id": "5a245d2c-253d-473b-834c-83420dd6d91f", "address": "fa:16:3e:34:ab:62", "network": {"id": "6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302", "bridge": "br-int", "label": "tempest-device-tagging-net1-1985151211", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a245d2c-25", "ovs_interfaceid": "5a245d2c-253d-473b-834c-83420dd6d91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:ab:62,bridge_name='br-int',has_traffic_filtering=True,id=5a245d2c-253d-473b-834c-83420dd6d91f,network=Network(6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5a245d2c-25') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG os_vif [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:ab:62,bridge_name='br-int',has_traffic_filtering=True,id=5a245d2c-253d-473b-834c-83420dd6d91f,network=Network(6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5a245d2c-25') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a245d2c-25, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:39:22 user nova-compute[74996]: INFO os_vif [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:ab:62,bridge_name='br-int',has_traffic_filtering=True,id=5a245d2c-253d-473b-834c-83420dd6d91f,network=Network(6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5a245d2c-25')
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:38:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1933798296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1933798296',id=21,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQGCeY1dXf3BiDyaPj6Hr6kisRGRuoBVzgTVbr8/V1FepopQbYtc4G15Xrtyg4vIumaZPaAcYz+/16q816utlhna62jY/emoT5vwhtbgRH8s6puDNrFxDOpFrpnVi8YbQ==',key_name='tempest-keypair-229889969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='064ef9744af64b01b7b5cac9615eb13f',ramdisk_id='',reservation_id='r-mjj70xln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1627608408',owner_user_name='tempest-TaggedBootDevicesTest_v242-1627608408-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:38:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49d9ec7a63074b45829c5733f9701ab6',uuid=31da007b-1f16-4d01-8b1a-b41f60cd08f2,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "004e2b4b-86f0-4b1f-861a-db8f99a272ab", "address": "fa:16:3e:4c:86:0b", "network": {"id": "6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302", "bridge": "br-int", "label": "tempest-device-tagging-net1-1985151211", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004e2b4b-86", "ovs_interfaceid": "004e2b4b-86f0-4b1f-861a-db8f99a272ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Converting VIF {"id": "004e2b4b-86f0-4b1f-861a-db8f99a272ab", "address": "fa:16:3e:4c:86:0b", "network": {"id": "6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302", "bridge": "br-int", "label": "tempest-device-tagging-net1-1985151211", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004e2b4b-86", "ovs_interfaceid": "004e2b4b-86f0-4b1f-861a-db8f99a272ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:86:0b,bridge_name='br-int',has_traffic_filtering=True,id=004e2b4b-86f0-4b1f-861a-db8f99a272ab,network=Network(6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004e2b4b-86') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG os_vif [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:86:0b,bridge_name='br-int',has_traffic_filtering=True,id=004e2b4b-86f0-4b1f-861a-db8f99a272ab,network=Network(6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004e2b4b-86') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap004e2b4b-86, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:39:22 user nova-compute[74996]: INFO os_vif [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:86:0b,bridge_name='br-int',has_traffic_filtering=True,id=004e2b4b-86f0-4b1f-861a-db8f99a272ab,network=Network(6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004e2b4b-86')
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:38:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1933798296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1933798296',id=21,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQGCeY1dXf3BiDyaPj6Hr6kisRGRuoBVzgTVbr8/V1FepopQbYtc4G15Xrtyg4vIumaZPaAcYz+/16q816utlhna62jY/emoT5vwhtbgRH8s6puDNrFxDOpFrpnVi8YbQ==',key_name='tempest-keypair-229889969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='064ef9744af64b01b7b5cac9615eb13f',ramdisk_id='',reservation_id='r-mjj70xln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1627608408',owner_user_name='tempest-TaggedBootDevicesTest_v242-1627608408-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:38:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49d9ec7a63074b45829c5733f9701ab6',uuid=31da007b-1f16-4d01-8b1a-b41f60cd08f2,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efb2f61a-fe66-48e0-a067-35d06f375412", "address": "fa:16:3e:0f:88:f1", "network": {"id": "6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302", "bridge": "br-int", "label": "tempest-device-tagging-net1-1985151211", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb2f61a-fe", "ovs_interfaceid": "efb2f61a-fe66-48e0-a067-35d06f375412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Converting VIF {"id": "efb2f61a-fe66-48e0-a067-35d06f375412", "address": "fa:16:3e:0f:88:f1", "network": {"id": "6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302", "bridge": "br-int", "label": "tempest-device-tagging-net1-1985151211", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb2f61a-fe", "ovs_interfaceid": "efb2f61a-fe66-48e0-a067-35d06f375412", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:88:f1,bridge_name='br-int',has_traffic_filtering=True,id=efb2f61a-fe66-48e0-a067-35d06f375412,network=Network(6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefb2f61a-fe') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG os_vif [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:88:f1,bridge_name='br-int',has_traffic_filtering=True,id=efb2f61a-fe66-48e0-a067-35d06f375412,network=Network(6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefb2f61a-fe') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapefb2f61a-fe, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:39:22 user nova-compute[74996]: INFO os_vif [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:88:f1,bridge_name='br-int',has_traffic_filtering=True,id=efb2f61a-fe66-48e0-a067-35d06f375412,network=Network(6ebfa2ff-6b0a-45f1-9d53-430a5a4d8302),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefb2f61a-fe')
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:38:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1933798296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1933798296',id=21,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQGCeY1dXf3BiDyaPj6Hr6kisRGRuoBVzgTVbr8/V1FepopQbYtc4G15Xrtyg4vIumaZPaAcYz+/16q816utlhna62jY/emoT5vwhtbgRH8s6puDNrFxDOpFrpnVi8YbQ==',key_name='tempest-keypair-229889969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='064ef9744af64b01b7b5cac9615eb13f',ramdisk_id='',reservation_id='r-mjj70xln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1627608408',owner_user_name='tempest-TaggedBootDevicesTest_v242-1627608408-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:38:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49d9ec7a63074b45829c5733f9701ab6',uuid=31da007b-1f16-4d01-8b1a-b41f60cd08f2,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0a9d6f7-f2c1-41b7-9e90-04df4f23f8c3", "address": "fa:16:3e:38:45:14", "network": {"id": "fd8151b8-a1ff-40ab-9118-7e6042226042", "bridge": "br-int", "label": "tempest-device-tagging-net2-1306882922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a9d6f7-f2", "ovs_interfaceid": "b0a9d6f7-f2c1-41b7-9e90-04df4f23f8c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Converting VIF {"id": "b0a9d6f7-f2c1-41b7-9e90-04df4f23f8c3", "address": "fa:16:3e:38:45:14", "network": {"id": "fd8151b8-a1ff-40ab-9118-7e6042226042", "bridge": "br-int", "label": "tempest-device-tagging-net2-1306882922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a9d6f7-f2", "ovs_interfaceid": "b0a9d6f7-f2c1-41b7-9e90-04df4f23f8c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:45:14,bridge_name='br-int',has_traffic_filtering=True,id=b0a9d6f7-f2c1-41b7-9e90-04df4f23f8c3,network=Network(fd8151b8-a1ff-40ab-9118-7e6042226042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0a9d6f7-f2') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG os_vif [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:45:14,bridge_name='br-int',has_traffic_filtering=True,id=b0a9d6f7-f2c1-41b7-9e90-04df4f23f8c3,network=Network(fd8151b8-a1ff-40ab-9118-7e6042226042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0a9d6f7-f2') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0a9d6f7-f2, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:39:22 user nova-compute[74996]: INFO os_vif [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:45:14,bridge_name='br-int',has_traffic_filtering=True,id=b0a9d6f7-f2c1-41b7-9e90-04df4f23f8c3,network=Network(fd8151b8-a1ff-40ab-9118-7e6042226042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0a9d6f7-f2')
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:38:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1933798296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1933798296',id=21,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQGCeY1dXf3BiDyaPj6Hr6kisRGRuoBVzgTVbr8/V1FepopQbYtc4G15Xrtyg4vIumaZPaAcYz+/16q816utlhna62jY/emoT5vwhtbgRH8s6puDNrFxDOpFrpnVi8YbQ==',key_name='tempest-keypair-229889969',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='064ef9744af64b01b7b5cac9615eb13f',ramdisk_id='',reservation_id='r-mjj70xln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1627608408',owner_user_name='tempest-TaggedBootDevicesTest_v242-1627608408-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:38:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49d9ec7a63074b45829c5733f9701ab6',uuid=31da007b-1f16-4d01-8b1a-b41f60cd08f2,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5d41e0b-52ab-46ba-8783-9f88087cecf8", "address": "fa:16:3e:8c:33:88", "network": {"id": "fd8151b8-a1ff-40ab-9118-7e6042226042", "bridge": "br-int", "label": "tempest-device-tagging-net2-1306882922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d41e0b-52", "ovs_interfaceid": "b5d41e0b-52ab-46ba-8783-9f88087cecf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Converting VIF {"id": "b5d41e0b-52ab-46ba-8783-9f88087cecf8", "address": "fa:16:3e:8c:33:88", "network": {"id": "fd8151b8-a1ff-40ab-9118-7e6042226042", "bridge": "br-int", "label": "tempest-device-tagging-net2-1306882922", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "064ef9744af64b01b7b5cac9615eb13f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d41e0b-52", "ovs_interfaceid": "b5d41e0b-52ab-46ba-8783-9f88087cecf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:33:88,bridge_name='br-int',has_traffic_filtering=True,id=b5d41e0b-52ab-46ba-8783-9f88087cecf8,network=Network(fd8151b8-a1ff-40ab-9118-7e6042226042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5d41e0b-52') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG os_vif [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:33:88,bridge_name='br-int',has_traffic_filtering=True,id=b5d41e0b-52ab-46ba-8783-9f88087cecf8,network=Network(fd8151b8-a1ff-40ab-9118-7e6042226042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5d41e0b-52') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5d41e0b-52, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:39:22 user nova-compute[74996]: INFO os_vif [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:33:88,bridge_name='br-int',has_traffic_filtering=True,id=b5d41e0b-52ab-46ba-8783-9f88087cecf8,network=Network(fd8151b8-a1ff-40ab-9118-7e6042226042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5d41e0b-52')
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Unplugged VIFs for instance {{(pid=74996) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:39:22 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:39:23 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.435s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:39:23 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] <== connect_volume: return (1436ms) {'type': 'block', 'scsi_wwn': '23130303838303338', 'path': '/dev/sdd'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:39:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130303838303338', 'path': '/dev/sdd'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:39:23 user nova-compute[74996]: DEBUG nova.objects.instance [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lazy-loading 'flavor' on Instance uuid da10dadd-b04a-4f3b-92bd-fcaa18b51fce {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:39:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 01:39:23 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:39:23 user nova-compute[74996]:   <source dev="/dev/sdd"/>
Nov 02 01:39:23 user nova-compute[74996]:   <target dev="vdc" bus="virtio"/>
Nov 02 01:39:23 user nova-compute[74996]:   <serial>bce4c077-5447-4ee3-ae7b-e55ce97cd3c1</serial>
Nov 02 01:39:23 user nova-compute[74996]: </disk>
Nov 02 01:39:23 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 01:39:24 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:39:24 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:39:24 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:39:24 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] No VIF found with MAC fa:16:3e:f8:1e:be, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:39:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ad8add77-32ef-47ca-ab45-652b8ff95563 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.567s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:39:24 user nova-compute[74996]: DEBUG nova.compute.manager [req-a9a0e3fa-6642-4e3f-9b21-2abf3c541bdd req-a126df6e-ad98-4b97-99c6-f81e581dce16 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Received event network-vif-plugged-d1504136-cb23-4cfd-981b-5f4a46f71bb1 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:39:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a9a0e3fa-6642-4e3f-9b21-2abf3c541bdd req-a126df6e-ad98-4b97-99c6-f81e581dce16 service nova] Acquiring lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:39:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a9a0e3fa-6642-4e3f-9b21-2abf3c541bdd req-a126df6e-ad98-4b97-99c6-f81e581dce16 service nova] Lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:39:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a9a0e3fa-6642-4e3f-9b21-2abf3c541bdd req-a126df6e-ad98-4b97-99c6-f81e581dce16 service nova] Lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:39:24 user nova-compute[74996]: DEBUG nova.compute.manager [req-a9a0e3fa-6642-4e3f-9b21-2abf3c541bdd req-a126df6e-ad98-4b97-99c6-f81e581dce16 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] No waiting events found dispatching network-vif-plugged-d1504136-cb23-4cfd-981b-5f4a46f71bb1 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:39:24 user nova-compute[74996]: WARNING nova.compute.manager [req-a9a0e3fa-6642-4e3f-9b21-2abf3c541bdd req-a126df6e-ad98-4b97-99c6-f81e581dce16 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Received unexpected event network-vif-plugged-d1504136-cb23-4cfd-981b-5f4a46f71bb1 for instance with vm_state active and task_state None.
Nov 02 01:39:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Acquiring lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:39:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:39:25 user nova-compute[74996]: INFO nova.compute.manager [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Detaching volume bce4c077-5447-4ee3-ae7b-e55ce97cd3c1
Nov 02 01:39:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:25 user nova-compute[74996]: INFO nova.virt.block_device [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Attempting to driver detach volume bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 from mountpoint /dev/vdc
Nov 02 01:39:25 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Attempting to detach device vdc from instance da10dadd-b04a-4f3b-92bd-fcaa18b51fce from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 01:39:25 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 01:39:25 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:39:25 user nova-compute[74996]:   <source dev="/dev/sdd"/>
Nov 02 01:39:25 user nova-compute[74996]:   <target dev="vdc" bus="virtio"/>
Nov 02 01:39:25 user nova-compute[74996]:   <serial>bce4c077-5447-4ee3-ae7b-e55ce97cd3c1</serial>
Nov 02 01:39:25 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 02 01:39:25 user nova-compute[74996]: </disk>
Nov 02 01:39:25 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:39:25 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Successfully detached device vdc from instance da10dadd-b04a-4f3b-92bd-fcaa18b51fce from the persistent domain config.
Nov 02 01:39:25 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance da10dadd-b04a-4f3b-92bd-fcaa18b51fce from the live domain config. {{(pid=74996) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 01:39:25 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 01:39:25 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:39:25 user nova-compute[74996]:   <source dev="/dev/sdd"/>
Nov 02 01:39:25 user nova-compute[74996]:   <target dev="vdc" bus="virtio"/>
Nov 02 01:39:25 user nova-compute[74996]:   <serial>bce4c077-5447-4ee3-ae7b-e55ce97cd3c1</serial>
Nov 02 01:39:25 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 02 01:39:25 user nova-compute[74996]: </disk>
Nov 02 01:39:25 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:39:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance da10dadd-b04a-4f3b-92bd-fcaa18b51fce {{(pid=74996) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 01:39:27 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:39:27 user nova-compute[74996]: INFO nova.compute.manager [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Took 4.30 seconds to deallocate network for instance.
Nov 02 01:39:27 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Detaching volume: feadcde3-d4d2-40b6-808a-c8973b54f3ce {{(pid=74996) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 02 01:39:27 user nova-compute[74996]: INFO nova.compute.manager [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Detaching volume feadcde3-d4d2-40b6-808a-c8973b54f3ce
Nov 02 01:39:27 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Skipping driver_detach during remote rebuild. {{(pid=74996) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 02 01:39:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "6b79aa2f-02c7-492e-b27e-7481e41f8d2c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:39:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "6b79aa2f-02c7-492e-b27e-7481e41f8d2c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:39:28 user nova-compute[74996]: INFO nova.compute.manager [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Detaching volume cd193bfc-2f88-478c-b7f3-e67be6cfe3b8
Nov 02 01:39:28 user nova-compute[74996]: INFO nova.virt.block_device [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Attempting to driver detach volume cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 from mountpoint /dev/vdb
Nov 02 01:39:28 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Attempting to detach device vdb from instance 6b79aa2f-02c7-492e-b27e-7481e41f8d2c from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 01:39:28 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 01:39:28 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:39:28 user nova-compute[74996]:   <source dev="/dev/sdh"/>
Nov 02 01:39:28 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:39:28 user nova-compute[74996]:   <serial>cd193bfc-2f88-478c-b7f3-e67be6cfe3b8</serial>
Nov 02 01:39:28 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 01:39:28 user nova-compute[74996]: </disk>
Nov 02 01:39:28 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:39:28 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Successfully detached device vdb from instance 6b79aa2f-02c7-492e-b27e-7481e41f8d2c from the persistent domain config.
Nov 02 01:39:28 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6b79aa2f-02c7-492e-b27e-7481e41f8d2c from the live domain config. {{(pid=74996) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 01:39:28 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 01:39:28 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:39:28 user nova-compute[74996]:   <source dev="/dev/sdh"/>
Nov 02 01:39:28 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:39:28 user nova-compute[74996]:   <serial>cd193bfc-2f88-478c-b7f3-e67be6cfe3b8</serial>
Nov 02 01:39:28 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 01:39:28 user nova-compute[74996]: </disk>
Nov 02 01:39:28 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:39:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6b79aa2f-02c7-492e-b27e-7481e41f8d2c {{(pid=74996) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 01:39:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:33 user nova-compute[74996]: WARNING nova.compute.manager [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Failed to detach volume: feadcde3-d4d2-40b6-808a-c8973b54f3ce due to 'NoneType' object has no attribute 'devices'
Nov 02 01:39:33 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Detaching volume: 1cf83048-4745-486f-b222-0a84a9e81cb6 {{(pid=74996) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 02 01:39:33 user nova-compute[74996]: INFO nova.compute.manager [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Detaching volume 1cf83048-4745-486f-b222-0a84a9e81cb6
Nov 02 01:39:33 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Skipping driver_detach during remote rebuild. {{(pid=74996) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 02 01:39:33 user nova-compute[74996]: WARNING nova.compute.manager [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Failed to detach volume: 1cf83048-4745-486f-b222-0a84a9e81cb6 due to 'NoneType' object has no attribute 'devices'
Nov 02 01:39:33 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Detaching volume: 8eabf891-92ed-4ea2-8212-2f010c63ccd1 {{(pid=74996) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 02 01:39:33 user nova-compute[74996]: INFO nova.compute.manager [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Detaching volume 8eabf891-92ed-4ea2-8212-2f010c63ccd1
Nov 02 01:39:33 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] [instance: 31da007b-1f16-4d01-8b1a-b41f60cd08f2] Skipping driver_detach during remote rebuild. {{(pid=74996) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 02 01:39:34 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Deleted allocations for instance 31da007b-1f16-4d01-8b1a-b41f60cd08f2
Nov 02 01:39:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ceee70ae-1c14-4aba-aa57-62f00c20acae tempest-TaggedBootDevicesTest_v242-1627608408 tempest-TaggedBootDevicesTest_v242-1627608408-project-member] Lock "31da007b-1f16-4d01-8b1a-b41f60cd08f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 55.769s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:39:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:39:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 01:39:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:39:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:39:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:39:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 01:39:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:39:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:39:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:42 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Waiting for libvirt event about the detach of device tapd1504136-cb with device alias net1 from instance f44d0b13-9dae-40c9-83d0-0b84699b1cc2 is timed out.
Nov 02 01:39:42 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fd:76:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tapd1504136-cb"/></interface> {{(pid=74996) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fd:76:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tapd1504136-cb"/></interface>not found in domain: <domain type='kvm' id='16'>
Nov 02 01:39:42 user nova-compute[74996]:   <name>instance-00000011</name>
Nov 02 01:39:42 user nova-compute[74996]:   <uuid>f44d0b13-9dae-40c9-83d0-0b84699b1cc2</uuid>
Nov 02 01:39:42 user nova-compute[74996]:   <metadata>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:39:42 user nova-compute[74996]:   <nova:package version="0.0.0"/>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:name>tempest-device-tagging-server-2111239639</nova:name>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:creationTime>2023-11-02 01:37:21</nova:creationTime>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:flavor name="m1.tiny">
Nov 02 01:39:42 user nova-compute[74996]:     <nova:memory>512</nova:memory>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:disk>1</nova:disk>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:swap>0</nova:swap>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:vcpus>1</nova:vcpus>
Nov 02 01:39:42 user nova-compute[74996]:   </nova:flavor>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:owner>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:user uuid="1bb72dff3f614017b0ddc032ac15cd7b">tempest-TaggedAttachmentsTest-722286534-project-member</nova:user>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:project uuid="7981230c517e493883bb048b1cfa7907">tempest-TaggedAttachmentsTest-722286534</nova:project>
Nov 02 01:39:42 user nova-compute[74996]:   </nova:owner>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:ports>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:port uuid="fbf546f3-964c-4816-84c1-20d11b5ed544">
Nov 02 01:39:42 user nova-compute[74996]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 01:39:42 user nova-compute[74996]:     </nova:port>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:port uuid="d1504136-cb23-4cfd-981b-5f4a46f71bb1">
Nov 02 01:39:42 user nova-compute[74996]:       <nova:ip type="fixed" address="10.10.10.180" ipVersion="4"/>
Nov 02 01:39:42 user nova-compute[74996]:     </nova:port>
Nov 02 01:39:42 user nova-compute[74996]:   </nova:ports>
Nov 02 01:39:42 user nova-compute[74996]: </nova:instance>
Nov 02 01:39:42 user nova-compute[74996]:   </metadata>
Nov 02 01:39:42 user nova-compute[74996]:   <memory unit='KiB'>524288</memory>
Nov 02 01:39:42 user nova-compute[74996]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 02 01:39:42 user nova-compute[74996]:   <vcpu placement='static'>1</vcpu>
Nov 02 01:39:42 user nova-compute[74996]:   <resource>
Nov 02 01:39:42 user nova-compute[74996]:     <partition>/machine</partition>
Nov 02 01:39:42 user nova-compute[74996]:   </resource>
Nov 02 01:39:42 user nova-compute[74996]:   <sysinfo type='smbios'>
Nov 02 01:39:42 user nova-compute[74996]:     <system>
Nov 02 01:39:42 user nova-compute[74996]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 02 01:39:42 user nova-compute[74996]:       <entry name='product'>OpenStack Nova</entry>
Nov 02 01:39:42 user nova-compute[74996]:       <entry name='version'>0.0.0</entry>
Nov 02 01:39:42 user nova-compute[74996]:       <entry name='serial'>f44d0b13-9dae-40c9-83d0-0b84699b1cc2</entry>
Nov 02 01:39:42 user nova-compute[74996]:       <entry name='uuid'>f44d0b13-9dae-40c9-83d0-0b84699b1cc2</entry>
Nov 02 01:39:42 user nova-compute[74996]:       <entry name='family'>Virtual Machine</entry>
Nov 02 01:39:42 user nova-compute[74996]:     </system>
Nov 02 01:39:42 user nova-compute[74996]:   </sysinfo>
Nov 02 01:39:42 user nova-compute[74996]:   <os>
Nov 02 01:39:42 user nova-compute[74996]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 02 01:39:42 user nova-compute[74996]:     <boot dev='hd'/>
Nov 02 01:39:42 user nova-compute[74996]:     <smbios mode='sysinfo'/>
Nov 02 01:39:42 user nova-compute[74996]:   </os>
Nov 02 01:39:42 user nova-compute[74996]:   <features>
Nov 02 01:39:42 user nova-compute[74996]:     <acpi/>
Nov 02 01:39:42 user nova-compute[74996]:     <apic/>
Nov 02 01:39:42 user nova-compute[74996]:     <vmcoreinfo state='on'/>
Nov 02 01:39:42 user nova-compute[74996]:   </features>
Nov 02 01:39:42 user nova-compute[74996]:   <cpu mode='custom' match='exact' check='full'>
Nov 02 01:39:42 user nova-compute[74996]:     <model fallback='forbid'>Nehalem</model>
Nov 02 01:39:42 user nova-compute[74996]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 02 01:39:42 user nova-compute[74996]:     <feature policy='require' name='vme'/>
Nov 02 01:39:42 user nova-compute[74996]:     <feature policy='require' name='x2apic'/>
Nov 02 01:39:42 user nova-compute[74996]:     <feature policy='require' name='hypervisor'/>
Nov 02 01:39:42 user nova-compute[74996]:   </cpu>
Nov 02 01:39:42 user nova-compute[74996]:   <clock offset='utc'>
Nov 02 01:39:42 user nova-compute[74996]:     <timer name='pit' tickpolicy='delay'/>
Nov 02 01:39:42 user nova-compute[74996]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 02 01:39:42 user nova-compute[74996]:     <timer name='hpet' present='no'/>
Nov 02 01:39:42 user nova-compute[74996]:   </clock>
Nov 02 01:39:42 user nova-compute[74996]:   <on_poweroff>destroy</on_poweroff>
Nov 02 01:39:42 user nova-compute[74996]:   <on_reboot>restart</on_reboot>
Nov 02 01:39:42 user nova-compute[74996]:   <on_crash>destroy</on_crash>
Nov 02 01:39:42 user nova-compute[74996]:   <devices>
Nov 02 01:39:42 user nova-compute[74996]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 02 01:39:42 user nova-compute[74996]:     <disk type='file' device='disk'>
Nov 02 01:39:42 user nova-compute[74996]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 02 01:39:42 user nova-compute[74996]:       <source file='/opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk' index='2'/>
Nov 02 01:39:42 user nova-compute[74996]:       <backingStore type='file' index='3'>
Nov 02 01:39:42 user nova-compute[74996]:         <format type='raw'/>
Nov 02 01:39:42 user nova-compute[74996]:         <source file='/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8'/>
Nov 02 01:39:42 user nova-compute[74996]:         <backingStore/>
Nov 02 01:39:42 user nova-compute[74996]:       </backingStore>
Nov 02 01:39:42 user nova-compute[74996]:       <target dev='vda' bus='virtio'/>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='virtio-disk0'/>
Nov 02 01:39:42 user nova-compute[74996]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </disk>
Nov 02 01:39:42 user nova-compute[74996]:     <disk type='file' device='cdrom'>
Nov 02 01:39:42 user nova-compute[74996]:       <driver name='qemu' type='raw' cache='none'/>
Nov 02 01:39:42 user nova-compute[74996]:       <source file='/opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk.config' index='1'/>
Nov 02 01:39:42 user nova-compute[74996]:       <backingStore/>
Nov 02 01:39:42 user nova-compute[74996]:       <target dev='hda' bus='ide'/>
Nov 02 01:39:42 user nova-compute[74996]:       <readonly/>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='ide0-0-0'/>
Nov 02 01:39:42 user nova-compute[74996]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </disk>
Nov 02 01:39:42 user nova-compute[74996]:     <controller type='usb' index='0' model='none'>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='usb'/>
Nov 02 01:39:42 user nova-compute[74996]:     </controller>
Nov 02 01:39:42 user nova-compute[74996]:     <controller type='pci' index='0' model='pci-root'>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='pci.0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </controller>
Nov 02 01:39:42 user nova-compute[74996]:     <controller type='ide' index='0'>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='ide'/>
Nov 02 01:39:42 user nova-compute[74996]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 02 01:39:42 user nova-compute[74996]:     </controller>
Nov 02 01:39:42 user nova-compute[74996]:     <interface type='ethernet'>
Nov 02 01:39:42 user nova-compute[74996]:       <mac address='fa:16:3e:e1:e1:a7'/>
Nov 02 01:39:42 user nova-compute[74996]:       <target dev='tapfbf546f3-96'/>
Nov 02 01:39:42 user nova-compute[74996]:       <model type='virtio'/>
Nov 02 01:39:42 user nova-compute[74996]:       <mtu size='1442'/>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='net0'/>
Nov 02 01:39:42 user nova-compute[74996]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </interface>
Nov 02 01:39:42 user nova-compute[74996]:     <serial type='pty'>
Nov 02 01:39:42 user nova-compute[74996]:       <source path='/dev/pts/8'/>
Nov 02 01:39:42 user nova-compute[74996]:       <log file='/opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/console.log' append='off'/>
Nov 02 01:39:42 user nova-compute[74996]:       <target type='isa-serial' port='0'>
Nov 02 01:39:42 user nova-compute[74996]:         <model name='isa-serial'/>
Nov 02 01:39:42 user nova-compute[74996]:       </target>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='serial0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </serial>
Nov 02 01:39:42 user nova-compute[74996]:     <console type='pty' tty='/dev/pts/8'>
Nov 02 01:39:42 user nova-compute[74996]:       <source path='/dev/pts/8'/>
Nov 02 01:39:42 user nova-compute[74996]:       <log file='/opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/console.log' append='off'/>
Nov 02 01:39:42 user nova-compute[74996]:       <target type='serial' port='0'/>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='serial0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </console>
Nov 02 01:39:42 user nova-compute[74996]:     <input type='mouse' bus='ps2'>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='input0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </input>
Nov 02 01:39:42 user nova-compute[74996]:     <input type='keyboard' bus='ps2'>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='input1'/>
Nov 02 01:39:42 user nova-compute[74996]:     </input>
Nov 02 01:39:42 user nova-compute[74996]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 02 01:39:42 user nova-compute[74996]:       <listen type='address' address='0.0.0.0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </graphics>
Nov 02 01:39:42 user nova-compute[74996]:     <audio id='1' type='none'/>
Nov 02 01:39:42 user nova-compute[74996]:     <video>
Nov 02 01:39:42 user nova-compute[74996]:       <model type='virtio' heads='1' primary='yes'/>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='video0'/>
Nov 02 01:39:42 user nova-compute[74996]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </video>
Nov 02 01:39:42 user nova-compute[74996]:     <memballoon model='virtio'>
Nov 02 01:39:42 user nova-compute[74996]:       <stats period='10'/>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='balloon0'/>
Nov 02 01:39:42 user nova-compute[74996]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </memballoon>
Nov 02 01:39:42 user nova-compute[74996]:     <rng model='virtio'>
Nov 02 01:39:42 user nova-compute[74996]:       <backend model='random'>/dev/urandom</backend>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='rng0'/>
Nov 02 01:39:42 user nova-compute[74996]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </rng>
Nov 02 01:39:42 user nova-compute[74996]:   </devices>
Nov 02 01:39:42 user nova-compute[74996]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 02 01:39:42 user nova-compute[74996]:     <label>libvirt-f44d0b13-9dae-40c9-83d0-0b84699b1cc2</label>
Nov 02 01:39:42 user nova-compute[74996]:     <imagelabel>libvirt-f44d0b13-9dae-40c9-83d0-0b84699b1cc2</imagelabel>
Nov 02 01:39:42 user nova-compute[74996]:   </seclabel>
Nov 02 01:39:42 user nova-compute[74996]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 02 01:39:42 user nova-compute[74996]:     <label>+64055:+108</label>
Nov 02 01:39:42 user nova-compute[74996]:     <imagelabel>+64055:+108</imagelabel>
Nov 02 01:39:42 user nova-compute[74996]:   </seclabel>
Nov 02 01:39:42 user nova-compute[74996]: </domain>
Nov 02 01:39:42 user nova-compute[74996]:  {{(pid=74996) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 02 01:39:42 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Successfully detached device tapd1504136-cb from instance f44d0b13-9dae-40c9-83d0-0b84699b1cc2 from the live domain config.
Nov 02 01:39:42 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111239639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111239639',id=17,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLtwBp/DvHskyQXeHr37ezG4yqg/zTU4wDpo1xGzexMimgVBKyE7nsHF9zbcCIyqHw1sf3kCFQioLSlFRREV/mNyOI03M7/LCcKSZAW08/rLH78veAeoRHPxfQDNyUQqA==',key_name='tempest-keypair-876877355',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:35:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7981230c517e493883bb048b1cfa7907',ramdisk_id='',reservation_id='r-ccrouw9n',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-722286534',owner_user_name='tempest-TaggedAttachmentsTest-722286534-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:35:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bb72dff3f614017b0ddc032ac15cd7b',uuid=f44d0b13-9dae-40c9-83d0-0b84699b1cc2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1504136-cb23-4cfd-981b-5f4a46f71bb1", "address": "fa:16:3e:fd:76:d8", "network": {"id": "d7c8d7c4-4b9d-4903-bdaf-c3db1f11a6dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1241834085", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7981230c517e493883bb048b1cfa7907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1504136-cb", "ovs_interfaceid": "d1504136-cb23-4cfd-981b-5f4a46f71bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Converting VIF {"id": "d1504136-cb23-4cfd-981b-5f4a46f71bb1", "address": "fa:16:3e:fd:76:d8", "network": {"id": "d7c8d7c4-4b9d-4903-bdaf-c3db1f11a6dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1241834085", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7981230c517e493883bb048b1cfa7907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1504136-cb", "ovs_interfaceid": "d1504136-cb23-4cfd-981b-5f4a46f71bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:76:d8,bridge_name='br-int',has_traffic_filtering=True,id=d1504136-cb23-4cfd-981b-5f4a46f71bb1,network=Network(d7c8d7c4-4b9d-4903-bdaf-c3db1f11a6dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1504136-cb') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG os_vif [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:76:d8,bridge_name='br-int',has_traffic_filtering=True,id=d1504136-cb23-4cfd-981b-5f4a46f71bb1,network=Network(d7c8d7c4-4b9d-4903-bdaf-c3db1f11a6dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1504136-cb') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1504136-cb, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=601f66fc-2ab8-4373-9897-2f83cba52d15) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:39:42 user nova-compute[74996]: INFO os_vif [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:76:d8,bridge_name='br-int',has_traffic_filtering=True,id=d1504136-cb23-4cfd-981b-5f4a46f71bb1,network=Network(d7c8d7c4-4b9d-4903-bdaf-c3db1f11a6dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1504136-cb')
Nov 02 01:39:42 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:39:42 user nova-compute[74996]:   <nova:package version="0.0.0"/>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:name>tempest-device-tagging-server-2111239639</nova:name>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:creationTime>2023-11-02 01:39:42</nova:creationTime>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:flavor name="m1.tiny">
Nov 02 01:39:42 user nova-compute[74996]:     <nova:memory>512</nova:memory>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:disk>1</nova:disk>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:swap>0</nova:swap>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:vcpus>1</nova:vcpus>
Nov 02 01:39:42 user nova-compute[74996]:   </nova:flavor>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:owner>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:user uuid="1bb72dff3f614017b0ddc032ac15cd7b">tempest-TaggedAttachmentsTest-722286534-project-member</nova:user>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:project uuid="7981230c517e493883bb048b1cfa7907">tempest-TaggedAttachmentsTest-722286534</nova:project>
Nov 02 01:39:42 user nova-compute[74996]:   </nova:owner>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:ports>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:port uuid="fbf546f3-964c-4816-84c1-20d11b5ed544">
Nov 02 01:39:42 user nova-compute[74996]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 01:39:42 user nova-compute[74996]:     </nova:port>
Nov 02 01:39:42 user nova-compute[74996]:   </nova:ports>
Nov 02 01:39:42 user nova-compute[74996]: </nova:instance>
Nov 02 01:39:42 user nova-compute[74996]:  {{(pid=74996) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG nova.compute.manager [req-4e63afaa-913d-40dc-862f-9d1afcef4f5e req-7d85a3b5-8328-4c97-8410-05f1e909d9cf service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Received event network-vif-deleted-d1504136-cb23-4cfd-981b-5f4a46f71bb1 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:39:42 user nova-compute[74996]: INFO nova.compute.manager [req-4e63afaa-913d-40dc-862f-9d1afcef4f5e req-7d85a3b5-8328-4c97-8410-05f1e909d9cf service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Neutron deleted interface d1504136-cb23-4cfd-981b-5f4a46f71bb1; detaching it from the instance and deleting it from the info cache
Nov 02 01:39:42 user nova-compute[74996]: DEBUG nova.network.neutron [req-4e63afaa-913d-40dc-862f-9d1afcef4f5e req-7d85a3b5-8328-4c97-8410-05f1e909d9cf service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Updating instance_info_cache with network_info: [{"id": "fbf546f3-964c-4816-84c1-20d11b5ed544", "address": "fa:16:3e:e1:e1:a7", "network": {"id": "2cb390f5-5458-4e64-bf80-887d5f41bdf8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1475294747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7981230c517e493883bb048b1cfa7907", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf546f3-96", "ovs_interfaceid": "fbf546f3-964c-4816-84c1-20d11b5ed544", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Acquiring lock "refresh_cache-f44d0b13-9dae-40c9-83d0-0b84699b1cc2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Acquired lock "refresh_cache-f44d0b13-9dae-40c9-83d0-0b84699b1cc2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG nova.network.neutron [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG nova.objects.instance [req-4e63afaa-913d-40dc-862f-9d1afcef4f5e req-7d85a3b5-8328-4c97-8410-05f1e909d9cf service nova] Lazy-loading 'system_metadata' on Instance uuid f44d0b13-9dae-40c9-83d0-0b84699b1cc2 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG nova.objects.instance [req-4e63afaa-913d-40dc-862f-9d1afcef4f5e req-7d85a3b5-8328-4c97-8410-05f1e909d9cf service nova] Lazy-loading 'flavor' on Instance uuid f44d0b13-9dae-40c9-83d0-0b84699b1cc2 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG nova.objects.base [req-4e63afaa-913d-40dc-862f-9d1afcef4f5e req-7d85a3b5-8328-4c97-8410-05f1e909d9cf service nova] Object Instance<f44d0b13-9dae-40c9-83d0-0b84699b1cc2> lazy-loaded attributes: system_metadata,flavor {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [req-4e63afaa-913d-40dc-862f-9d1afcef4f5e req-7d85a3b5-8328-4c97-8410-05f1e909d9cf service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111239639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111239639',id=17,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLtwBp/DvHskyQXeHr37ezG4yqg/zTU4wDpo1xGzexMimgVBKyE7nsHF9zbcCIyqHw1sf3kCFQioLSlFRREV/mNyOI03M7/LCcKSZAW08/rLH78veAeoRHPxfQDNyUQqA==',key_name='tempest-keypair-876877355',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:35:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7981230c517e493883bb048b1cfa7907',ramdisk_id='',reservation_id='r-ccrouw9n',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-722286534',owner_user_name='tempest-TaggedAttachmentsTest-722286534-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:35:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bb72dff3f614017b0ddc032ac15cd7b',uuid=f44d0b13-9dae-40c9-83d0-0b84699b1cc2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1504136-cb23-4cfd-981b-5f4a46f71bb1", "address": "fa:16:3e:fd:76:d8", "network": {"id": "d7c8d7c4-4b9d-4903-bdaf-c3db1f11a6dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1241834085", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7981230c517e493883bb048b1cfa7907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1504136-cb", "ovs_interfaceid": "d1504136-cb23-4cfd-981b-5f4a46f71bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG nova.network.os_vif_util [req-4e63afaa-913d-40dc-862f-9d1afcef4f5e req-7d85a3b5-8328-4c97-8410-05f1e909d9cf service nova] Converting VIF {"id": "d1504136-cb23-4cfd-981b-5f4a46f71bb1", "address": "fa:16:3e:fd:76:d8", "network": {"id": "d7c8d7c4-4b9d-4903-bdaf-c3db1f11a6dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1241834085", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7981230c517e493883bb048b1cfa7907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1504136-cb", "ovs_interfaceid": "d1504136-cb23-4cfd-981b-5f4a46f71bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG nova.network.os_vif_util [req-4e63afaa-913d-40dc-862f-9d1afcef4f5e req-7d85a3b5-8328-4c97-8410-05f1e909d9cf service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:76:d8,bridge_name='br-int',has_traffic_filtering=True,id=d1504136-cb23-4cfd-981b-5f4a46f71bb1,network=Network(d7c8d7c4-4b9d-4903-bdaf-c3db1f11a6dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1504136-cb') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [req-4e63afaa-913d-40dc-862f-9d1afcef4f5e req-7d85a3b5-8328-4c97-8410-05f1e909d9cf service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fd:76:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tapd1504136-cb"/></interface> {{(pid=74996) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [req-4e63afaa-913d-40dc-862f-9d1afcef4f5e req-7d85a3b5-8328-4c97-8410-05f1e909d9cf service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fd:76:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tapd1504136-cb"/></interface>not found in domain: <domain type='kvm' id='16'>
Nov 02 01:39:42 user nova-compute[74996]:   <name>instance-00000011</name>
Nov 02 01:39:42 user nova-compute[74996]:   <uuid>f44d0b13-9dae-40c9-83d0-0b84699b1cc2</uuid>
Nov 02 01:39:42 user nova-compute[74996]:   <metadata>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:39:42 user nova-compute[74996]:   <nova:package version="0.0.0"/>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:name>tempest-device-tagging-server-2111239639</nova:name>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:creationTime>2023-11-02 01:39:42</nova:creationTime>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:flavor name="m1.tiny">
Nov 02 01:39:42 user nova-compute[74996]:     <nova:memory>512</nova:memory>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:disk>1</nova:disk>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:swap>0</nova:swap>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:vcpus>1</nova:vcpus>
Nov 02 01:39:42 user nova-compute[74996]:   </nova:flavor>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:owner>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:user uuid="1bb72dff3f614017b0ddc032ac15cd7b">tempest-TaggedAttachmentsTest-722286534-project-member</nova:user>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:project uuid="7981230c517e493883bb048b1cfa7907">tempest-TaggedAttachmentsTest-722286534</nova:project>
Nov 02 01:39:42 user nova-compute[74996]:   </nova:owner>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:ports>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:port uuid="fbf546f3-964c-4816-84c1-20d11b5ed544">
Nov 02 01:39:42 user nova-compute[74996]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 01:39:42 user nova-compute[74996]:     </nova:port>
Nov 02 01:39:42 user nova-compute[74996]:   </nova:ports>
Nov 02 01:39:42 user nova-compute[74996]: </nova:instance>
Nov 02 01:39:42 user nova-compute[74996]:   </metadata>
Nov 02 01:39:42 user nova-compute[74996]:   <memory unit='KiB'>524288</memory>
Nov 02 01:39:42 user nova-compute[74996]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 02 01:39:42 user nova-compute[74996]:   <vcpu placement='static'>1</vcpu>
Nov 02 01:39:42 user nova-compute[74996]:   <resource>
Nov 02 01:39:42 user nova-compute[74996]:     <partition>/machine</partition>
Nov 02 01:39:42 user nova-compute[74996]:   </resource>
Nov 02 01:39:42 user nova-compute[74996]:   <sysinfo type='smbios'>
Nov 02 01:39:42 user nova-compute[74996]:     <system>
Nov 02 01:39:42 user nova-compute[74996]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 02 01:39:42 user nova-compute[74996]:       <entry name='product'>OpenStack Nova</entry>
Nov 02 01:39:42 user nova-compute[74996]:       <entry name='version'>0.0.0</entry>
Nov 02 01:39:42 user nova-compute[74996]:       <entry name='serial'>f44d0b13-9dae-40c9-83d0-0b84699b1cc2</entry>
Nov 02 01:39:42 user nova-compute[74996]:       <entry name='uuid'>f44d0b13-9dae-40c9-83d0-0b84699b1cc2</entry>
Nov 02 01:39:42 user nova-compute[74996]:       <entry name='family'>Virtual Machine</entry>
Nov 02 01:39:42 user nova-compute[74996]:     </system>
Nov 02 01:39:42 user nova-compute[74996]:   </sysinfo>
Nov 02 01:39:42 user nova-compute[74996]:   <os>
Nov 02 01:39:42 user nova-compute[74996]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 02 01:39:42 user nova-compute[74996]:     <boot dev='hd'/>
Nov 02 01:39:42 user nova-compute[74996]:     <smbios mode='sysinfo'/>
Nov 02 01:39:42 user nova-compute[74996]:   </os>
Nov 02 01:39:42 user nova-compute[74996]:   <features>
Nov 02 01:39:42 user nova-compute[74996]:     <acpi/>
Nov 02 01:39:42 user nova-compute[74996]:     <apic/>
Nov 02 01:39:42 user nova-compute[74996]:     <vmcoreinfo state='on'/>
Nov 02 01:39:42 user nova-compute[74996]:   </features>
Nov 02 01:39:42 user nova-compute[74996]:   <cpu mode='custom' match='exact' check='full'>
Nov 02 01:39:42 user nova-compute[74996]:     <model fallback='forbid'>Nehalem</model>
Nov 02 01:39:42 user nova-compute[74996]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 02 01:39:42 user nova-compute[74996]:     <feature policy='require' name='vme'/>
Nov 02 01:39:42 user nova-compute[74996]:     <feature policy='require' name='x2apic'/>
Nov 02 01:39:42 user nova-compute[74996]:     <feature policy='require' name='hypervisor'/>
Nov 02 01:39:42 user nova-compute[74996]:   </cpu>
Nov 02 01:39:42 user nova-compute[74996]:   <clock offset='utc'>
Nov 02 01:39:42 user nova-compute[74996]:     <timer name='pit' tickpolicy='delay'/>
Nov 02 01:39:42 user nova-compute[74996]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 02 01:39:42 user nova-compute[74996]:     <timer name='hpet' present='no'/>
Nov 02 01:39:42 user nova-compute[74996]:   </clock>
Nov 02 01:39:42 user nova-compute[74996]:   <on_poweroff>destroy</on_poweroff>
Nov 02 01:39:42 user nova-compute[74996]:   <on_reboot>restart</on_reboot>
Nov 02 01:39:42 user nova-compute[74996]:   <on_crash>destroy</on_crash>
Nov 02 01:39:42 user nova-compute[74996]:   <devices>
Nov 02 01:39:42 user nova-compute[74996]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 02 01:39:42 user nova-compute[74996]:     <disk type='file' device='disk'>
Nov 02 01:39:42 user nova-compute[74996]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 02 01:39:42 user nova-compute[74996]:       <source file='/opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk' index='2'/>
Nov 02 01:39:42 user nova-compute[74996]:       <backingStore type='file' index='3'>
Nov 02 01:39:42 user nova-compute[74996]:         <format type='raw'/>
Nov 02 01:39:42 user nova-compute[74996]:         <source file='/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8'/>
Nov 02 01:39:42 user nova-compute[74996]:         <backingStore/>
Nov 02 01:39:42 user nova-compute[74996]:       </backingStore>
Nov 02 01:39:42 user nova-compute[74996]:       <target dev='vda' bus='virtio'/>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='virtio-disk0'/>
Nov 02 01:39:42 user nova-compute[74996]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </disk>
Nov 02 01:39:42 user nova-compute[74996]:     <disk type='file' device='cdrom'>
Nov 02 01:39:42 user nova-compute[74996]:       <driver name='qemu' type='raw' cache='none'/>
Nov 02 01:39:42 user nova-compute[74996]:       <source file='/opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk.config' index='1'/>
Nov 02 01:39:42 user nova-compute[74996]:       <backingStore/>
Nov 02 01:39:42 user nova-compute[74996]:       <target dev='hda' bus='ide'/>
Nov 02 01:39:42 user nova-compute[74996]:       <readonly/>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='ide0-0-0'/>
Nov 02 01:39:42 user nova-compute[74996]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </disk>
Nov 02 01:39:42 user nova-compute[74996]:     <controller type='usb' index='0' model='none'>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='usb'/>
Nov 02 01:39:42 user nova-compute[74996]:     </controller>
Nov 02 01:39:42 user nova-compute[74996]:     <controller type='pci' index='0' model='pci-root'>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='pci.0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </controller>
Nov 02 01:39:42 user nova-compute[74996]:     <controller type='ide' index='0'>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='ide'/>
Nov 02 01:39:42 user nova-compute[74996]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 02 01:39:42 user nova-compute[74996]:     </controller>
Nov 02 01:39:42 user nova-compute[74996]:     <interface type='ethernet'>
Nov 02 01:39:42 user nova-compute[74996]:       <mac address='fa:16:3e:e1:e1:a7'/>
Nov 02 01:39:42 user nova-compute[74996]:       <target dev='tapfbf546f3-96'/>
Nov 02 01:39:42 user nova-compute[74996]:       <model type='virtio'/>
Nov 02 01:39:42 user nova-compute[74996]:       <mtu size='1442'/>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='net0'/>
Nov 02 01:39:42 user nova-compute[74996]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </interface>
Nov 02 01:39:42 user nova-compute[74996]:     <serial type='pty'>
Nov 02 01:39:42 user nova-compute[74996]:       <source path='/dev/pts/8'/>
Nov 02 01:39:42 user nova-compute[74996]:       <log file='/opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/console.log' append='off'/>
Nov 02 01:39:42 user nova-compute[74996]:       <target type='isa-serial' port='0'>
Nov 02 01:39:42 user nova-compute[74996]:         <model name='isa-serial'/>
Nov 02 01:39:42 user nova-compute[74996]:       </target>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='serial0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </serial>
Nov 02 01:39:42 user nova-compute[74996]:     <console type='pty' tty='/dev/pts/8'>
Nov 02 01:39:42 user nova-compute[74996]:       <source path='/dev/pts/8'/>
Nov 02 01:39:42 user nova-compute[74996]:       <log file='/opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/console.log' append='off'/>
Nov 02 01:39:42 user nova-compute[74996]:       <target type='serial' port='0'/>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='serial0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </console>
Nov 02 01:39:42 user nova-compute[74996]:     <input type='mouse' bus='ps2'>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='input0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </input>
Nov 02 01:39:42 user nova-compute[74996]:     <input type='keyboard' bus='ps2'>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='input1'/>
Nov 02 01:39:42 user nova-compute[74996]:     </input>
Nov 02 01:39:42 user nova-compute[74996]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 02 01:39:42 user nova-compute[74996]:       <listen type='address' address='0.0.0.0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </graphics>
Nov 02 01:39:42 user nova-compute[74996]:     <audio id='1' type='none'/>
Nov 02 01:39:42 user nova-compute[74996]:     <video>
Nov 02 01:39:42 user nova-compute[74996]:       <model type='virtio' heads='1' primary='yes'/>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='video0'/>
Nov 02 01:39:42 user nova-compute[74996]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </video>
Nov 02 01:39:42 user nova-compute[74996]:     <memballoon model='virtio'>
Nov 02 01:39:42 user nova-compute[74996]:       <stats period='10'/>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='balloon0'/>
Nov 02 01:39:42 user nova-compute[74996]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </memballoon>
Nov 02 01:39:42 user nova-compute[74996]:     <rng model='virtio'>
Nov 02 01:39:42 user nova-compute[74996]:       <backend model='random'>/dev/urandom</backend>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='rng0'/>
Nov 02 01:39:42 user nova-compute[74996]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </rng>
Nov 02 01:39:42 user nova-compute[74996]:   </devices>
Nov 02 01:39:42 user nova-compute[74996]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 02 01:39:42 user nova-compute[74996]:     <label>libvirt-f44d0b13-9dae-40c9-83d0-0b84699b1cc2</label>
Nov 02 01:39:42 user nova-compute[74996]:     <imagelabel>libvirt-f44d0b13-9dae-40c9-83d0-0b84699b1cc2</imagelabel>
Nov 02 01:39:42 user nova-compute[74996]:   </seclabel>
Nov 02 01:39:42 user nova-compute[74996]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 02 01:39:42 user nova-compute[74996]:     <label>+64055:+108</label>
Nov 02 01:39:42 user nova-compute[74996]:     <imagelabel>+64055:+108</imagelabel>
Nov 02 01:39:42 user nova-compute[74996]:   </seclabel>
Nov 02 01:39:42 user nova-compute[74996]: </domain>
Nov 02 01:39:42 user nova-compute[74996]:  {{(pid=74996) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [req-4e63afaa-913d-40dc-862f-9d1afcef4f5e req-7d85a3b5-8328-4c97-8410-05f1e909d9cf service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fd:76:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tapd1504136-cb"/></interface> {{(pid=74996) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [req-4e63afaa-913d-40dc-862f-9d1afcef4f5e req-7d85a3b5-8328-4c97-8410-05f1e909d9cf service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fd:76:d8"/><model type="virtio"/><mtu size="1442"/><target dev="tapd1504136-cb"/></interface>not found in domain: <domain type='kvm' id='16'>
Nov 02 01:39:42 user nova-compute[74996]:   <name>instance-00000011</name>
Nov 02 01:39:42 user nova-compute[74996]:   <uuid>f44d0b13-9dae-40c9-83d0-0b84699b1cc2</uuid>
Nov 02 01:39:42 user nova-compute[74996]:   <metadata>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:39:42 user nova-compute[74996]:   <nova:package version="0.0.0"/>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:name>tempest-device-tagging-server-2111239639</nova:name>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:creationTime>2023-11-02 01:39:42</nova:creationTime>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:flavor name="m1.tiny">
Nov 02 01:39:42 user nova-compute[74996]:     <nova:memory>512</nova:memory>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:disk>1</nova:disk>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:swap>0</nova:swap>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:vcpus>1</nova:vcpus>
Nov 02 01:39:42 user nova-compute[74996]:   </nova:flavor>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:owner>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:user uuid="1bb72dff3f614017b0ddc032ac15cd7b">tempest-TaggedAttachmentsTest-722286534-project-member</nova:user>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:project uuid="7981230c517e493883bb048b1cfa7907">tempest-TaggedAttachmentsTest-722286534</nova:project>
Nov 02 01:39:42 user nova-compute[74996]:   </nova:owner>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:ports>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:port uuid="fbf546f3-964c-4816-84c1-20d11b5ed544">
Nov 02 01:39:42 user nova-compute[74996]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 01:39:42 user nova-compute[74996]:     </nova:port>
Nov 02 01:39:42 user nova-compute[74996]:   </nova:ports>
Nov 02 01:39:42 user nova-compute[74996]: </nova:instance>
Nov 02 01:39:42 user nova-compute[74996]:   </metadata>
Nov 02 01:39:42 user nova-compute[74996]:   <memory unit='KiB'>524288</memory>
Nov 02 01:39:42 user nova-compute[74996]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 02 01:39:42 user nova-compute[74996]:   <vcpu placement='static'>1</vcpu>
Nov 02 01:39:42 user nova-compute[74996]:   <resource>
Nov 02 01:39:42 user nova-compute[74996]:     <partition>/machine</partition>
Nov 02 01:39:42 user nova-compute[74996]:   </resource>
Nov 02 01:39:42 user nova-compute[74996]:   <sysinfo type='smbios'>
Nov 02 01:39:42 user nova-compute[74996]:     <system>
Nov 02 01:39:42 user nova-compute[74996]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 02 01:39:42 user nova-compute[74996]:       <entry name='product'>OpenStack Nova</entry>
Nov 02 01:39:42 user nova-compute[74996]:       <entry name='version'>0.0.0</entry>
Nov 02 01:39:42 user nova-compute[74996]:       <entry name='serial'>f44d0b13-9dae-40c9-83d0-0b84699b1cc2</entry>
Nov 02 01:39:42 user nova-compute[74996]:       <entry name='uuid'>f44d0b13-9dae-40c9-83d0-0b84699b1cc2</entry>
Nov 02 01:39:42 user nova-compute[74996]:       <entry name='family'>Virtual Machine</entry>
Nov 02 01:39:42 user nova-compute[74996]:     </system>
Nov 02 01:39:42 user nova-compute[74996]:   </sysinfo>
Nov 02 01:39:42 user nova-compute[74996]:   <os>
Nov 02 01:39:42 user nova-compute[74996]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 02 01:39:42 user nova-compute[74996]:     <boot dev='hd'/>
Nov 02 01:39:42 user nova-compute[74996]:     <smbios mode='sysinfo'/>
Nov 02 01:39:42 user nova-compute[74996]:   </os>
Nov 02 01:39:42 user nova-compute[74996]:   <features>
Nov 02 01:39:42 user nova-compute[74996]:     <acpi/>
Nov 02 01:39:42 user nova-compute[74996]:     <apic/>
Nov 02 01:39:42 user nova-compute[74996]:     <vmcoreinfo state='on'/>
Nov 02 01:39:42 user nova-compute[74996]:   </features>
Nov 02 01:39:42 user nova-compute[74996]:   <cpu mode='custom' match='exact' check='full'>
Nov 02 01:39:42 user nova-compute[74996]:     <model fallback='forbid'>Nehalem</model>
Nov 02 01:39:42 user nova-compute[74996]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 02 01:39:42 user nova-compute[74996]:     <feature policy='require' name='vme'/>
Nov 02 01:39:42 user nova-compute[74996]:     <feature policy='require' name='x2apic'/>
Nov 02 01:39:42 user nova-compute[74996]:     <feature policy='require' name='hypervisor'/>
Nov 02 01:39:42 user nova-compute[74996]:   </cpu>
Nov 02 01:39:42 user nova-compute[74996]:   <clock offset='utc'>
Nov 02 01:39:42 user nova-compute[74996]:     <timer name='pit' tickpolicy='delay'/>
Nov 02 01:39:42 user nova-compute[74996]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 02 01:39:42 user nova-compute[74996]:     <timer name='hpet' present='no'/>
Nov 02 01:39:42 user nova-compute[74996]:   </clock>
Nov 02 01:39:42 user nova-compute[74996]:   <on_poweroff>destroy</on_poweroff>
Nov 02 01:39:42 user nova-compute[74996]:   <on_reboot>restart</on_reboot>
Nov 02 01:39:42 user nova-compute[74996]:   <on_crash>destroy</on_crash>
Nov 02 01:39:42 user nova-compute[74996]:   <devices>
Nov 02 01:39:42 user nova-compute[74996]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 02 01:39:42 user nova-compute[74996]:     <disk type='file' device='disk'>
Nov 02 01:39:42 user nova-compute[74996]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 02 01:39:42 user nova-compute[74996]:       <source file='/opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk' index='2'/>
Nov 02 01:39:42 user nova-compute[74996]:       <backingStore type='file' index='3'>
Nov 02 01:39:42 user nova-compute[74996]:         <format type='raw'/>
Nov 02 01:39:42 user nova-compute[74996]:         <source file='/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8'/>
Nov 02 01:39:42 user nova-compute[74996]:         <backingStore/>
Nov 02 01:39:42 user nova-compute[74996]:       </backingStore>
Nov 02 01:39:42 user nova-compute[74996]:       <target dev='vda' bus='virtio'/>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='virtio-disk0'/>
Nov 02 01:39:42 user nova-compute[74996]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </disk>
Nov 02 01:39:42 user nova-compute[74996]:     <disk type='file' device='cdrom'>
Nov 02 01:39:42 user nova-compute[74996]:       <driver name='qemu' type='raw' cache='none'/>
Nov 02 01:39:42 user nova-compute[74996]:       <source file='/opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/disk.config' index='1'/>
Nov 02 01:39:42 user nova-compute[74996]:       <backingStore/>
Nov 02 01:39:42 user nova-compute[74996]:       <target dev='hda' bus='ide'/>
Nov 02 01:39:42 user nova-compute[74996]:       <readonly/>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='ide0-0-0'/>
Nov 02 01:39:42 user nova-compute[74996]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </disk>
Nov 02 01:39:42 user nova-compute[74996]:     <controller type='usb' index='0' model='none'>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='usb'/>
Nov 02 01:39:42 user nova-compute[74996]:     </controller>
Nov 02 01:39:42 user nova-compute[74996]:     <controller type='pci' index='0' model='pci-root'>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='pci.0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </controller>
Nov 02 01:39:42 user nova-compute[74996]:     <controller type='ide' index='0'>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='ide'/>
Nov 02 01:39:42 user nova-compute[74996]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 02 01:39:42 user nova-compute[74996]:     </controller>
Nov 02 01:39:42 user nova-compute[74996]:     <interface type='ethernet'>
Nov 02 01:39:42 user nova-compute[74996]:       <mac address='fa:16:3e:e1:e1:a7'/>
Nov 02 01:39:42 user nova-compute[74996]:       <target dev='tapfbf546f3-96'/>
Nov 02 01:39:42 user nova-compute[74996]:       <model type='virtio'/>
Nov 02 01:39:42 user nova-compute[74996]:       <mtu size='1442'/>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='net0'/>
Nov 02 01:39:42 user nova-compute[74996]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </interface>
Nov 02 01:39:42 user nova-compute[74996]:     <serial type='pty'>
Nov 02 01:39:42 user nova-compute[74996]:       <source path='/dev/pts/8'/>
Nov 02 01:39:42 user nova-compute[74996]:       <log file='/opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/console.log' append='off'/>
Nov 02 01:39:42 user nova-compute[74996]:       <target type='isa-serial' port='0'>
Nov 02 01:39:42 user nova-compute[74996]:         <model name='isa-serial'/>
Nov 02 01:39:42 user nova-compute[74996]:       </target>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='serial0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </serial>
Nov 02 01:39:42 user nova-compute[74996]:     <console type='pty' tty='/dev/pts/8'>
Nov 02 01:39:42 user nova-compute[74996]:       <source path='/dev/pts/8'/>
Nov 02 01:39:42 user nova-compute[74996]:       <log file='/opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2/console.log' append='off'/>
Nov 02 01:39:42 user nova-compute[74996]:       <target type='serial' port='0'/>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='serial0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </console>
Nov 02 01:39:42 user nova-compute[74996]:     <input type='mouse' bus='ps2'>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='input0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </input>
Nov 02 01:39:42 user nova-compute[74996]:     <input type='keyboard' bus='ps2'>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='input1'/>
Nov 02 01:39:42 user nova-compute[74996]:     </input>
Nov 02 01:39:42 user nova-compute[74996]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 02 01:39:42 user nova-compute[74996]:       <listen type='address' address='0.0.0.0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </graphics>
Nov 02 01:39:42 user nova-compute[74996]:     <audio id='1' type='none'/>
Nov 02 01:39:42 user nova-compute[74996]:     <video>
Nov 02 01:39:42 user nova-compute[74996]:       <model type='virtio' heads='1' primary='yes'/>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='video0'/>
Nov 02 01:39:42 user nova-compute[74996]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </video>
Nov 02 01:39:42 user nova-compute[74996]:     <memballoon model='virtio'>
Nov 02 01:39:42 user nova-compute[74996]:       <stats period='10'/>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='balloon0'/>
Nov 02 01:39:42 user nova-compute[74996]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </memballoon>
Nov 02 01:39:42 user nova-compute[74996]:     <rng model='virtio'>
Nov 02 01:39:42 user nova-compute[74996]:       <backend model='random'>/dev/urandom</backend>
Nov 02 01:39:42 user nova-compute[74996]:       <alias name='rng0'/>
Nov 02 01:39:42 user nova-compute[74996]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 02 01:39:42 user nova-compute[74996]:     </rng>
Nov 02 01:39:42 user nova-compute[74996]:   </devices>
Nov 02 01:39:42 user nova-compute[74996]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 02 01:39:42 user nova-compute[74996]:     <label>libvirt-f44d0b13-9dae-40c9-83d0-0b84699b1cc2</label>
Nov 02 01:39:42 user nova-compute[74996]:     <imagelabel>libvirt-f44d0b13-9dae-40c9-83d0-0b84699b1cc2</imagelabel>
Nov 02 01:39:42 user nova-compute[74996]:   </seclabel>
Nov 02 01:39:42 user nova-compute[74996]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 02 01:39:42 user nova-compute[74996]:     <label>+64055:+108</label>
Nov 02 01:39:42 user nova-compute[74996]:     <imagelabel>+64055:+108</imagelabel>
Nov 02 01:39:42 user nova-compute[74996]:   </seclabel>
Nov 02 01:39:42 user nova-compute[74996]: </domain>
Nov 02 01:39:42 user nova-compute[74996]:  {{(pid=74996) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 02 01:39:42 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [req-4e63afaa-913d-40dc-862f-9d1afcef4f5e req-7d85a3b5-8328-4c97-8410-05f1e909d9cf service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Detaching interface fa:16:3e:fd:76:d8 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapd1504136-cb' not found.
Nov 02 01:39:42 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [req-4e63afaa-913d-40dc-862f-9d1afcef4f5e req-7d85a3b5-8328-4c97-8410-05f1e909d9cf service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111239639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111239639',id=17,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLtwBp/DvHskyQXeHr37ezG4yqg/zTU4wDpo1xGzexMimgVBKyE7nsHF9zbcCIyqHw1sf3kCFQioLSlFRREV/mNyOI03M7/LCcKSZAW08/rLH78veAeoRHPxfQDNyUQqA==',key_name='tempest-keypair-876877355',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:35:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7981230c517e493883bb048b1cfa7907',ramdisk_id='',reservation_id='r-ccrouw9n',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-722286534',owner_user_name='tempest-TaggedAttachmentsTest-722286534-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:35:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bb72dff3f614017b0ddc032ac15cd7b',uuid=f44d0b13-9dae-40c9-83d0-0b84699b1cc2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1504136-cb23-4cfd-981b-5f4a46f71bb1", "address": "fa:16:3e:fd:76:d8", "network": {"id": "d7c8d7c4-4b9d-4903-bdaf-c3db1f11a6dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1241834085", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7981230c517e493883bb048b1cfa7907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1504136-cb", "ovs_interfaceid": "d1504136-cb23-4cfd-981b-5f4a46f71bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG nova.network.os_vif_util [req-4e63afaa-913d-40dc-862f-9d1afcef4f5e req-7d85a3b5-8328-4c97-8410-05f1e909d9cf service nova] Converting VIF {"id": "d1504136-cb23-4cfd-981b-5f4a46f71bb1", "address": "fa:16:3e:fd:76:d8", "network": {"id": "d7c8d7c4-4b9d-4903-bdaf-c3db1f11a6dd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1241834085", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7981230c517e493883bb048b1cfa7907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1504136-cb", "ovs_interfaceid": "d1504136-cb23-4cfd-981b-5f4a46f71bb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG nova.network.os_vif_util [req-4e63afaa-913d-40dc-862f-9d1afcef4f5e req-7d85a3b5-8328-4c97-8410-05f1e909d9cf service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:76:d8,bridge_name='br-int',has_traffic_filtering=True,id=d1504136-cb23-4cfd-981b-5f4a46f71bb1,network=Network(d7c8d7c4-4b9d-4903-bdaf-c3db1f11a6dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1504136-cb') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG os_vif [req-4e63afaa-913d-40dc-862f-9d1afcef4f5e req-7d85a3b5-8328-4c97-8410-05f1e909d9cf service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:76:d8,bridge_name='br-int',has_traffic_filtering=True,id=d1504136-cb23-4cfd-981b-5f4a46f71bb1,network=Network(d7c8d7c4-4b9d-4903-bdaf-c3db1f11a6dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1504136-cb') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1504136-cb, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:39:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:39:42 user nova-compute[74996]: INFO os_vif [req-4e63afaa-913d-40dc-862f-9d1afcef4f5e req-7d85a3b5-8328-4c97-8410-05f1e909d9cf service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:76:d8,bridge_name='br-int',has_traffic_filtering=True,id=d1504136-cb23-4cfd-981b-5f4a46f71bb1,network=Network(d7c8d7c4-4b9d-4903-bdaf-c3db1f11a6dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1504136-cb')
Nov 02 01:39:42 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [req-4e63afaa-913d-40dc-862f-9d1afcef4f5e req-7d85a3b5-8328-4c97-8410-05f1e909d9cf service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:39:42 user nova-compute[74996]:   <nova:package version="0.0.0"/>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:name>tempest-device-tagging-server-2111239639</nova:name>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:creationTime>2023-11-02 01:39:42</nova:creationTime>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:flavor name="m1.tiny">
Nov 02 01:39:42 user nova-compute[74996]:     <nova:memory>512</nova:memory>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:disk>1</nova:disk>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:swap>0</nova:swap>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:vcpus>1</nova:vcpus>
Nov 02 01:39:42 user nova-compute[74996]:   </nova:flavor>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:owner>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:user uuid="1bb72dff3f614017b0ddc032ac15cd7b">tempest-TaggedAttachmentsTest-722286534-project-member</nova:user>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:project uuid="7981230c517e493883bb048b1cfa7907">tempest-TaggedAttachmentsTest-722286534</nova:project>
Nov 02 01:39:42 user nova-compute[74996]:   </nova:owner>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:39:42 user nova-compute[74996]:   <nova:ports>
Nov 02 01:39:42 user nova-compute[74996]:     <nova:port uuid="fbf546f3-964c-4816-84c1-20d11b5ed544">
Nov 02 01:39:42 user nova-compute[74996]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 01:39:42 user nova-compute[74996]:     </nova:port>
Nov 02 01:39:42 user nova-compute[74996]:   </nova:ports>
Nov 02 01:39:42 user nova-compute[74996]: </nova:instance>
Nov 02 01:39:42 user nova-compute[74996]:  {{(pid=74996) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 02 01:39:43 user nova-compute[74996]: INFO nova.network.neutron [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Port d1504136-cb23-4cfd-981b-5f4a46f71bb1 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 02 01:39:43 user nova-compute[74996]: DEBUG nova.network.neutron [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Updating instance_info_cache with network_info: [{"id": "fbf546f3-964c-4816-84c1-20d11b5ed544", "address": "fa:16:3e:e1:e1:a7", "network": {"id": "2cb390f5-5458-4e64-bf80-887d5f41bdf8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1475294747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7981230c517e493883bb048b1cfa7907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf546f3-96", "ovs_interfaceid": "fbf546f3-964c-4816-84c1-20d11b5ed544", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:39:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Releasing lock "refresh_cache-f44d0b13-9dae-40c9-83d0-0b84699b1cc2" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:39:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c11e7fe-ce7b-4387-b5b2-2de3136a4d48 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "interface-f44d0b13-9dae-40c9-83d0-0b84699b1cc2-d1504136-cb23-4cfd-981b-5f4a46f71bb1" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.419s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:39:46 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance da10dadd-b04a-4f3b-92bd-fcaa18b51fce is timed out.
Nov 02 01:39:46 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Successfully detached device vdc from instance da10dadd-b04a-4f3b-92bd-fcaa18b51fce from the live domain config.
Nov 02 01:39:46 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CsmvrMgz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:39:46 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:39:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9a5d39-1ddb-4b6f-8b9c-2d389f433209]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:39:46 user nova-compute[74996]: No targets found.
Nov 02 01:39:46 user nova-compute[74996]: iSNS:
Nov 02 01:39:46 user nova-compute[74996]: No targets found.
Nov 02 01:39:46 user nova-compute[74996]: STATIC:
Nov 02 01:39:46 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855
Nov 02 01:39:46 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:39:46 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:39:46 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1
Nov 02 01:39:46 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:39:46 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:39:46 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7
Nov 02 01:39:46 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:39:46 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:39:46 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8
Nov 02 01:39:46 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:39:46 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:39:46 user nova-compute[74996]: FIRMWARE:
Nov 02 01:39:46 user nova-compute[74996]: No targets found.
Nov 02 01:39:46 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:39:46 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:39:46 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6540c308-175c-45e1-902f-67e4f9bae492]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3fd6f8-ac40-4d65-a292-3ff80284cda9]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:39:46 user nova-compute[74996]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:39:46 user nova-compute[74996]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 (non-flash)
Nov 02 01:39:46 user nova-compute[74996]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 (non-flash)
Nov 02 01:39:46 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:39:46 user nova-compute[74996]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:39:46 user nova-compute[74996]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 (non-flash)
Nov 02 01:39:46 user nova-compute[74996]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 (non-flash)
Nov 02 01:39:46 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830c4ce050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1'): ({'sdd'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Removing single pathed devices sdd {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab0cdf5-9595-41c4-bc16-7013f477ee4a]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[509d53ab-3dc6-44fa-b955-65e741fa001f]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Flushing IO for device /dev/sdd {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a1bb97-88eb-41f3-8160-5f48082349ba]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[685e5ffb-9e42-4dd3-95e6-477059b854d6]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] SCSI volumes sdd have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7828bd8-b0d1-4e6c-bb3a-ce68e8105356]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cf66f5-f6bc-4046-8973-31106f30c37c]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1, portal: 172.16.0.220,3260]
Nov 02 01:39:46 user nova-compute[74996]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1, portal: 172.16.0.220,3260] successful.
Nov 02 01:39:46 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bce4c077-5447-4ee3-ae7b-e55ce97cd3c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab54a956-1393-4865-bae4-27f385fb940e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] <== disconnect_volume: return (307ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:39:46 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:39:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:49 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6b79aa2f-02c7-492e-b27e-7481e41f8d2c is timed out.
Nov 02 01:39:49 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Successfully detached device vdb from instance 6b79aa2f-02c7-492e-b27e-7481e41f8d2c from the live domain config.
Nov 02 01:39:49 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qenFIiNA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:39:49 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:39:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f90e81b-91ed-4f36-b7fd-26ab2d3166d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:39:49 user nova-compute[74996]: No targets found.
Nov 02 01:39:49 user nova-compute[74996]: iSNS:
Nov 02 01:39:49 user nova-compute[74996]: No targets found.
Nov 02 01:39:49 user nova-compute[74996]: STATIC:
Nov 02 01:39:49 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855
Nov 02 01:39:49 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:39:49 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:39:49 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7
Nov 02 01:39:49 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:39:49 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:39:49 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8
Nov 02 01:39:49 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:39:49 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:39:49 user nova-compute[74996]: FIRMWARE:
Nov 02 01:39:49 user nova-compute[74996]: No targets found.
Nov 02 01:39:49 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:39:49 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:39:49 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00d5da0-2936-44e6-8c2b-a8d107db786e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a484875-08a5-4ede-bada-3bcce51c60da]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:39:49 user nova-compute[74996]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:39:49 user nova-compute[74996]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 (non-flash)
Nov 02 01:39:49 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 (non-flash)
Nov 02 01:39:49 user nova-compute[74996]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:39:49 user nova-compute[74996]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 (non-flash)
Nov 02 01:39:49 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8314246f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8'): ({'sdh'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Removing single pathed devices sdh {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0542590c-ddb9-4318-ac46-f88a34b2d2ed]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f47de0a-5b2b-46c5-b6be-7e985b061fdc]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Flushing IO for device /dev/sdh {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff173ec-3791-4762-949e-de7535cc285f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.038s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e7052f-3287-4951-8406-031f67b3fda6]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] SCSI volumes sdh have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b920989-aa9c-415a-9fa5-5b97416134ed]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[def2be7b-4eb5-463e-a47c-6e5b5e557f1b]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8, portal: 172.16.0.220,3260]
Nov 02 01:39:49 user nova-compute[74996]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8, portal: 172.16.0.220,3260] successful.
Nov 02 01:39:49 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd193bfc-2f88-478c-b7f3-e67be6cfe3b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0010e91f-676d-4262-b140-dd8cc3f09437]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] <== disconnect_volume: return (339ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:39:49 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:39:51 user nova-compute[74996]: DEBUG nova.objects.instance [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lazy-loading 'flavor' on Instance uuid da10dadd-b04a-4f3b-92bd-fcaa18b51fce {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:39:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0ba405cf-ce96-4fb2-86aa-667ec313212c tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.918s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:39:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:39:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "3b5719c9-08ad-4a01-b960-23328b537283" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:39:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "3b5719c9-08ad-4a01-b960-23328b537283" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:39:52 user nova-compute[74996]: DEBUG nova.compute.manager [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:39:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:39:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:39:52 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:39:52 user nova-compute[74996]: INFO nova.compute.claims [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Claim successful on node user
Nov 02 01:39:52 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:39:52 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:39:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:39:52 user nova-compute[74996]: DEBUG nova.compute.manager [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:39:53 user nova-compute[74996]: DEBUG nova.compute.manager [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:39:53 user nova-compute[74996]: DEBUG nova.network.neutron [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:39:53 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:39:53 user nova-compute[74996]: DEBUG nova.compute.manager [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:39:53 user nova-compute[74996]: DEBUG nova.policy [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be6bf504c3a649898e8c83399f6fee8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31965b482eb243a69112a49bf1302779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:39:53 user nova-compute[74996]: INFO nova.virt.block_device [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Booting with volume 9c2c466a-1b32-4336-aae3-0dd383f2f59d at /dev/vda
Nov 02 01:39:53 user nova-compute[74996]: DEBUG os_brick.utils [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:39:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efc197b-a096-4f3d-b6d3-fd8094a7d2fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae16c7d-c854-4068-813e-5baa507b5c4d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:39:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac99cca1-b682-4a98-a495-d699435acacc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44b0fcf-339a-4c77-9186-fb8a543d6bc3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:39:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:39:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:39:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:39:53 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:39:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a400c6-f30b-44aa-b510-3edeea20dfca]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:39:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:39:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:39:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:39:53 user nova-compute[74996]: DEBUG os_brick.utils [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:39:53 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Updating existing volume attachment record: a3601031-de66-4da9-a5c8-6da817bd8fb6 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:39:53 user nova-compute[74996]: DEBUG nova.network.neutron [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Successfully created port: 39bb24a8-37e5-43fc-839b-203634b56ad6 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:39:54 user nova-compute[74996]: DEBUG nova.network.neutron [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Successfully updated port: 39bb24a8-37e5-43fc-839b-203634b56ad6 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:39:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "refresh_cache-3b5719c9-08ad-4a01-b960-23328b537283" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:39:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquired lock "refresh_cache-3b5719c9-08ad-4a01-b960-23328b537283" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:39:54 user nova-compute[74996]: DEBUG nova.network.neutron [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:39:54 user nova-compute[74996]: DEBUG nova.network.neutron [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:39:54 user nova-compute[74996]: DEBUG nova.compute.manager [req-e81db88c-b198-4b1e-b84b-ee5573b2c456 req-807e6788-bc38-4670-8443-9478cadb5262 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Received event network-changed-39bb24a8-37e5-43fc-839b-203634b56ad6 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:39:54 user nova-compute[74996]: DEBUG nova.compute.manager [req-e81db88c-b198-4b1e-b84b-ee5573b2c456 req-807e6788-bc38-4670-8443-9478cadb5262 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Refreshing instance network info cache due to event network-changed-39bb24a8-37e5-43fc-839b-203634b56ad6. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:39:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-e81db88c-b198-4b1e-b84b-ee5573b2c456 req-807e6788-bc38-4670-8443-9478cadb5262 service nova] Acquiring lock "refresh_cache-3b5719c9-08ad-4a01-b960-23328b537283" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:39:54 user nova-compute[74996]: DEBUG nova.network.neutron [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Updating instance_info_cache with network_info: [{"id": "39bb24a8-37e5-43fc-839b-203634b56ad6", "address": "fa:16:3e:31:e2:fb", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bb24a8-37", "ovs_interfaceid": "39bb24a8-37e5-43fc-839b-203634b56ad6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:39:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Releasing lock "refresh_cache-3b5719c9-08ad-4a01-b960-23328b537283" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:39:55 user nova-compute[74996]: DEBUG nova.compute.manager [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Instance network_info: |[{"id": "39bb24a8-37e5-43fc-839b-203634b56ad6", "address": "fa:16:3e:31:e2:fb", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bb24a8-37", "ovs_interfaceid": "39bb24a8-37e5-43fc-839b-203634b56ad6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:39:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-e81db88c-b198-4b1e-b84b-ee5573b2c456 req-807e6788-bc38-4670-8443-9478cadb5262 service nova] Acquired lock "refresh_cache-3b5719c9-08ad-4a01-b960-23328b537283" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:39:55 user nova-compute[74996]: DEBUG nova.network.neutron [req-e81db88c-b198-4b1e-b84b-ee5573b2c456 req-807e6788-bc38-4670-8443-9478cadb5262 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Refreshing network info cache for port 39bb24a8-37e5-43fc-839b-203634b56ad6 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:39:55 user nova-compute[74996]: DEBUG nova.network.neutron [req-e81db88c-b198-4b1e-b84b-ee5573b2c456 req-807e6788-bc38-4670-8443-9478cadb5262 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Updated VIF entry in instance network info cache for port 39bb24a8-37e5-43fc-839b-203634b56ad6. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:39:55 user nova-compute[74996]: DEBUG nova.network.neutron [req-e81db88c-b198-4b1e-b84b-ee5573b2c456 req-807e6788-bc38-4670-8443-9478cadb5262 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Updating instance_info_cache with network_info: [{"id": "39bb24a8-37e5-43fc-839b-203634b56ad6", "address": "fa:16:3e:31:e2:fb", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bb24a8-37", "ovs_interfaceid": "39bb24a8-37e5-43fc-839b-203634b56ad6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:39:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-e81db88c-b198-4b1e-b84b-ee5573b2c456 req-807e6788-bc38-4670-8443-9478cadb5262 service nova] Releasing lock "refresh_cache-3b5719c9-08ad-4a01-b960-23328b537283" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:39:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:40:01 user nova-compute[74996]: DEBUG nova.objects.instance [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lazy-loading 'flavor' on Instance uuid 6b79aa2f-02c7-492e-b27e-7481e41f8d2c {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:40:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cde72363-5bf5-4ecd-bcab-dae6dceae4e2 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "6b79aa2f-02c7-492e-b27e-7481e41f8d2c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 32.973s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:40:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:08 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:40:12 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:40:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e359a5d2-7c2b-4748-8b81-8874f28c43e8 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Acquiring lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:40:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e359a5d2-7c2b-4748-8b81-8874f28c43e8 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:40:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e359a5d2-7c2b-4748-8b81-8874f28c43e8 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Acquiring lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:40:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e359a5d2-7c2b-4748-8b81-8874f28c43e8 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:40:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e359a5d2-7c2b-4748-8b81-8874f28c43e8 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:12 user nova-compute[74996]: INFO nova.compute.manager [None req-e359a5d2-7c2b-4748-8b81-8874f28c43e8 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Terminating instance
Nov 02 01:40:12 user nova-compute[74996]: DEBUG nova.compute.manager [None req-e359a5d2-7c2b-4748-8b81-8874f28c43e8 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:40:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:13 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:40:13 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74996) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 01:40:13 user nova-compute[74996]: DEBUG nova.compute.manager [req-c5470a4f-dc05-4453-b51f-5fa681eeaa38 req-0726394b-9303-40bb-98f3-b9badbe32b49 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Received event network-vif-unplugged-fbf546f3-964c-4816-84c1-20d11b5ed544 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:40:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c5470a4f-dc05-4453-b51f-5fa681eeaa38 req-0726394b-9303-40bb-98f3-b9badbe32b49 service nova] Acquiring lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:40:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c5470a4f-dc05-4453-b51f-5fa681eeaa38 req-0726394b-9303-40bb-98f3-b9badbe32b49 service nova] Lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:40:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c5470a4f-dc05-4453-b51f-5fa681eeaa38 req-0726394b-9303-40bb-98f3-b9badbe32b49 service nova] Lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:13 user nova-compute[74996]: DEBUG nova.compute.manager [req-c5470a4f-dc05-4453-b51f-5fa681eeaa38 req-0726394b-9303-40bb-98f3-b9badbe32b49 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] No waiting events found dispatching network-vif-unplugged-fbf546f3-964c-4816-84c1-20d11b5ed544 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:40:13 user nova-compute[74996]: DEBUG nova.compute.manager [req-c5470a4f-dc05-4453-b51f-5fa681eeaa38 req-0726394b-9303-40bb-98f3-b9badbe32b49 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Received event network-vif-unplugged-fbf546f3-964c-4816-84c1-20d11b5ed544 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:40:13 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Instance destroyed successfully.
Nov 02 01:40:13 user nova-compute[74996]: DEBUG nova.objects.instance [None req-e359a5d2-7c2b-4748-8b81-8874f28c43e8 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lazy-loading 'resources' on Instance uuid f44d0b13-9dae-40c9-83d0-0b84699b1cc2 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:40:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-e359a5d2-7c2b-4748-8b81-8874f28c43e8 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-02T01:35:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2111239639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2111239639',id=17,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLtwBp/DvHskyQXeHr37ezG4yqg/zTU4wDpo1xGzexMimgVBKyE7nsHF9zbcCIyqHw1sf3kCFQioLSlFRREV/mNyOI03M7/LCcKSZAW08/rLH78veAeoRHPxfQDNyUQqA==',key_name='tempest-keypair-876877355',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:35:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7981230c517e493883bb048b1cfa7907',ramdisk_id='',reservation_id='r-ccrouw9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-722286534',owner_user_name='tempest-TaggedAttachmentsTest-722286534-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:35:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bb72dff3f614017b0ddc032ac15cd7b',uuid=f44d0b13-9dae-40c9-83d0-0b84699b1cc2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbf546f3-964c-4816-84c1-20d11b5ed544", "address": "fa:16:3e:e1:e1:a7", "network": {"id": "2cb390f5-5458-4e64-bf80-887d5f41bdf8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1475294747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7981230c517e493883bb048b1cfa7907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf546f3-96", "ovs_interfaceid": "fbf546f3-964c-4816-84c1-20d11b5ed544", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:40:13 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-e359a5d2-7c2b-4748-8b81-8874f28c43e8 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Converting VIF {"id": "fbf546f3-964c-4816-84c1-20d11b5ed544", "address": "fa:16:3e:e1:e1:a7", "network": {"id": "2cb390f5-5458-4e64-bf80-887d5f41bdf8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1475294747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7981230c517e493883bb048b1cfa7907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf546f3-96", "ovs_interfaceid": "fbf546f3-964c-4816-84c1-20d11b5ed544", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:40:13 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-e359a5d2-7c2b-4748-8b81-8874f28c43e8 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:e1:a7,bridge_name='br-int',has_traffic_filtering=True,id=fbf546f3-964c-4816-84c1-20d11b5ed544,network=Network(2cb390f5-5458-4e64-bf80-887d5f41bdf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbf546f3-96') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:40:13 user nova-compute[74996]: DEBUG os_vif [None req-e359a5d2-7c2b-4748-8b81-8874f28c43e8 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:e1:a7,bridge_name='br-int',has_traffic_filtering=True,id=fbf546f3-964c-4816-84c1-20d11b5ed544,network=Network(2cb390f5-5458-4e64-bf80-887d5f41bdf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbf546f3-96') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:40:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbf546f3-96, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:40:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b4ac355-e4f0-4844-8ac1-c6995009201d) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:40:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:13 user nova-compute[74996]: INFO os_vif [None req-e359a5d2-7c2b-4748-8b81-8874f28c43e8 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:e1:a7,bridge_name='br-int',has_traffic_filtering=True,id=fbf546f3-964c-4816-84c1-20d11b5ed544,network=Network(2cb390f5-5458-4e64-bf80-887d5f41bdf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbf546f3-96')
Nov 02 01:40:13 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-e359a5d2-7c2b-4748-8b81-8874f28c43e8 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Deleting instance files /opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2_del
Nov 02 01:40:13 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-e359a5d2-7c2b-4748-8b81-8874f28c43e8 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Deletion of /opt/stack/data/nova/instances/f44d0b13-9dae-40c9-83d0-0b84699b1cc2_del complete
Nov 02 01:40:13 user nova-compute[74996]: INFO nova.compute.manager [None req-e359a5d2-7c2b-4748-8b81-8874f28c43e8 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 02 01:40:13 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-e359a5d2-7c2b-4748-8b81-8874f28c43e8 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:40:13 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:40:13 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:40:14 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:40:14 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:40:14 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:40:14 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Took 1.12 seconds to deallocate network for instance.
Nov 02 01:40:14 user nova-compute[74996]: DEBUG nova.compute.manager [req-4e23730f-3e6b-47e4-befc-f7b10029efff req-0e5cc2d4-ef0d-4748-bd4a-cba66f0e3c52 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Received event network-vif-deleted-fbf546f3-964c-4816-84c1-20d11b5ed544 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:40:14 user nova-compute[74996]: INFO nova.compute.manager [req-4e23730f-3e6b-47e4-befc-f7b10029efff req-0e5cc2d4-ef0d-4748-bd4a-cba66f0e3c52 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Neutron deleted interface fbf546f3-964c-4816-84c1-20d11b5ed544; detaching it from the instance and deleting it from the info cache
Nov 02 01:40:14 user nova-compute[74996]: DEBUG nova.network.neutron [req-4e23730f-3e6b-47e4-befc-f7b10029efff req-0e5cc2d4-ef0d-4748-bd4a-cba66f0e3c52 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:40:14 user nova-compute[74996]: DEBUG nova.compute.manager [req-4e23730f-3e6b-47e4-befc-f7b10029efff req-0e5cc2d4-ef0d-4748-bd4a-cba66f0e3c52 service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Detach interface failed, port_id=fbf546f3-964c-4816-84c1-20d11b5ed544, reason: Instance f44d0b13-9dae-40c9-83d0-0b84699b1cc2 could not be found. {{(pid=74996) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 01:40:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e359a5d2-7c2b-4748-8b81-8874f28c43e8 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:40:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e359a5d2-7c2b-4748-8b81-8874f28c43e8 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:40:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:15 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:40:15 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:40:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:40:15 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-e359a5d2-7c2b-4748-8b81-8874f28c43e8 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:40:15 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-e359a5d2-7c2b-4748-8b81-8874f28c43e8 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:40:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e359a5d2-7c2b-4748-8b81-8874f28c43e8 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.179s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:40:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:15 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:40:15 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-e359a5d2-7c2b-4748-8b81-8874f28c43e8 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Deleted allocations for instance f44d0b13-9dae-40c9-83d0-0b84699b1cc2
Nov 02 01:40:15 user nova-compute[74996]: DEBUG nova.compute.manager [req-4d9a175d-4e2d-4060-8155-f7cbda63f032 req-fc19e480-5ca6-4b75-b715-8fb733ca043b service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Received event network-vif-plugged-fbf546f3-964c-4816-84c1-20d11b5ed544 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:40:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4d9a175d-4e2d-4060-8155-f7cbda63f032 req-fc19e480-5ca6-4b75-b715-8fb733ca043b service nova] Acquiring lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:40:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4d9a175d-4e2d-4060-8155-f7cbda63f032 req-fc19e480-5ca6-4b75-b715-8fb733ca043b service nova] Lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:40:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4d9a175d-4e2d-4060-8155-f7cbda63f032 req-fc19e480-5ca6-4b75-b715-8fb733ca043b service nova] Lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:15 user nova-compute[74996]: DEBUG nova.compute.manager [req-4d9a175d-4e2d-4060-8155-f7cbda63f032 req-fc19e480-5ca6-4b75-b715-8fb733ca043b service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] No waiting events found dispatching network-vif-plugged-fbf546f3-964c-4816-84c1-20d11b5ed544 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:40:15 user nova-compute[74996]: WARNING nova.compute.manager [req-4d9a175d-4e2d-4060-8155-f7cbda63f032 req-fc19e480-5ca6-4b75-b715-8fb733ca043b service nova] [instance: f44d0b13-9dae-40c9-83d0-0b84699b1cc2] Received unexpected event network-vif-plugged-fbf546f3-964c-4816-84c1-20d11b5ed544 for instance with vm_state deleted and task_state None.
Nov 02 01:40:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e359a5d2-7c2b-4748-8b81-8874f28c43e8 tempest-TaggedAttachmentsTest-722286534 tempest-TaggedAttachmentsTest-722286534-project-member] Lock "f44d0b13-9dae-40c9-83d0-0b84699b1cc2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.656s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Acquiring lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:40:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:40:16 user nova-compute[74996]: INFO nova.compute.manager [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Detaching volume 93e3e6fa-4c8c-43f0-9138-e4bac5747855
Nov 02 01:40:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:16 user nova-compute[74996]: INFO nova.virt.block_device [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Attempting to driver detach volume 93e3e6fa-4c8c-43f0-9138-e4bac5747855 from mountpoint /dev/vdb
Nov 02 01:40:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Attempting to detach device vdb from instance da10dadd-b04a-4f3b-92bd-fcaa18b51fce from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 01:40:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 01:40:16 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:40:16 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 01:40:16 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:40:16 user nova-compute[74996]:   <serial>93e3e6fa-4c8c-43f0-9138-e4bac5747855</serial>
Nov 02 01:40:16 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 01:40:16 user nova-compute[74996]: </disk>
Nov 02 01:40:16 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:40:16 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Successfully detached device vdb from instance da10dadd-b04a-4f3b-92bd-fcaa18b51fce from the persistent domain config.
Nov 02 01:40:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance da10dadd-b04a-4f3b-92bd-fcaa18b51fce from the live domain config. {{(pid=74996) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 01:40:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 01:40:16 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:40:16 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 01:40:16 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:40:16 user nova-compute[74996]:   <serial>93e3e6fa-4c8c-43f0-9138-e4bac5747855</serial>
Nov 02 01:40:16 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 01:40:16 user nova-compute[74996]: </disk>
Nov 02 01:40:16 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:40:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:40:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:40:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance da10dadd-b04a-4f3b-92bd-fcaa18b51fce {{(pid=74996) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 01:40:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:18 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:40:18 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:40:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8048MB free_disk=25.281368255615234GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:40:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:40:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:40:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance fea802b7-64d9-4c77-87a7-eaba1dce5c22 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:40:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7307f3a3-1ad1-43f7-be49-9cd03a626cd7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:40:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 6b79aa2f-02c7-492e-b27e-7481e41f8d2c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:40:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance d8f51f7d-c9de-4914-883e-7a875d3d73ad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:40:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance da10dadd-b04a-4f3b-92bd-fcaa18b51fce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:40:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 9d706c1a-883b-4b26-8972-4083df064e93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:40:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 3b5719c9-08ad-4a01-b960-23328b537283 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:40:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:40:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:40:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:18 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:40:18 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:40:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:40:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.794s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:18 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:40:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e7c94475-0a99-4111-8bee-b5723293fc43 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "6b79aa2f-02c7-492e-b27e-7481e41f8d2c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:40:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e7c94475-0a99-4111-8bee-b5723293fc43 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "6b79aa2f-02c7-492e-b27e-7481e41f8d2c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:40:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e7c94475-0a99-4111-8bee-b5723293fc43 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "6b79aa2f-02c7-492e-b27e-7481e41f8d2c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:40:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e7c94475-0a99-4111-8bee-b5723293fc43 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "6b79aa2f-02c7-492e-b27e-7481e41f8d2c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:40:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e7c94475-0a99-4111-8bee-b5723293fc43 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "6b79aa2f-02c7-492e-b27e-7481e41f8d2c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:19 user nova-compute[74996]: INFO nova.compute.manager [None req-e7c94475-0a99-4111-8bee-b5723293fc43 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Terminating instance
Nov 02 01:40:19 user nova-compute[74996]: DEBUG nova.compute.manager [None req-e7c94475-0a99-4111-8bee-b5723293fc43 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:40:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:19 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:40:19 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:40:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:19 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Instance destroyed successfully.
Nov 02 01:40:19 user nova-compute[74996]: DEBUG nova.objects.instance [None req-e7c94475-0a99-4111-8bee-b5723293fc43 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lazy-loading 'resources' on Instance uuid 6b79aa2f-02c7-492e-b27e-7481e41f8d2c {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:40:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-e7c94475-0a99-4111-8bee-b5723293fc43 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:34:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1815344306',display_name='tempest-AttachVolumeNegativeTest-server-1815344306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1815344306',id=13,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrpZWG4nOYTSLSUhU3pnNIr1LyK1MTKi3nNDiAjRCbp01rFzM+gqyUZoDGf8eHvyP7m0hpX7Ua/m6xcBvZ8oWAqIPU6ouLWb5U64a4B0P+Fux7I+UisdXLd4qL0xJ0aAQ==',key_name='tempest-keypair-570593061',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:34:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b6b2c4a38374459b73fa76b8dde9db4',ramdisk_id='',reservation_id='r-63dnctsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1395123327',owner_user_name='tempest-AttachVolumeNegativeTest-1395123327-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:34:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='700d6c84a40547e99f3e364d6447ad4e',uuid=6b79aa2f-02c7-492e-b27e-7481e41f8d2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eed60db2-70ab-4fd5-aa15-91c391740d1d", "address": "fa:16:3e:16:c6:b4", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed60db2-70", "ovs_interfaceid": "eed60db2-70ab-4fd5-aa15-91c391740d1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:40:19 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-e7c94475-0a99-4111-8bee-b5723293fc43 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Converting VIF {"id": "eed60db2-70ab-4fd5-aa15-91c391740d1d", "address": "fa:16:3e:16:c6:b4", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeed60db2-70", "ovs_interfaceid": "eed60db2-70ab-4fd5-aa15-91c391740d1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:40:19 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-e7c94475-0a99-4111-8bee-b5723293fc43 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:c6:b4,bridge_name='br-int',has_traffic_filtering=True,id=eed60db2-70ab-4fd5-aa15-91c391740d1d,network=Network(d18bfd38-1454-4665-a175-2c7d0e2002ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeed60db2-70') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:40:19 user nova-compute[74996]: DEBUG os_vif [None req-e7c94475-0a99-4111-8bee-b5723293fc43 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:c6:b4,bridge_name='br-int',has_traffic_filtering=True,id=eed60db2-70ab-4fd5-aa15-91c391740d1d,network=Network(d18bfd38-1454-4665-a175-2c7d0e2002ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeed60db2-70') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:40:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeed60db2-70, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:40:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:40:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=513fd3a4-a7e3-469a-a763-d170eddf15b5) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:40:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:40:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:20 user nova-compute[74996]: INFO os_vif [None req-e7c94475-0a99-4111-8bee-b5723293fc43 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:c6:b4,bridge_name='br-int',has_traffic_filtering=True,id=eed60db2-70ab-4fd5-aa15-91c391740d1d,network=Network(d18bfd38-1454-4665-a175-2c7d0e2002ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeed60db2-70')
Nov 02 01:40:20 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-e7c94475-0a99-4111-8bee-b5723293fc43 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Deleting instance files /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c_del
Nov 02 01:40:20 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-e7c94475-0a99-4111-8bee-b5723293fc43 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Deletion of /opt/stack/data/nova/instances/6b79aa2f-02c7-492e-b27e-7481e41f8d2c_del complete
Nov 02 01:40:20 user nova-compute[74996]: INFO nova.compute.manager [None req-e7c94475-0a99-4111-8bee-b5723293fc43 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 02 01:40:20 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-e7c94475-0a99-4111-8bee-b5723293fc43 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:40:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-d8f51f7d-c9de-4914-883e-7a875d3d73ad" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:40:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-d8f51f7d-c9de-4914-883e-7a875d3d73ad" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:40:20 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 01:40:20 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:40:20 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:40:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:21 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Updating instance_info_cache with network_info: [{"id": "d0ea7655-29c6-450a-b2df-f2554925c3a5", "address": "fa:16:3e:0d:f1:d9", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7655-29", "ovs_interfaceid": "d0ea7655-29c6-450a-b2df-f2554925c3a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:40:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-d8f51f7d-c9de-4914-883e-7a875d3d73ad" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:40:21 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 01:40:21 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:40:21 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:40:21 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:40:21 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:40:21 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Took 1.21 seconds to deallocate network for instance.
Nov 02 01:40:21 user nova-compute[74996]: DEBUG nova.compute.manager [req-56e91cee-4a4a-4277-87be-804061ed5ea9 req-40adc0aa-4715-48c3-b5d4-d5f311d2f446 service nova] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Received event network-vif-deleted-eed60db2-70ab-4fd5-aa15-91c391740d1d {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:40:21 user nova-compute[74996]: INFO nova.compute.manager [req-56e91cee-4a4a-4277-87be-804061ed5ea9 req-40adc0aa-4715-48c3-b5d4-d5f311d2f446 service nova] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Neutron deleted interface eed60db2-70ab-4fd5-aa15-91c391740d1d; detaching it from the instance and deleting it from the info cache
Nov 02 01:40:21 user nova-compute[74996]: DEBUG nova.network.neutron [req-56e91cee-4a4a-4277-87be-804061ed5ea9 req-40adc0aa-4715-48c3-b5d4-d5f311d2f446 service nova] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:40:21 user nova-compute[74996]: DEBUG nova.compute.manager [req-56e91cee-4a4a-4277-87be-804061ed5ea9 req-40adc0aa-4715-48c3-b5d4-d5f311d2f446 service nova] [instance: 6b79aa2f-02c7-492e-b27e-7481e41f8d2c] Detach interface failed, port_id=eed60db2-70ab-4fd5-aa15-91c391740d1d, reason: Instance 6b79aa2f-02c7-492e-b27e-7481e41f8d2c could not be found. {{(pid=74996) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 01:40:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e7c94475-0a99-4111-8bee-b5723293fc43 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:40:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e7c94475-0a99-4111-8bee-b5723293fc43 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:40:21 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-e7c94475-0a99-4111-8bee-b5723293fc43 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:40:21 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-e7c94475-0a99-4111-8bee-b5723293fc43 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:40:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e7c94475-0a99-4111-8bee-b5723293fc43 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:21 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-e7c94475-0a99-4111-8bee-b5723293fc43 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Deleted allocations for instance 6b79aa2f-02c7-492e-b27e-7481e41f8d2c
Nov 02 01:40:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e7c94475-0a99-4111-8bee-b5723293fc43 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "6b79aa2f-02c7-492e-b27e-7481e41f8d2c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.768s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Acquiring lock "f0de5980-334b-4654-8b1a-88c4c861aa49" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:40:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:40:22 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:40:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:40:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:40:22 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:40:22 user nova-compute[74996]: INFO nova.compute.claims [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Claim successful on node user
Nov 02 01:40:22 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:40:22 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:40:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.729s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:22 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:40:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:23 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:40:23 user nova-compute[74996]: DEBUG nova.network.neutron [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:40:23 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:40:23 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:40:23 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:40:23 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Cleaning up deleted instances {{(pid=74996) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 01:40:23 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] There are 0 instances to clean {{(pid=74996) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 01:40:23 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:40:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:40:23 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Creating image(s)
Nov 02 01:40:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:40:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "/opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:40:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "/opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:23 user nova-compute[74996]: DEBUG nova.policy [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b023d5c4fe1e45a6a4594cdd303a352f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9cafad1855f4b3b98cba6bb24f7562b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:40:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.211s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:40:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:40:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.229s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk 1073741824" returned: 0 in 0.061s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.246s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:24 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:40:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:24 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Cannot resize image /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:40:24 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:40:24 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Ensure instance console log exists: /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:40:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:40:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:40:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:24 user nova-compute[74996]: DEBUG nova.network.neutron [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Successfully created port: a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.network.neutron [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Successfully updated port: a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Acquiring lock "refresh_cache-f0de5980-334b-4654-8b1a-88c4c861aa49" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Acquired lock "refresh_cache-f0de5980-334b-4654-8b1a-88c4c861aa49" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.network.neutron [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.compute.manager [req-0faba028-3f2e-44ca-887f-4497142657f2 req-7121cc9f-495b-4670-a047-3f0b1514a922 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Received event network-changed-a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.compute.manager [req-0faba028-3f2e-44ca-887f-4497142657f2 req-7121cc9f-495b-4670-a047-3f0b1514a922 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Refreshing instance network info cache due to event network-changed-a8fe6401-b45e-4c64-b975-963eeecc7516. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0faba028-3f2e-44ca-887f-4497142657f2 req-7121cc9f-495b-4670-a047-3f0b1514a922 service nova] Acquiring lock "refresh_cache-f0de5980-334b-4654-8b1a-88c4c861aa49" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.network.neutron [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.network.neutron [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Updating instance_info_cache with network_info: [{"id": "a8fe6401-b45e-4c64-b975-963eeecc7516", "address": "fa:16:3e:02:4b:04", "network": {"id": "7de1ec81-4bf0-4099-a317-52e3c4b64f4e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-840004831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cafad1855f4b3b98cba6bb24f7562b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8fe6401-b4", "ovs_interfaceid": "a8fe6401-b45e-4c64-b975-963eeecc7516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Releasing lock "refresh_cache-f0de5980-334b-4654-8b1a-88c4c861aa49" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Instance network_info: |[{"id": "a8fe6401-b45e-4c64-b975-963eeecc7516", "address": "fa:16:3e:02:4b:04", "network": {"id": "7de1ec81-4bf0-4099-a317-52e3c4b64f4e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-840004831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cafad1855f4b3b98cba6bb24f7562b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8fe6401-b4", "ovs_interfaceid": "a8fe6401-b45e-4c64-b975-963eeecc7516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0faba028-3f2e-44ca-887f-4497142657f2 req-7121cc9f-495b-4670-a047-3f0b1514a922 service nova] Acquired lock "refresh_cache-f0de5980-334b-4654-8b1a-88c4c861aa49" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.network.neutron [req-0faba028-3f2e-44ca-887f-4497142657f2 req-7121cc9f-495b-4670-a047-3f0b1514a922 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Refreshing network info cache for port a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Start _get_guest_xml network_info=[{"id": "a8fe6401-b45e-4c64-b975-963eeecc7516", "address": "fa:16:3e:02:4b:04", "network": {"id": "7de1ec81-4bf0-4099-a317-52e3c4b64f4e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-840004831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cafad1855f4b3b98cba6bb24f7562b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8fe6401-b4", "ovs_interfaceid": "a8fe6401-b45e-4c64-b975-963eeecc7516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:40:25 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:40:25 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1625581851',display_name='tempest-ServerStableDeviceRescueTest-server-1625581851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1625581851',id=23,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEK8Sx58tlmlBIUf+BUgUFMWnLbDRHHFCCjwrW+5A7V6+CJXFa4iqA+tn8c5R1h1LqApc/K3DXH7VI97JPeKjgNFqdRaZxPpdxRt/kUhiGhAn5AGwQVIOmuoVwNFfaET8w==',key_name='tempest-keypair-2039863911',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9cafad1855f4b3b98cba6bb24f7562b',ramdisk_id='',reservation_id='r-s6tn81gr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1201179668',owner_user_name='tempest-ServerStableDeviceRescueTest-1201179668-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b023d5c4fe1e45a6a4594cdd303a352f',uuid=f0de5980-334b-4654-8b1a-88c4c861aa49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8fe6401-b45e-4c64-b975-963eeecc7516", "address": "fa:16:3e:02:4b:04", "network": {"id": "7de1ec81-4bf0-4099-a317-52e3c4b64f4e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-840004831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cafad1855f4b3b98cba6bb24f7562b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8fe6401-b4", "ovs_interfaceid": "a8fe6401-b45e-4c64-b975-963eeecc7516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Converting VIF {"id": "a8fe6401-b45e-4c64-b975-963eeecc7516", "address": "fa:16:3e:02:4b:04", "network": {"id": "7de1ec81-4bf0-4099-a317-52e3c4b64f4e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-840004831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cafad1855f4b3b98cba6bb24f7562b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8fe6401-b4", "ovs_interfaceid": "a8fe6401-b45e-4c64-b975-963eeecc7516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:4b:04,bridge_name='br-int',has_traffic_filtering=True,id=a8fe6401-b45e-4c64-b975-963eeecc7516,network=Network(7de1ec81-4bf0-4099-a317-52e3c4b64f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8fe6401-b4') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.objects.instance [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lazy-loading 'pci_devices' on Instance uuid f0de5980-334b-4654-8b1a-88c4c861aa49 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:40:25 user nova-compute[74996]:   <uuid>f0de5980-334b-4654-8b1a-88c4c861aa49</uuid>
Nov 02 01:40:25 user nova-compute[74996]:   <name>instance-00000017</name>
Nov 02 01:40:25 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:40:25 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:40:25 user nova-compute[74996]:   <metadata>
Nov 02 01:40:25 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:40:25 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:40:25 user nova-compute[74996]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1625581851</nova:name>
Nov 02 01:40:25 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:40:25</nova:creationTime>
Nov 02 01:40:25 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:40:25 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:40:25 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:40:25 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:40:25 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:40:25 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:40:25 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:40:25 user nova-compute[74996]:       <nova:owner>
Nov 02 01:40:25 user nova-compute[74996]:         <nova:user uuid="b023d5c4fe1e45a6a4594cdd303a352f">tempest-ServerStableDeviceRescueTest-1201179668-project-member</nova:user>
Nov 02 01:40:25 user nova-compute[74996]:         <nova:project uuid="d9cafad1855f4b3b98cba6bb24f7562b">tempest-ServerStableDeviceRescueTest-1201179668</nova:project>
Nov 02 01:40:25 user nova-compute[74996]:       </nova:owner>
Nov 02 01:40:25 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:40:25 user nova-compute[74996]:       <nova:ports>
Nov 02 01:40:25 user nova-compute[74996]:         <nova:port uuid="a8fe6401-b45e-4c64-b975-963eeecc7516">
Nov 02 01:40:25 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 02 01:40:25 user nova-compute[74996]:         </nova:port>
Nov 02 01:40:25 user nova-compute[74996]:       </nova:ports>
Nov 02 01:40:25 user nova-compute[74996]:     </nova:instance>
Nov 02 01:40:25 user nova-compute[74996]:   </metadata>
Nov 02 01:40:25 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:40:25 user nova-compute[74996]:     <system>
Nov 02 01:40:25 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:40:25 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:40:25 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:40:25 user nova-compute[74996]:       <entry name="serial">f0de5980-334b-4654-8b1a-88c4c861aa49</entry>
Nov 02 01:40:25 user nova-compute[74996]:       <entry name="uuid">f0de5980-334b-4654-8b1a-88c4c861aa49</entry>
Nov 02 01:40:25 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:40:25 user nova-compute[74996]:     </system>
Nov 02 01:40:25 user nova-compute[74996]:   </sysinfo>
Nov 02 01:40:25 user nova-compute[74996]:   <os>
Nov 02 01:40:25 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:40:25 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:40:25 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:40:25 user nova-compute[74996]:   </os>
Nov 02 01:40:25 user nova-compute[74996]:   <features>
Nov 02 01:40:25 user nova-compute[74996]:     <acpi/>
Nov 02 01:40:25 user nova-compute[74996]:     <apic/>
Nov 02 01:40:25 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:40:25 user nova-compute[74996]:   </features>
Nov 02 01:40:25 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:40:25 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:40:25 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:40:25 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:40:25 user nova-compute[74996]:   </clock>
Nov 02 01:40:25 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:40:25 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:40:25 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:40:25 user nova-compute[74996]:   </cpu>
Nov 02 01:40:25 user nova-compute[74996]:   <devices>
Nov 02 01:40:25 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:40:25 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:40:25 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk"/>
Nov 02 01:40:25 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:40:25 user nova-compute[74996]:     </disk>
Nov 02 01:40:25 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:40:25 user nova-compute[74996]:       <mac address="fa:16:3e:02:4b:04"/>
Nov 02 01:40:25 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:40:25 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:40:25 user nova-compute[74996]:       <target dev="tapa8fe6401-b4"/>
Nov 02 01:40:25 user nova-compute[74996]:     </interface>
Nov 02 01:40:25 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:40:25 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/console.log" append="off"/>
Nov 02 01:40:25 user nova-compute[74996]:     </serial>
Nov 02 01:40:25 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:40:25 user nova-compute[74996]:     <video>
Nov 02 01:40:25 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:40:25 user nova-compute[74996]:     </video>
Nov 02 01:40:25 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:40:25 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:40:25 user nova-compute[74996]:     </rng>
Nov 02 01:40:25 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:40:25 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:40:25 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:40:25 user nova-compute[74996]:     </memballoon>
Nov 02 01:40:25 user nova-compute[74996]:   </devices>
Nov 02 01:40:25 user nova-compute[74996]: </domain>
Nov 02 01:40:25 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1625581851',display_name='tempest-ServerStableDeviceRescueTest-server-1625581851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1625581851',id=23,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEK8Sx58tlmlBIUf+BUgUFMWnLbDRHHFCCjwrW+5A7V6+CJXFa4iqA+tn8c5R1h1LqApc/K3DXH7VI97JPeKjgNFqdRaZxPpdxRt/kUhiGhAn5AGwQVIOmuoVwNFfaET8w==',key_name='tempest-keypair-2039863911',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9cafad1855f4b3b98cba6bb24f7562b',ramdisk_id='',reservation_id='r-s6tn81gr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1201179668',owner_user_name='tempest-ServerStableDeviceRescueTest-1201179668-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b023d5c4fe1e45a6a4594cdd303a352f',uuid=f0de5980-334b-4654-8b1a-88c4c861aa49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8fe6401-b45e-4c64-b975-963eeecc7516", "address": "fa:16:3e:02:4b:04", "network": {"id": "7de1ec81-4bf0-4099-a317-52e3c4b64f4e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-840004831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cafad1855f4b3b98cba6bb24f7562b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8fe6401-b4", "ovs_interfaceid": "a8fe6401-b45e-4c64-b975-963eeecc7516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Converting VIF {"id": "a8fe6401-b45e-4c64-b975-963eeecc7516", "address": "fa:16:3e:02:4b:04", "network": {"id": "7de1ec81-4bf0-4099-a317-52e3c4b64f4e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-840004831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cafad1855f4b3b98cba6bb24f7562b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8fe6401-b4", "ovs_interfaceid": "a8fe6401-b45e-4c64-b975-963eeecc7516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:4b:04,bridge_name='br-int',has_traffic_filtering=True,id=a8fe6401-b45e-4c64-b975-963eeecc7516,network=Network(7de1ec81-4bf0-4099-a317-52e3c4b64f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8fe6401-b4') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG os_vif [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:4b:04,bridge_name='br-int',has_traffic_filtering=True,id=a8fe6401-b45e-4c64-b975-963eeecc7516,network=Network(7de1ec81-4bf0-4099-a317-52e3c4b64f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8fe6401-b4') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c11e7f96-88db-59cf-a5d5-159a831dc03d', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8fe6401-b4, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8fe6401-b4, col_values=(('qos', UUID('98d29ed1-2d4b-41f3-8b1f-7d9eac0b430b')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8fe6401-b4, col_values=(('external_ids', {'iface-id': 'a8fe6401-b45e-4c64-b975-963eeecc7516', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:4b:04', 'vm-uuid': 'f0de5980-334b-4654-8b1a-88c4c861aa49'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:25 user nova-compute[74996]: INFO os_vif [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:4b:04,bridge_name='br-int',has_traffic_filtering=True,id=a8fe6401-b45e-4c64-b975-963eeecc7516,network=Network(7de1ec81-4bf0-4099-a317-52e3c4b64f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8fe6401-b4')
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:40:25 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] No VIF found with MAC fa:16:3e:02:4b:04, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:40:26 user nova-compute[74996]: DEBUG nova.network.neutron [req-0faba028-3f2e-44ca-887f-4497142657f2 req-7121cc9f-495b-4670-a047-3f0b1514a922 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Updated VIF entry in instance network info cache for port a8fe6401-b45e-4c64-b975-963eeecc7516. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:40:26 user nova-compute[74996]: DEBUG nova.network.neutron [req-0faba028-3f2e-44ca-887f-4497142657f2 req-7121cc9f-495b-4670-a047-3f0b1514a922 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Updating instance_info_cache with network_info: [{"id": "a8fe6401-b45e-4c64-b975-963eeecc7516", "address": "fa:16:3e:02:4b:04", "network": {"id": "7de1ec81-4bf0-4099-a317-52e3c4b64f4e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-840004831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cafad1855f4b3b98cba6bb24f7562b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8fe6401-b4", "ovs_interfaceid": "a8fe6401-b45e-4c64-b975-963eeecc7516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:40:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0faba028-3f2e-44ca-887f-4497142657f2 req-7121cc9f-495b-4670-a047-3f0b1514a922 service nova] Releasing lock "refresh_cache-f0de5980-334b-4654-8b1a-88c4c861aa49" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:40:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:27 user nova-compute[74996]: DEBUG nova.compute.manager [req-2520dcf4-176c-42c0-8d4d-bc3d4ebe5671 req-b5b17c7b-2467-41cd-89df-3ffbac75b625 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Received event network-vif-plugged-a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:40:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2520dcf4-176c-42c0-8d4d-bc3d4ebe5671 req-b5b17c7b-2467-41cd-89df-3ffbac75b625 service nova] Acquiring lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:40:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2520dcf4-176c-42c0-8d4d-bc3d4ebe5671 req-b5b17c7b-2467-41cd-89df-3ffbac75b625 service nova] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:40:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2520dcf4-176c-42c0-8d4d-bc3d4ebe5671 req-b5b17c7b-2467-41cd-89df-3ffbac75b625 service nova] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:27 user nova-compute[74996]: DEBUG nova.compute.manager [req-2520dcf4-176c-42c0-8d4d-bc3d4ebe5671 req-b5b17c7b-2467-41cd-89df-3ffbac75b625 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] No waiting events found dispatching network-vif-plugged-a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:40:27 user nova-compute[74996]: WARNING nova.compute.manager [req-2520dcf4-176c-42c0-8d4d-bc3d4ebe5671 req-b5b17c7b-2467-41cd-89df-3ffbac75b625 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Received unexpected event network-vif-plugged-a8fe6401-b45e-4c64-b975-963eeecc7516 for instance with vm_state building and task_state spawning.
Nov 02 01:40:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:29 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:40:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:40:29 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Instance spawned successfully.
Nov 02 01:40:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:40:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:40:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:40:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:40:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:40:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:40:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:40:29 user nova-compute[74996]: DEBUG nova.compute.manager [req-f6b9c6c3-7a54-44f1-ac30-be7388fc23f6 req-ea844e5f-4837-4db9-8066-b19e00e9d2fe service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Received event network-vif-plugged-a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:40:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f6b9c6c3-7a54-44f1-ac30-be7388fc23f6 req-ea844e5f-4837-4db9-8066-b19e00e9d2fe service nova] Acquiring lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:40:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f6b9c6c3-7a54-44f1-ac30-be7388fc23f6 req-ea844e5f-4837-4db9-8066-b19e00e9d2fe service nova] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:40:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f6b9c6c3-7a54-44f1-ac30-be7388fc23f6 req-ea844e5f-4837-4db9-8066-b19e00e9d2fe service nova] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:29 user nova-compute[74996]: DEBUG nova.compute.manager [req-f6b9c6c3-7a54-44f1-ac30-be7388fc23f6 req-ea844e5f-4837-4db9-8066-b19e00e9d2fe service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] No waiting events found dispatching network-vif-plugged-a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:40:29 user nova-compute[74996]: WARNING nova.compute.manager [req-f6b9c6c3-7a54-44f1-ac30-be7388fc23f6 req-ea844e5f-4837-4db9-8066-b19e00e9d2fe service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Received unexpected event network-vif-plugged-a8fe6401-b45e-4c64-b975-963eeecc7516 for instance with vm_state building and task_state spawning.
Nov 02 01:40:30 user nova-compute[74996]: INFO nova.compute.manager [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Took 6.78 seconds to spawn the instance on the hypervisor.
Nov 02 01:40:30 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:40:30 user nova-compute[74996]: INFO nova.compute.manager [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Took 7.97 seconds to build instance.
Nov 02 01:40:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1cd41157-fdb8-43a2-8926-81bd5695c676 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.076s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:30 user nova-compute[74996]: INFO nova.compute.manager [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Rescuing
Nov 02 01:40:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "refresh_cache-9d706c1a-883b-4b26-8972-4083df064e93" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:40:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquired lock "refresh_cache-9d706c1a-883b-4b26-8972-4083df064e93" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:40:30 user nova-compute[74996]: DEBUG nova.network.neutron [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:40:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:31 user nova-compute[74996]: DEBUG nova.network.neutron [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Updating instance_info_cache with network_info: [{"id": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "address": "fa:16:3e:f0:bd:77", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9071ad51-8c", "ovs_interfaceid": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:40:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Releasing lock "refresh_cache-9d706c1a-883b-4b26-8972-4083df064e93" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:40:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:32 user nova-compute[74996]: DEBUG nova.compute.manager [req-7a7828ab-3016-4f1d-97f6-7d770f448bac req-d8b23eeb-8530-4410-863c-2684f8d9a884 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Received event network-vif-unplugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:40:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7a7828ab-3016-4f1d-97f6-7d770f448bac req-d8b23eeb-8530-4410-863c-2684f8d9a884 service nova] Acquiring lock "9d706c1a-883b-4b26-8972-4083df064e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:40:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7a7828ab-3016-4f1d-97f6-7d770f448bac req-d8b23eeb-8530-4410-863c-2684f8d9a884 service nova] Lock "9d706c1a-883b-4b26-8972-4083df064e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:40:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7a7828ab-3016-4f1d-97f6-7d770f448bac req-d8b23eeb-8530-4410-863c-2684f8d9a884 service nova] Lock "9d706c1a-883b-4b26-8972-4083df064e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:32 user nova-compute[74996]: DEBUG nova.compute.manager [req-7a7828ab-3016-4f1d-97f6-7d770f448bac req-d8b23eeb-8530-4410-863c-2684f8d9a884 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] No waiting events found dispatching network-vif-unplugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:40:32 user nova-compute[74996]: WARNING nova.compute.manager [req-7a7828ab-3016-4f1d-97f6-7d770f448bac req-d8b23eeb-8530-4410-863c-2684f8d9a884 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Received unexpected event network-vif-unplugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c for instance with vm_state active and task_state rescuing.
Nov 02 01:40:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:32 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Instance destroyed successfully.
Nov 02 01:40:32 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Attempting a stable device rescue
Nov 02 01:40:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74996) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 02 01:40:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Instance directory exists: not creating {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 01:40:32 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Creating image(s)
Nov 02 01:40:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "/opt/stack/data/nova/instances/9d706c1a-883b-4b26-8972-4083df064e93/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:40:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "/opt/stack/data/nova/instances/9d706c1a-883b-4b26-8972-4083df064e93/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:40:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "/opt/stack/data/nova/instances/9d706c1a-883b-4b26-8972-4083df064e93/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:32 user nova-compute[74996]: DEBUG nova.objects.instance [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9d706c1a-883b-4b26-8972-4083df064e93 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:40:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "26666f56e17f51b88dab0cd41224b323e1307080" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:40:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "26666f56e17f51b88dab0cd41224b323e1307080" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:40:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26666f56e17f51b88dab0cd41224b323e1307080.part --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26666f56e17f51b88dab0cd41224b323e1307080.part --force-share --output=json" returned: 0 in 0.245s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:34 user nova-compute[74996]: DEBUG nova.virt.images [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] 3963cf19-4dba-4571-9cab-63650722d529 was qcow2, converting to raw {{(pid=74996) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 01:40:34 user nova-compute[74996]: DEBUG nova.privsep.utils [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74996) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 01:40:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/26666f56e17f51b88dab0cd41224b323e1307080.part /opt/stack/data/nova/instances/_base/26666f56e17f51b88dab0cd41224b323e1307080.converted {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:34 user nova-compute[74996]: DEBUG nova.compute.manager [req-a78bd351-92c7-417a-8ff8-e73659780a39 req-8059ef4c-f3d5-49d2-8869-1c73d9f2d49f service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Received event network-vif-plugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:40:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a78bd351-92c7-417a-8ff8-e73659780a39 req-8059ef4c-f3d5-49d2-8869-1c73d9f2d49f service nova] Acquiring lock "9d706c1a-883b-4b26-8972-4083df064e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:40:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a78bd351-92c7-417a-8ff8-e73659780a39 req-8059ef4c-f3d5-49d2-8869-1c73d9f2d49f service nova] Lock "9d706c1a-883b-4b26-8972-4083df064e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:40:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a78bd351-92c7-417a-8ff8-e73659780a39 req-8059ef4c-f3d5-49d2-8869-1c73d9f2d49f service nova] Lock "9d706c1a-883b-4b26-8972-4083df064e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:34 user nova-compute[74996]: DEBUG nova.compute.manager [req-a78bd351-92c7-417a-8ff8-e73659780a39 req-8059ef4c-f3d5-49d2-8869-1c73d9f2d49f service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] No waiting events found dispatching network-vif-plugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:40:34 user nova-compute[74996]: WARNING nova.compute.manager [req-a78bd351-92c7-417a-8ff8-e73659780a39 req-8059ef4c-f3d5-49d2-8869-1c73d9f2d49f service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Received unexpected event network-vif-plugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c for instance with vm_state active and task_state rescuing.
Nov 02 01:40:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/26666f56e17f51b88dab0cd41224b323e1307080.part /opt/stack/data/nova/instances/_base/26666f56e17f51b88dab0cd41224b323e1307080.converted" returned: 0 in 0.540s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26666f56e17f51b88dab0cd41224b323e1307080.converted --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26666f56e17f51b88dab0cd41224b323e1307080.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "26666f56e17f51b88dab0cd41224b323e1307080" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.110s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "26666f56e17f51b88dab0cd41224b323e1307080" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:40:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "26666f56e17f51b88dab0cd41224b323e1307080" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:40:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26666f56e17f51b88dab0cd41224b323e1307080 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/26666f56e17f51b88dab0cd41224b323e1307080 --force-share --output=json" returned: 0 in 0.213s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/26666f56e17f51b88dab0cd41224b323e1307080,backing_fmt=raw /opt/stack/data/nova/instances/9d706c1a-883b-4b26-8972-4083df064e93/disk.rescue {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/26666f56e17f51b88dab0cd41224b323e1307080,backing_fmt=raw /opt/stack/data/nova/instances/9d706c1a-883b-4b26-8972-4083df064e93/disk.rescue" returned: 0 in 0.057s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "26666f56e17f51b88dab0cd41224b323e1307080" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.objects.instance [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lazy-loading 'migration_context' on Instance uuid 9d706c1a-883b-4b26-8972-4083df064e93 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.objects.base [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Object Instance<9d706c1a-883b-4b26-8972-4083df064e93> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Start _get_guest_xml network_info=[{"id": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "address": "fa:16:3e:f0:bd:77", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "vif_mac": "fa:16:3e:f0:bd:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9071ad51-8c", "ovs_interfaceid": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3963cf19-4dba-4571-9cab-63650722d529', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6b6832f4-84cf-4ea0-8baa-75ff12d655d8', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEHAcMyI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '9d706c1a-883b-4b26-8972-4083df064e93', 'attached_at': '', 'detached_at': '', 'volume_id': '056998b8-61e1-46e5-b497-c0ee61ae9ff7', 'serial': '056998b8-61e1-46e5-b497-c0ee61ae9ff7'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.objects.instance [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lazy-loading 'resources' on Instance uuid 9d706c1a-883b-4b26-8972-4083df064e93 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.objects.base [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Object Instance<9d706c1a-883b-4b26-8972-4083df064e93> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.objects.instance [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lazy-loading 'numa_topology' on Instance uuid 9d706c1a-883b-4b26-8972-4083df064e93 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.objects.base [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Object Instance<9d706c1a-883b-4b26-8972-4083df064e93> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:40:35 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:40:35 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.objects.instance [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9d706c1a-883b-4b26-8972-4083df064e93 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.objects.base [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Object Instance<9d706c1a-883b-4b26-8972-4083df064e93> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEHAcMyI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:40:35 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:40:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:40:35 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:40:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:40:35 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:40:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a5eeaf-3204-4043-bb80-800db0c119a4]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = DEHAcMyI\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 02 01:40:35 user nova-compute[74996]: node.name = iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7
Nov 02 01:40:35 user nova-compute[74996]: node.tpgt = -1
Nov 02 01:40:35 user nova-compute[74996]: node.startup = automatic
Nov 02 01:40:35 user nova-compute[74996]: node.leading_login = No
Nov 02 01:40:35 user nova-compute[74996]: iface.iscsi_ifacename = default
Nov 02 01:40:35 user nova-compute[74996]: iface.net_ifacename = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.ipaddress = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.prefix_len = 0
Nov 02 01:40:35 user nova-compute[74996]: iface.hwaddress = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.transport_name = tcp
Nov 02 01:40:35 user nova-compute[74996]: iface.initiatorname = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.state = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.vlan_id = 0
Nov 02 01:40:35 user nova-compute[74996]: iface.vlan_priority = 0
Nov 02 01:40:35 user nova-compute[74996]: iface.vlan_state = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.iface_num = 0
Nov 02 01:40:35 user nova-compute[74996]: iface.mtu = 0
Nov 02 01:40:35 user nova-compute[74996]: iface.port = 0
Nov 02 01:40:35 user nova-compute[74996]: iface.bootproto = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.subnet_mask = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.gateway = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.dhcp_alt_client_id_state = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.dhcp_alt_client_id = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.dhcp_dns = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.dhcp_learn_iqn = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.dhcp_req_vendor_id_state = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.dhcp_vendor_id_state = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.dhcp_vendor_id = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.dhcp_slp_da = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.fragmentation = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.gratuitous_arp = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.incoming_forwarding = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.tos_state = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.tos = 0
Nov 02 01:40:35 user nova-compute[74996]: iface.ttl = 0
Nov 02 01:40:35 user nova-compute[74996]: iface.delayed_ack = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.tcp_nagle = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.tcp_wsf_state = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.tcp_wsf = 0
Nov 02 01:40:35 user nova-compute[74996]: iface.tcp_timer_scale = 0
Nov 02 01:40:35 user nova-compute[74996]: iface.tcp_timestamp = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.redirect = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.def_task_mgmt_timeout = 0
Nov 02 01:40:35 user nova-compute[74996]: iface.header_digest = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.data_digest = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.immediate_data = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.initial_r2t = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.data_seq_inorder = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.data_pdu_inorder = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.erl = 0
Nov 02 01:40:35 user nova-compute[74996]: iface.max_receive_data_len = 0
Nov 02 01:40:35 user nova-compute[74996]: iface.first_burst_len = 0
Nov 02 01:40:35 user nova-compute[74996]: iface.max_outstanding_r2t = 0
Nov 02 01:40:35 user nova-compute[74996]: iface.max_burst_len = 0
Nov 02 01:40:35 user nova-compute[74996]: iface.chap_auth = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.bidi_chap = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.strict_login_compliance = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.discovery_auth = <empty>
Nov 02 01:40:35 user nova-compute[74996]: iface.discovery_logout = <empty>
Nov 02 01:40:35 user nova-compute[74996]: node.discovery_address = <empty>
Nov 02 01:40:35 user nova-compute[74996]: node.discovery_port = 0
Nov 02 01:40:35 user nova-compute[74996]: node.discovery_type = static
Nov 02 01:40:35 user nova-compute[74996]: node.session.initial_cmdsn = 0
Nov 02 01:40:35 user nova-compute[74996]: node.session.initial_login_retry_max = 8
Nov 02 01:40:35 user nova-compute[74996]: node.session.xmit_thread_priority = -20
Nov 02 01:40:35 user nova-compute[74996]: node.session.cmds_max = 128
Nov 02 01:40:35 user nova-compute[74996]: node.session.queue_depth = 32
Nov 02 01:40:35 user nova-compute[74996]: node.session.nr_sessions = 1
Nov 02 01:40:35 user nova-compute[74996]: node.session.auth.authmethod = CHAP
Nov 02 01:40:35 user nova-compute[74996]: node.session.auth.username = DEHAcMyI
Nov 02 01:40:35 user nova-compute[74996]: node.session.auth.password = ***
Nov 02 01:40:35 user nova-compute[74996]: node.session.auth.username_in = <empty>
Nov 02 01:40:35 user nova-compute[74996]: node.session.auth.password_in = <empty>
Nov 02 01:40:35 user nova-compute[74996]: node.session.auth.chap_algs = MD5
Nov 02 01:40:35 user nova-compute[74996]: node.session.timeo.replacement_timeout = 120
Nov 02 01:40:35 user nova-compute[74996]: node.session.err_timeo.abort_timeout = 15
Nov 02 01:40:35 user nova-compute[74996]: node.session.err_timeo.lu_reset_timeout = 30
Nov 02 01:40:35 user nova-compute[74996]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 02 01:40:35 user nova-compute[74996]: node.session.err_timeo.host_reset_timeout = 60
Nov 02 01:40:35 user nova-compute[74996]: node.session.iscsi.FastAbort = Yes
Nov 02 01:40:35 user nova-compute[74996]: node.session.iscsi.InitialR2T = No
Nov 02 01:40:35 user nova-compute[74996]: node.session.iscsi.ImmediateData = Yes
Nov 02 01:40:35 user nova-compute[74996]: node.session.iscsi.FirstBurstLength = 262144
Nov 02 01:40:35 user nova-compute[74996]: node.session.iscsi.MaxBurstLength = 16776192
Nov 02 01:40:35 user nova-compute[74996]: node.session.iscsi.DefaultTime2Retain = 0
Nov 02 01:40:35 user nova-compute[74996]: node.session.iscsi.DefaultTime2Wait = 2
Nov 02 01:40:35 user nova-compute[74996]: node.session.iscsi.MaxConnections = 1
Nov 02 01:40:35 user nova-compute[74996]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 02 01:40:35 user nova-compute[74996]: node.session.iscsi.ERL = 0
Nov 02 01:40:35 user nova-compute[74996]: node.session.scan = manual
Nov 02 01:40:35 user nova-compute[74996]: node.session.reopen_max = 0
Nov 02 01:40:35 user nova-compute[74996]: node.conn[0].address = 172.16.0.220
Nov 02 01:40:35 user nova-compute[74996]: node.conn[0].port = 3260
Nov 02 01:40:35 user nova-compute[74996]: node.conn[0].startup = manual
Nov 02 01:40:35 user nova-compute[74996]: node.conn[0].tcp.window_size = 524288
Nov 02 01:40:35 user nova-compute[74996]: node.conn[0].tcp.type_of_service = 0
Nov 02 01:40:35 user nova-compute[74996]: node.conn[0].timeo.logout_timeout = 15
Nov 02 01:40:35 user nova-compute[74996]: node.conn[0].timeo.login_timeout = 15
Nov 02 01:40:35 user nova-compute[74996]: node.conn[0].timeo.auth_timeout = 45
Nov 02 01:40:35 user nova-compute[74996]: node.conn[0].timeo.noop_out_interval = 5
Nov 02 01:40:35 user nova-compute[74996]: node.conn[0].timeo.noop_out_timeout = 5
Nov 02 01:40:35 user nova-compute[74996]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 02 01:40:35 user nova-compute[74996]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 02 01:40:35 user nova-compute[74996]: node.conn[0].iscsi.HeaderDigest = None
Nov 02 01:40:35 user nova-compute[74996]: node.conn[0].iscsi.DataDigest = None
Nov 02 01:40:35 user nova-compute[74996]: node.conn[0].iscsi.IFMarker = No
Nov 02 01:40:35 user nova-compute[74996]: node.conn[0].iscsi.OFMarker = No
Nov 02 01:40:35 user nova-compute[74996]: # END RECORD
Nov 02 01:40:35 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ef2090-de05-473a-9ac6-996688138aca]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7984149-247d-461e-b597-4842d38a0723]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DEHAcMyI {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DEHAcMyI" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a870de0c-c3b3-4610-bcf0-730b891cc0bb]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DEHAcMyI'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c0de30-5b85-4ae5-bc26-0bcf76f394e5]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d530fdee-016c-40d9-8b6a-f6d65c8b4f77]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:40:35 user nova-compute[74996]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 (non-flash)
Nov 02 01:40:35 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:40:35 user nova-compute[74996]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 (non-flash)
Nov 02 01:40:35 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.175s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] HCTL ('33', '0', '0', 0) found on session 20 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55748e8-78df-4c56-8920-17aa40e48bd0]: (4, ('0 0 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Searching for a device in session 20 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEHAcMyI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.202s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] <== connect_volume: return (203ms) {'type': 'block', 'scsi_wwn': '23637306137383036', 'path': '/dev/sdb'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637306137383036', 'path': '/dev/sdb'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:37:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-94790749',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-94790749',id=20,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:38:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='142161c2fae44bdea848619580195795',ramdisk_id='',reservation_id='r-cla6iv6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1294190560',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:38:42Z,user_data=None,user_id='15affb427e9b4fb8873accf286510e14',uuid=9d706c1a-883b-4b26-8972-4083df064e93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "address": "fa:16:3e:f0:bd:77", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "vif_mac": "fa:16:3e:f0:bd:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9071ad51-8c", "ovs_interfaceid": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Converting VIF {"id": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "address": "fa:16:3e:f0:bd:77", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "vif_mac": "fa:16:3e:f0:bd:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9071ad51-8c", "ovs_interfaceid": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:bd:77,bridge_name='br-int',has_traffic_filtering=True,id=9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c,network=Network(b5218514-0348-4dcc-8ecf-4595a87e204a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9071ad51-8c') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.objects.instance [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d706c1a-883b-4b26-8972-4083df064e93 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.objects.base [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Object Instance<9d706c1a-883b-4b26-8972-4083df064e93> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:40:35 user nova-compute[74996]:   <uuid>9d706c1a-883b-4b26-8972-4083df064e93</uuid>
Nov 02 01:40:35 user nova-compute[74996]:   <name>instance-00000014</name>
Nov 02 01:40:35 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:40:35 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:40:35 user nova-compute[74996]:   <metadata>
Nov 02 01:40:35 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:40:35 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:40:35 user nova-compute[74996]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-94790749</nova:name>
Nov 02 01:40:35 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:40:35</nova:creationTime>
Nov 02 01:40:35 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:40:35 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:40:35 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:40:35 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:40:35 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:40:35 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:40:35 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:40:35 user nova-compute[74996]:       <nova:owner>
Nov 02 01:40:35 user nova-compute[74996]:         <nova:user uuid="15affb427e9b4fb8873accf286510e14">tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member</nova:user>
Nov 02 01:40:35 user nova-compute[74996]:         <nova:project uuid="142161c2fae44bdea848619580195795">tempest-ServerBootFromVolumeStableRescueTest-1294190560</nova:project>
Nov 02 01:40:35 user nova-compute[74996]:       </nova:owner>
Nov 02 01:40:35 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:40:35 user nova-compute[74996]:       <nova:ports>
Nov 02 01:40:35 user nova-compute[74996]:         <nova:port uuid="9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c">
Nov 02 01:40:35 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 01:40:35 user nova-compute[74996]:         </nova:port>
Nov 02 01:40:35 user nova-compute[74996]:       </nova:ports>
Nov 02 01:40:35 user nova-compute[74996]:     </nova:instance>
Nov 02 01:40:35 user nova-compute[74996]:   </metadata>
Nov 02 01:40:35 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:40:35 user nova-compute[74996]:     <system>
Nov 02 01:40:35 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:40:35 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:40:35 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:40:35 user nova-compute[74996]:       <entry name="serial">9d706c1a-883b-4b26-8972-4083df064e93</entry>
Nov 02 01:40:35 user nova-compute[74996]:       <entry name="uuid">9d706c1a-883b-4b26-8972-4083df064e93</entry>
Nov 02 01:40:35 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:40:35 user nova-compute[74996]:     </system>
Nov 02 01:40:35 user nova-compute[74996]:   </sysinfo>
Nov 02 01:40:35 user nova-compute[74996]:   <os>
Nov 02 01:40:35 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:40:35 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:40:35 user nova-compute[74996]:   </os>
Nov 02 01:40:35 user nova-compute[74996]:   <features>
Nov 02 01:40:35 user nova-compute[74996]:     <acpi/>
Nov 02 01:40:35 user nova-compute[74996]:     <apic/>
Nov 02 01:40:35 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:40:35 user nova-compute[74996]:   </features>
Nov 02 01:40:35 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:40:35 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:40:35 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:40:35 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:40:35 user nova-compute[74996]:   </clock>
Nov 02 01:40:35 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:40:35 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:40:35 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:40:35 user nova-compute[74996]:   </cpu>
Nov 02 01:40:35 user nova-compute[74996]:   <devices>
Nov 02 01:40:35 user nova-compute[74996]:     <disk type="block" device="disk">
Nov 02 01:40:35 user nova-compute[74996]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:40:35 user nova-compute[74996]:       <source dev="/dev/sdb"/>
Nov 02 01:40:35 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:40:35 user nova-compute[74996]:       <serial>056998b8-61e1-46e5-b497-c0ee61ae9ff7</serial>
Nov 02 01:40:35 user nova-compute[74996]:     </disk>
Nov 02 01:40:35 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:40:35 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:40:35 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/9d706c1a-883b-4b26-8972-4083df064e93/disk.rescue"/>
Nov 02 01:40:35 user nova-compute[74996]:       <target dev="vdb" bus="virtio"/>
Nov 02 01:40:35 user nova-compute[74996]:       <boot order="1"/>
Nov 02 01:40:35 user nova-compute[74996]:     </disk>
Nov 02 01:40:35 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:40:35 user nova-compute[74996]:       <mac address="fa:16:3e:f0:bd:77"/>
Nov 02 01:40:35 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:40:35 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:40:35 user nova-compute[74996]:       <target dev="tap9071ad51-8c"/>
Nov 02 01:40:35 user nova-compute[74996]:     </interface>
Nov 02 01:40:35 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:40:35 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/9d706c1a-883b-4b26-8972-4083df064e93/console.log" append="off"/>
Nov 02 01:40:35 user nova-compute[74996]:     </serial>
Nov 02 01:40:35 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:40:35 user nova-compute[74996]:     <video>
Nov 02 01:40:35 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:40:35 user nova-compute[74996]:     </video>
Nov 02 01:40:35 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:40:35 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:40:35 user nova-compute[74996]:     </rng>
Nov 02 01:40:35 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:40:35 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:40:35 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:40:35 user nova-compute[74996]:     </memballoon>
Nov 02 01:40:35 user nova-compute[74996]:   </devices>
Nov 02 01:40:35 user nova-compute[74996]: </domain>
Nov 02 01:40:35 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:40:35 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Instance destroyed successfully.
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] No VIF found with MAC fa:16:3e:f0:bd:77, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:40:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:36 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance da10dadd-b04a-4f3b-92bd-fcaa18b51fce is timed out.
Nov 02 01:40:36 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Successfully detached device vdb from instance da10dadd-b04a-4f3b-92bd-fcaa18b51fce from the live domain config.
Nov 02 01:40:36 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuqzjEfF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:40:36 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:40:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[834a530a-38af-4b6c-817e-2a448a3471b0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:40:36 user nova-compute[74996]: No targets found.
Nov 02 01:40:36 user nova-compute[74996]: iSNS:
Nov 02 01:40:36 user nova-compute[74996]: No targets found.
Nov 02 01:40:36 user nova-compute[74996]: STATIC:
Nov 02 01:40:36 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855
Nov 02 01:40:36 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:40:36 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:40:36 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7
Nov 02 01:40:36 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:40:36 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:40:36 user nova-compute[74996]: FIRMWARE:
Nov 02 01:40:36 user nova-compute[74996]: No targets found.
Nov 02 01:40:36 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:40:36 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:40:36 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a1e4a3-7d47-47f2-8f06-d71bcbe5ed98]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2388290c-2875-4515-9cdc-e1392472174c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:40:36 user nova-compute[74996]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 (non-flash)
Nov 02 01:40:36 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:40:36 user nova-compute[74996]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 (non-flash)
Nov 02 01:40:36 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e852cdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855'): ({'sdc'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Removing single pathed devices sdc {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc43d465-1e6a-44cb-9ca8-958d1505adbf]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d1193c-9451-4304-9e62-cd2ba88b6caf]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Flushing IO for device /dev/sdc {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3e2b9c-2066-4ef6-84b3-abf88386975e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:40:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[21baa32d-4043-45d6-b405-e41364f5fcf0]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd331312-e50d-422f-8a7c-dfe89709d2f5]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8a7593-7abc-4c36-abb0-fae186ae2137]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855, portal: 172.16.0.220,3260]
Nov 02 01:40:37 user nova-compute[74996]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855, portal: 172.16.0.220,3260] successful.
Nov 02 01:40:37 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e3e6fa-4c8c-43f0-9138-e4bac5747855 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c9b03d-c158-4d68-9c19-e2516c8b1936]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] <== disconnect_volume: return (359ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG nova.compute.manager [req-756ea4fe-909a-4e05-a207-5d3c1a4a4ac3 req-f52a7bd8-9186-47e1-98bd-f588ed50c9a6 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Received event network-vif-plugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-756ea4fe-909a-4e05-a207-5d3c1a4a4ac3 req-f52a7bd8-9186-47e1-98bd-f588ed50c9a6 service nova] Acquiring lock "9d706c1a-883b-4b26-8972-4083df064e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-756ea4fe-909a-4e05-a207-5d3c1a4a4ac3 req-f52a7bd8-9186-47e1-98bd-f588ed50c9a6 service nova] Lock "9d706c1a-883b-4b26-8972-4083df064e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-756ea4fe-909a-4e05-a207-5d3c1a4a4ac3 req-f52a7bd8-9186-47e1-98bd-f588ed50c9a6 service nova] Lock "9d706c1a-883b-4b26-8972-4083df064e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG nova.compute.manager [req-756ea4fe-909a-4e05-a207-5d3c1a4a4ac3 req-f52a7bd8-9186-47e1-98bd-f588ed50c9a6 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] No waiting events found dispatching network-vif-plugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:40:37 user nova-compute[74996]: WARNING nova.compute.manager [req-756ea4fe-909a-4e05-a207-5d3c1a4a4ac3 req-f52a7bd8-9186-47e1-98bd-f588ed50c9a6 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Received unexpected event network-vif-plugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c for instance with vm_state active and task_state rescuing.
Nov 02 01:40:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:39 user nova-compute[74996]: DEBUG nova.compute.manager [None req-243023d4-63fd-4087-b4e1-f8a9b4d5dff7 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:40:39 user nova-compute[74996]: DEBUG nova.compute.manager [req-9e4d7ef5-e0ac-4935-8c04-4488164cf5bb req-49cdc23a-4927-493a-80f5-ab6db422ac19 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Received event network-vif-plugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:40:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9e4d7ef5-e0ac-4935-8c04-4488164cf5bb req-49cdc23a-4927-493a-80f5-ab6db422ac19 service nova] Acquiring lock "9d706c1a-883b-4b26-8972-4083df064e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:40:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9e4d7ef5-e0ac-4935-8c04-4488164cf5bb req-49cdc23a-4927-493a-80f5-ab6db422ac19 service nova] Lock "9d706c1a-883b-4b26-8972-4083df064e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:40:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9e4d7ef5-e0ac-4935-8c04-4488164cf5bb req-49cdc23a-4927-493a-80f5-ab6db422ac19 service nova] Lock "9d706c1a-883b-4b26-8972-4083df064e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:39 user nova-compute[74996]: DEBUG nova.compute.manager [req-9e4d7ef5-e0ac-4935-8c04-4488164cf5bb req-49cdc23a-4927-493a-80f5-ab6db422ac19 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] No waiting events found dispatching network-vif-plugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:40:39 user nova-compute[74996]: WARNING nova.compute.manager [req-9e4d7ef5-e0ac-4935-8c04-4488164cf5bb req-49cdc23a-4927-493a-80f5-ab6db422ac19 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Received unexpected event network-vif-plugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c for instance with vm_state active and task_state rescuing.
Nov 02 01:40:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:40:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 01:40:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:40:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:40:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:45 user nova-compute[74996]: DEBUG nova.compute.manager [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:40:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:40:45 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Creating image(s)
Nov 02 01:40:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Did not create local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 01:40:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Ensure instance console log exists: /opt/stack/data/nova/instances/3b5719c9-08ad-4a01-b960-23328b537283/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:40:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:40:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:40:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Start _get_guest_xml network_info=[{"id": "39bb24a8-37e5-43fc-839b-203634b56ad6", "address": "fa:16:3e:31:e2:fb", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bb24a8-37", "ovs_interfaceid": "39bb24a8-37e5-43fc-839b-203634b56ad6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a3601031-de66-4da9-a5c8-6da817bd8fb6', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JFqYIoyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3b5719c9-08ad-4a01-b960-23328b537283', 'attached_at': '', 'detached_at': '', 'volume_id': '9c2c466a-1b32-4336-aae3-0dd383f2f59d', 'serial': '9c2c466a-1b32-4336-aae3-0dd383f2f59d'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:40:45 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:40:45 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:40:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:40:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:40:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:40:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:40:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:40:45 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:40:45 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:40:45 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:40:45 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:40:45 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:40:45 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:40:45 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:40:45 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:40:45 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:40:45 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:40:45 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JFqYIoyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:40:46 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:40:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:40:46 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:40:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:40:46 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7003f1-cd27-497b-be4f-9b08a922f7f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:40:46 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddf465b-fd94-446b-9baf-ff0056418b14]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d] added
Nov 02 01:40:46 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a500f07-aca1-4c89-9a67-c413474c916e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8185ac-c1c0-4320-b2b6-2f75958d8d97]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JFqYIoyw {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JFqYIoyw" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f712b25-4fcc-4013-bc46-5c96c96971c0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JFqYIoyw'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca74847-8805-4d3e-ab19-2570ca03bcb0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[742c380c-0a55-471e-9043-865e3a8a933b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:40:46 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:40:46 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[675ea572-a5fb-4e40-be97-2cdaa4d7301f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d, portal: 172.16.0.220,3260]
Nov 02 01:40:46 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d, portal: 172.16.0.220,3260] successful.
Nov 02 01:40:46 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e227db-aab1-4ab1-9939-cca257156616]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cd2bb1-e822-485c-a832-5f06d7614a84]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:40:46 user nova-compute[74996]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:40:46 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:40:46 user nova-compute[74996]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:40:46 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.039s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[421be888-e72c-41e5-b6ec-ff2674eca421]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:40:46 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: None {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:40:47 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:40:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JFqYIoyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:40:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:40:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23434333030326436', 'path': '/dev/sdc'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:40:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434333030326436', 'path': '/dev/sdc'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:40:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:39:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-526618239',display_name='tempest-TestVolumeBootPattern-volume-backed-server-526618239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-526618239',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsu+6bAxft2jCgvqyoEb61WCp3Bze3XC2Jn+gJFBiBov2pPxhEmYz7teo9ZT67hMugA7baU5FLQoRNjrUoiZCUdPX3jVoKwMGttZ7yPK0WkwoGj6BfMePZ2IY4sI/p4bA==',key_name='tempest-keypair-190111910',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31965b482eb243a69112a49bf1302779',ramdisk_id='',reservation_id='r-qkvo4v7f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-216720976',owner_user_name='tempest-TestVolumeBootPattern-216720976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:39:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be6bf504c3a649898e8c83399f6fee8e',uuid=3b5719c9-08ad-4a01-b960-23328b537283,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39bb24a8-37e5-43fc-839b-203634b56ad6", "address": "fa:16:3e:31:e2:fb", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bb24a8-37", "ovs_interfaceid": "39bb24a8-37e5-43fc-839b-203634b56ad6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:40:47 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converting VIF {"id": "39bb24a8-37e5-43fc-839b-203634b56ad6", "address": "fa:16:3e:31:e2:fb", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bb24a8-37", "ovs_interfaceid": "39bb24a8-37e5-43fc-839b-203634b56ad6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:40:47 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:e2:fb,bridge_name='br-int',has_traffic_filtering=True,id=39bb24a8-37e5-43fc-839b-203634b56ad6,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39bb24a8-37') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:40:47 user nova-compute[74996]: DEBUG nova.objects.instance [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b5719c9-08ad-4a01-b960-23328b537283 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:40:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:40:47 user nova-compute[74996]:   <uuid>3b5719c9-08ad-4a01-b960-23328b537283</uuid>
Nov 02 01:40:47 user nova-compute[74996]:   <name>instance-00000016</name>
Nov 02 01:40:47 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:40:47 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:40:47 user nova-compute[74996]:   <metadata>
Nov 02 01:40:47 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:40:47 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:40:47 user nova-compute[74996]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-526618239</nova:name>
Nov 02 01:40:47 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:40:45</nova:creationTime>
Nov 02 01:40:47 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:40:47 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:40:47 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:40:47 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:40:47 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:40:47 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:40:47 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:40:47 user nova-compute[74996]:       <nova:owner>
Nov 02 01:40:47 user nova-compute[74996]:         <nova:user uuid="be6bf504c3a649898e8c83399f6fee8e">tempest-TestVolumeBootPattern-216720976-project-member</nova:user>
Nov 02 01:40:47 user nova-compute[74996]:         <nova:project uuid="31965b482eb243a69112a49bf1302779">tempest-TestVolumeBootPattern-216720976</nova:project>
Nov 02 01:40:47 user nova-compute[74996]:       </nova:owner>
Nov 02 01:40:47 user nova-compute[74996]:       <nova:ports>
Nov 02 01:40:47 user nova-compute[74996]:         <nova:port uuid="39bb24a8-37e5-43fc-839b-203634b56ad6">
Nov 02 01:40:47 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 01:40:47 user nova-compute[74996]:         </nova:port>
Nov 02 01:40:47 user nova-compute[74996]:       </nova:ports>
Nov 02 01:40:47 user nova-compute[74996]:     </nova:instance>
Nov 02 01:40:47 user nova-compute[74996]:   </metadata>
Nov 02 01:40:47 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:40:47 user nova-compute[74996]:     <system>
Nov 02 01:40:47 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:40:47 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:40:47 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:40:47 user nova-compute[74996]:       <entry name="serial">3b5719c9-08ad-4a01-b960-23328b537283</entry>
Nov 02 01:40:47 user nova-compute[74996]:       <entry name="uuid">3b5719c9-08ad-4a01-b960-23328b537283</entry>
Nov 02 01:40:47 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:40:47 user nova-compute[74996]:     </system>
Nov 02 01:40:47 user nova-compute[74996]:   </sysinfo>
Nov 02 01:40:47 user nova-compute[74996]:   <os>
Nov 02 01:40:47 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:40:47 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:40:47 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:40:47 user nova-compute[74996]:   </os>
Nov 02 01:40:47 user nova-compute[74996]:   <features>
Nov 02 01:40:47 user nova-compute[74996]:     <acpi/>
Nov 02 01:40:47 user nova-compute[74996]:     <apic/>
Nov 02 01:40:47 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:40:47 user nova-compute[74996]:   </features>
Nov 02 01:40:47 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:40:47 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:40:47 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:40:47 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:40:47 user nova-compute[74996]:   </clock>
Nov 02 01:40:47 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:40:47 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:40:47 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:40:47 user nova-compute[74996]:   </cpu>
Nov 02 01:40:47 user nova-compute[74996]:   <devices>
Nov 02 01:40:47 user nova-compute[74996]:     <disk type="block" device="disk">
Nov 02 01:40:47 user nova-compute[74996]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:40:47 user nova-compute[74996]:       <source dev="/dev/sdc"/>
Nov 02 01:40:47 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:40:47 user nova-compute[74996]:       <serial>9c2c466a-1b32-4336-aae3-0dd383f2f59d</serial>
Nov 02 01:40:47 user nova-compute[74996]:     </disk>
Nov 02 01:40:47 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:40:47 user nova-compute[74996]:       <mac address="fa:16:3e:31:e2:fb"/>
Nov 02 01:40:47 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:40:47 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:40:47 user nova-compute[74996]:       <target dev="tap39bb24a8-37"/>
Nov 02 01:40:47 user nova-compute[74996]:     </interface>
Nov 02 01:40:47 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:40:47 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/3b5719c9-08ad-4a01-b960-23328b537283/console.log" append="off"/>
Nov 02 01:40:47 user nova-compute[74996]:     </serial>
Nov 02 01:40:47 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:40:47 user nova-compute[74996]:     <video>
Nov 02 01:40:47 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:40:47 user nova-compute[74996]:     </video>
Nov 02 01:40:47 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:40:47 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:40:47 user nova-compute[74996]:     </rng>
Nov 02 01:40:47 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:40:47 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:40:47 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:40:47 user nova-compute[74996]:     </memballoon>
Nov 02 01:40:47 user nova-compute[74996]:   </devices>
Nov 02 01:40:47 user nova-compute[74996]: </domain>
Nov 02 01:40:47 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:40:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:39:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-526618239',display_name='tempest-TestVolumeBootPattern-volume-backed-server-526618239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-526618239',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsu+6bAxft2jCgvqyoEb61WCp3Bze3XC2Jn+gJFBiBov2pPxhEmYz7teo9ZT67hMugA7baU5FLQoRNjrUoiZCUdPX3jVoKwMGttZ7yPK0WkwoGj6BfMePZ2IY4sI/p4bA==',key_name='tempest-keypair-190111910',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31965b482eb243a69112a49bf1302779',ramdisk_id='',reservation_id='r-qkvo4v7f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-216720976',owner_user_name='tempest-TestVolumeBootPattern-216720976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:39:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be6bf504c3a649898e8c83399f6fee8e',uuid=3b5719c9-08ad-4a01-b960-23328b537283,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39bb24a8-37e5-43fc-839b-203634b56ad6", "address": "fa:16:3e:31:e2:fb", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bb24a8-37", "ovs_interfaceid": "39bb24a8-37e5-43fc-839b-203634b56ad6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:40:47 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converting VIF {"id": "39bb24a8-37e5-43fc-839b-203634b56ad6", "address": "fa:16:3e:31:e2:fb", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bb24a8-37", "ovs_interfaceid": "39bb24a8-37e5-43fc-839b-203634b56ad6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:40:47 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:e2:fb,bridge_name='br-int',has_traffic_filtering=True,id=39bb24a8-37e5-43fc-839b-203634b56ad6,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39bb24a8-37') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:40:47 user nova-compute[74996]: DEBUG os_vif [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:e2:fb,bridge_name='br-int',has_traffic_filtering=True,id=39bb24a8-37e5-43fc-839b-203634b56ad6,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39bb24a8-37') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:40:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:40:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:40:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2523adfc-68b1-5dee-8328-47c3c5e8425f', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:40:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:40:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39bb24a8-37, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:40:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap39bb24a8-37, col_values=(('qos', UUID('80cb0f6f-a5d3-4301-a334-7b6beba0a7a2')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:40:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap39bb24a8-37, col_values=(('external_ids', {'iface-id': '39bb24a8-37e5-43fc-839b-203634b56ad6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:e2:fb', 'vm-uuid': '3b5719c9-08ad-4a01-b960-23328b537283'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:40:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:40:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:47 user nova-compute[74996]: INFO os_vif [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:e2:fb,bridge_name='br-int',has_traffic_filtering=True,id=39bb24a8-37e5-43fc-839b-203634b56ad6,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39bb24a8-37')
Nov 02 01:40:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:40:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] No VIF found with MAC fa:16:3e:31:e2:fb, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:40:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:49 user nova-compute[74996]: DEBUG nova.compute.manager [req-c8b4820a-7851-4c15-b121-b66f0f8f4032 req-4a964ade-0ee4-4fcf-b8c3-4091e62f4ded service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Received event network-vif-plugged-39bb24a8-37e5-43fc-839b-203634b56ad6 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:40:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c8b4820a-7851-4c15-b121-b66f0f8f4032 req-4a964ade-0ee4-4fcf-b8c3-4091e62f4ded service nova] Acquiring lock "3b5719c9-08ad-4a01-b960-23328b537283-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:40:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c8b4820a-7851-4c15-b121-b66f0f8f4032 req-4a964ade-0ee4-4fcf-b8c3-4091e62f4ded service nova] Lock "3b5719c9-08ad-4a01-b960-23328b537283-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:40:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c8b4820a-7851-4c15-b121-b66f0f8f4032 req-4a964ade-0ee4-4fcf-b8c3-4091e62f4ded service nova] Lock "3b5719c9-08ad-4a01-b960-23328b537283-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:49 user nova-compute[74996]: DEBUG nova.compute.manager [req-c8b4820a-7851-4c15-b121-b66f0f8f4032 req-4a964ade-0ee4-4fcf-b8c3-4091e62f4ded service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] No waiting events found dispatching network-vif-plugged-39bb24a8-37e5-43fc-839b-203634b56ad6 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:40:49 user nova-compute[74996]: WARNING nova.compute.manager [req-c8b4820a-7851-4c15-b121-b66f0f8f4032 req-4a964ade-0ee4-4fcf-b8c3-4091e62f4ded service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Received unexpected event network-vif-plugged-39bb24a8-37e5-43fc-839b-203634b56ad6 for instance with vm_state building and task_state spawning.
Nov 02 01:40:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-a9487e4e-e5d6-4782-8843-341a487366c8 req-85f0004d-416d-4783-9772-ad488d379ce9 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Received event network-vif-plugged-39bb24a8-37e5-43fc-839b-203634b56ad6 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:40:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a9487e4e-e5d6-4782-8843-341a487366c8 req-85f0004d-416d-4783-9772-ad488d379ce9 service nova] Acquiring lock "3b5719c9-08ad-4a01-b960-23328b537283-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:40:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a9487e4e-e5d6-4782-8843-341a487366c8 req-85f0004d-416d-4783-9772-ad488d379ce9 service nova] Lock "3b5719c9-08ad-4a01-b960-23328b537283-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:40:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a9487e4e-e5d6-4782-8843-341a487366c8 req-85f0004d-416d-4783-9772-ad488d379ce9 service nova] Lock "3b5719c9-08ad-4a01-b960-23328b537283-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-a9487e4e-e5d6-4782-8843-341a487366c8 req-85f0004d-416d-4783-9772-ad488d379ce9 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] No waiting events found dispatching network-vif-plugged-39bb24a8-37e5-43fc-839b-203634b56ad6 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:40:51 user nova-compute[74996]: WARNING nova.compute.manager [req-a9487e4e-e5d6-4782-8843-341a487366c8 req-85f0004d-416d-4783-9772-ad488d379ce9 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Received unexpected event network-vif-plugged-39bb24a8-37e5-43fc-839b-203634b56ad6 for instance with vm_state building and task_state spawning.
Nov 02 01:40:51 user nova-compute[74996]: DEBUG nova.compute.manager [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:40:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:40:51 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Instance spawned successfully.
Nov 02 01:40:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:40:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:40:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:40:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:40:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:40:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:40:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:40:51 user nova-compute[74996]: INFO nova.compute.manager [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Took 5.51 seconds to spawn the instance on the hypervisor.
Nov 02 01:40:51 user nova-compute[74996]: DEBUG nova.compute.manager [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:40:51 user nova-compute[74996]: INFO nova.compute.manager [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Took 59.10 seconds to build instance.
Nov 02 01:40:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-45a2083d-9682-41e0-baff-5c8bdda542b5 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "3b5719c9-08ad-4a01-b960-23328b537283" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 59.220s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:52 user nova-compute[74996]: DEBUG nova.objects.instance [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lazy-loading 'flavor' on Instance uuid da10dadd-b04a-4f3b-92bd-fcaa18b51fce {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:40:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c16ef9ad-28e0-43e6-9251-b83b8e77c712 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 36.109s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:40:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:40:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d5ef992d-1405-48a9-aedc-b0eb784e4051 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Acquiring lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:41:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d5ef992d-1405-48a9-aedc-b0eb784e4051 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:41:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d5ef992d-1405-48a9-aedc-b0eb784e4051 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Acquiring lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:41:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d5ef992d-1405-48a9-aedc-b0eb784e4051 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:41:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d5ef992d-1405-48a9-aedc-b0eb784e4051 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:41:06 user nova-compute[74996]: INFO nova.compute.manager [None req-d5ef992d-1405-48a9-aedc-b0eb784e4051 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Terminating instance
Nov 02 01:41:06 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d5ef992d-1405-48a9-aedc-b0eb784e4051 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:41:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:07 user nova-compute[74996]: DEBUG nova.compute.manager [req-f565dbb9-d7b0-44e2-b4a4-9174a30a6cd2 req-ff1571fe-24a3-4d62-8d5c-cb92d225fa7f service nova] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Received event network-vif-unplugged-63a93574-ffa2-45a1-9a42-b93779f1d7bb {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:41:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f565dbb9-d7b0-44e2-b4a4-9174a30a6cd2 req-ff1571fe-24a3-4d62-8d5c-cb92d225fa7f service nova] Acquiring lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:41:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f565dbb9-d7b0-44e2-b4a4-9174a30a6cd2 req-ff1571fe-24a3-4d62-8d5c-cb92d225fa7f service nova] Lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:41:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f565dbb9-d7b0-44e2-b4a4-9174a30a6cd2 req-ff1571fe-24a3-4d62-8d5c-cb92d225fa7f service nova] Lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:41:07 user nova-compute[74996]: DEBUG nova.compute.manager [req-f565dbb9-d7b0-44e2-b4a4-9174a30a6cd2 req-ff1571fe-24a3-4d62-8d5c-cb92d225fa7f service nova] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] No waiting events found dispatching network-vif-unplugged-63a93574-ffa2-45a1-9a42-b93779f1d7bb {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:41:07 user nova-compute[74996]: DEBUG nova.compute.manager [req-f565dbb9-d7b0-44e2-b4a4-9174a30a6cd2 req-ff1571fe-24a3-4d62-8d5c-cb92d225fa7f service nova] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Received event network-vif-unplugged-63a93574-ffa2-45a1-9a42-b93779f1d7bb for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:41:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:07 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Instance destroyed successfully.
Nov 02 01:41:07 user nova-compute[74996]: DEBUG nova.objects.instance [None req-d5ef992d-1405-48a9-aedc-b0eb784e4051 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lazy-loading 'resources' on Instance uuid da10dadd-b04a-4f3b-92bd-fcaa18b51fce {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:41:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-d5ef992d-1405-48a9-aedc-b0eb784e4051 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:36:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-648562890',display_name='tempest-TestServerVolumeAttachmentScenario-server-648562890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-648562890',id=18,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO41NR7dPdT4RGwBW5jxFL3kBGYDG0YElffqYyIwWiPntUjo1FCFsJCxkQa3rgp98mOxJ37aBJEltK4AxTaDzRyq9atWaJE2SR1gZFN0Fz5mvmiqxAdQoj4trhh8dPDfKQ==',key_name='tempest-keypair-933157162',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:36:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4094553af48241d9896971038ca4560c',ramdisk_id='',reservation_id='r-6s61vrzs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-125699075',owner_user_name='tempest-TestServerVolumeAttachmentScenario-125699075-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:36:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4722252fe05d42e7844123dfa5899718',uuid=da10dadd-b04a-4f3b-92bd-fcaa18b51fce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63a93574-ffa2-45a1-9a42-b93779f1d7bb", "address": "fa:16:3e:f8:1e:be", "network": {"id": "2a051be1-8b15-49b1-8686-7da5c3825033", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1021749906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4094553af48241d9896971038ca4560c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63a93574-ff", "ovs_interfaceid": "63a93574-ffa2-45a1-9a42-b93779f1d7bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:41:07 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-d5ef992d-1405-48a9-aedc-b0eb784e4051 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Converting VIF {"id": "63a93574-ffa2-45a1-9a42-b93779f1d7bb", "address": "fa:16:3e:f8:1e:be", "network": {"id": "2a051be1-8b15-49b1-8686-7da5c3825033", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1021749906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4094553af48241d9896971038ca4560c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63a93574-ff", "ovs_interfaceid": "63a93574-ffa2-45a1-9a42-b93779f1d7bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:41:07 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-d5ef992d-1405-48a9-aedc-b0eb784e4051 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:1e:be,bridge_name='br-int',has_traffic_filtering=True,id=63a93574-ffa2-45a1-9a42-b93779f1d7bb,network=Network(2a051be1-8b15-49b1-8686-7da5c3825033),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63a93574-ff') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:41:07 user nova-compute[74996]: DEBUG os_vif [None req-d5ef992d-1405-48a9-aedc-b0eb784e4051 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:1e:be,bridge_name='br-int',has_traffic_filtering=True,id=63a93574-ffa2-45a1-9a42-b93779f1d7bb,network=Network(2a051be1-8b15-49b1-8686-7da5c3825033),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63a93574-ff') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:41:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63a93574-ff, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:41:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c57cb7fe-85c4-436a-a057-dba1fb406732) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:41:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:07 user nova-compute[74996]: INFO os_vif [None req-d5ef992d-1405-48a9-aedc-b0eb784e4051 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:1e:be,bridge_name='br-int',has_traffic_filtering=True,id=63a93574-ffa2-45a1-9a42-b93779f1d7bb,network=Network(2a051be1-8b15-49b1-8686-7da5c3825033),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63a93574-ff')
Nov 02 01:41:07 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-d5ef992d-1405-48a9-aedc-b0eb784e4051 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Deleting instance files /opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce_del
Nov 02 01:41:07 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-d5ef992d-1405-48a9-aedc-b0eb784e4051 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Deletion of /opt/stack/data/nova/instances/da10dadd-b04a-4f3b-92bd-fcaa18b51fce_del complete
Nov 02 01:41:07 user nova-compute[74996]: INFO nova.compute.manager [None req-d5ef992d-1405-48a9-aedc-b0eb784e4051 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 02 01:41:07 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-d5ef992d-1405-48a9-aedc-b0eb784e4051 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:41:07 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:41:07 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:41:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:08 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:41:08 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Took 0.94 seconds to deallocate network for instance.
Nov 02 01:41:08 user nova-compute[74996]: DEBUG nova.compute.manager [req-1b28c3a3-d628-43c1-aaeb-ef205be9e165 req-64ecd6a3-9a99-44e3-bce6-ebbaad767589 service nova] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Received event network-vif-deleted-63a93574-ffa2-45a1-9a42-b93779f1d7bb {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:41:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d5ef992d-1405-48a9-aedc-b0eb784e4051 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:41:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d5ef992d-1405-48a9-aedc-b0eb784e4051 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:41:08 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d5ef992d-1405-48a9-aedc-b0eb784e4051 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Refreshing inventories for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 01:41:08 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d5ef992d-1405-48a9-aedc-b0eb784e4051 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Updating ProviderTree inventory for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 01:41:08 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d5ef992d-1405-48a9-aedc-b0eb784e4051 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Updating inventory in ProviderTree for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 01:41:09 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d5ef992d-1405-48a9-aedc-b0eb784e4051 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Refreshing aggregate associations for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259, aggregates: None {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 01:41:09 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d5ef992d-1405-48a9-aedc-b0eb784e4051 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Refreshing trait associations for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 01:41:09 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d5ef992d-1405-48a9-aedc-b0eb784e4051 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:41:09 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d5ef992d-1405-48a9-aedc-b0eb784e4051 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:41:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d5ef992d-1405-48a9-aedc-b0eb784e4051 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:41:09 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-d5ef992d-1405-48a9-aedc-b0eb784e4051 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Deleted allocations for instance da10dadd-b04a-4f3b-92bd-fcaa18b51fce
Nov 02 01:41:09 user nova-compute[74996]: DEBUG nova.compute.manager [req-1c59b473-326b-4a68-a93c-4376979c80eb req-743bc273-5004-42e6-9454-3cac1e80d953 service nova] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Received event network-vif-plugged-63a93574-ffa2-45a1-9a42-b93779f1d7bb {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:41:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1c59b473-326b-4a68-a93c-4376979c80eb req-743bc273-5004-42e6-9454-3cac1e80d953 service nova] Acquiring lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:41:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1c59b473-326b-4a68-a93c-4376979c80eb req-743bc273-5004-42e6-9454-3cac1e80d953 service nova] Lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:41:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1c59b473-326b-4a68-a93c-4376979c80eb req-743bc273-5004-42e6-9454-3cac1e80d953 service nova] Lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:41:09 user nova-compute[74996]: DEBUG nova.compute.manager [req-1c59b473-326b-4a68-a93c-4376979c80eb req-743bc273-5004-42e6-9454-3cac1e80d953 service nova] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] No waiting events found dispatching network-vif-plugged-63a93574-ffa2-45a1-9a42-b93779f1d7bb {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:41:09 user nova-compute[74996]: WARNING nova.compute.manager [req-1c59b473-326b-4a68-a93c-4376979c80eb req-743bc273-5004-42e6-9454-3cac1e80d953 service nova] [instance: da10dadd-b04a-4f3b-92bd-fcaa18b51fce] Received unexpected event network-vif-plugged-63a93574-ffa2-45a1-9a42-b93779f1d7bb for instance with vm_state deleted and task_state None.
Nov 02 01:41:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d5ef992d-1405-48a9-aedc-b0eb784e4051 tempest-TestServerVolumeAttachmentScenario-125699075 tempest-TestServerVolumeAttachmentScenario-125699075-project-member] Lock "da10dadd-b04a-4f3b-92bd-fcaa18b51fce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.523s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:41:10 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:41:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "5d834837-a1a1-436d-9015-b9b3bf048170" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:41:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "5d834837-a1a1-436d-9015-b9b3bf048170" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:41:13 user nova-compute[74996]: DEBUG nova.compute.manager [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:41:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:41:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:41:13 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:41:13 user nova-compute[74996]: INFO nova.compute.claims [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Claim successful on node user
Nov 02 01:41:14 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:41:14 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:41:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:14 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:41:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:41:14 user nova-compute[74996]: DEBUG nova.compute.manager [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:41:14 user nova-compute[74996]: DEBUG nova.compute.manager [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:41:14 user nova-compute[74996]: DEBUG nova.network.neutron [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:41:14 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:41:14 user nova-compute[74996]: DEBUG nova.compute.manager [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:41:14 user nova-compute[74996]: DEBUG nova.policy [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '700d6c84a40547e99f3e364d6447ad4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6b2c4a38374459b73fa76b8dde9db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:41:14 user nova-compute[74996]: DEBUG nova.compute.manager [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:41:14 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:41:14 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Creating image(s)
Nov 02 01:41:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d834837-a1a1-436d-9015-b9b3bf048170/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:41:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "/opt/stack/data/nova/instances/5d834837-a1a1-436d-9015-b9b3bf048170/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:41:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "/opt/stack/data/nova/instances/5d834837-a1a1-436d-9015-b9b3bf048170/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:41:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:41:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.189s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:41:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:41:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:41:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:41:15 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:41:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.218s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:41:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/5d834837-a1a1-436d-9015-b9b3bf048170/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:41:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:41:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:41:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:41:15 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:41:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/5d834837-a1a1-436d-9015-b9b3bf048170/disk 1073741824" returned: 0 in 0.060s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:41:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:41:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:41:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:41:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.253s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:41:15 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5d834837-a1a1-436d-9015-b9b3bf048170/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:41:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d834837-a1a1-436d-9015-b9b3bf048170/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:41:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:41:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:41:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d834837-a1a1-436d-9015-b9b3bf048170/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:41:15 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Cannot resize image /opt/stack/data/nova/instances/5d834837-a1a1-436d-9015-b9b3bf048170/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:41:15 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:41:15 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Ensure instance console log exists: /opt/stack/data/nova/instances/5d834837-a1a1-436d-9015-b9b3bf048170/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:41:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:41:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:41:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:41:15 user nova-compute[74996]: DEBUG nova.network.neutron [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Successfully created port: eda8feac-2d2d-4be0-aa50-ef4d7b2448d8 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:41:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:41:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:41:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:41:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:41:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:41:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:41:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d706c1a-883b-4b26-8972-4083df064e93/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:41:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d706c1a-883b-4b26-8972-4083df064e93/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:41:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d706c1a-883b-4b26-8972-4083df064e93/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:41:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d706c1a-883b-4b26-8972-4083df064e93/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:41:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:41:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:41:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:41:17 user nova-compute[74996]: DEBUG nova.network.neutron [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Successfully updated port: eda8feac-2d2d-4be0-aa50-ef4d7b2448d8 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:41:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "refresh_cache-5d834837-a1a1-436d-9015-b9b3bf048170" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:41:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquired lock "refresh_cache-5d834837-a1a1-436d-9015-b9b3bf048170" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:41:17 user nova-compute[74996]: DEBUG nova.network.neutron [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:41:17 user nova-compute[74996]: DEBUG nova.compute.manager [req-149e55fa-149d-47ae-ba42-7032ed8f855a req-47b38414-c62b-447e-b55c-ce6070220eeb service nova] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Received event network-changed-eda8feac-2d2d-4be0-aa50-ef4d7b2448d8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:41:17 user nova-compute[74996]: DEBUG nova.compute.manager [req-149e55fa-149d-47ae-ba42-7032ed8f855a req-47b38414-c62b-447e-b55c-ce6070220eeb service nova] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Refreshing instance network info cache due to event network-changed-eda8feac-2d2d-4be0-aa50-ef4d7b2448d8. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:41:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-149e55fa-149d-47ae-ba42-7032ed8f855a req-47b38414-c62b-447e-b55c-ce6070220eeb service nova] Acquiring lock "refresh_cache-5d834837-a1a1-436d-9015-b9b3bf048170" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:41:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:41:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:41:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:41:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:41:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:41:17 user nova-compute[74996]: DEBUG nova.network.neutron [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:41:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:41:18 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:41:18 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=7844MB free_disk=25.197368621826172GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance fea802b7-64d9-4c77-87a7-eaba1dce5c22 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7307f3a3-1ad1-43f7-be49-9cd03a626cd7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance d8f51f7d-c9de-4914-883e-7a875d3d73ad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 9d706c1a-883b-4b26-8972-4083df064e93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 3b5719c9-08ad-4a01-b960-23328b537283 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance f0de5980-334b-4654-8b1a-88c4c861aa49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 5d834837-a1a1-436d-9015-b9b3bf048170 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.network.neutron [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Updating instance_info_cache with network_info: [{"id": "eda8feac-2d2d-4be0-aa50-ef4d7b2448d8", "address": "fa:16:3e:8e:ff:6b", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeda8feac-2d", "ovs_interfaceid": "eda8feac-2d2d-4be0-aa50-ef4d7b2448d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Releasing lock "refresh_cache-5d834837-a1a1-436d-9015-b9b3bf048170" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.compute.manager [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Instance network_info: |[{"id": "eda8feac-2d2d-4be0-aa50-ef4d7b2448d8", "address": "fa:16:3e:8e:ff:6b", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeda8feac-2d", "ovs_interfaceid": "eda8feac-2d2d-4be0-aa50-ef4d7b2448d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-149e55fa-149d-47ae-ba42-7032ed8f855a req-47b38414-c62b-447e-b55c-ce6070220eeb service nova] Acquired lock "refresh_cache-5d834837-a1a1-436d-9015-b9b3bf048170" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.network.neutron [req-149e55fa-149d-47ae-ba42-7032ed8f855a req-47b38414-c62b-447e-b55c-ce6070220eeb service nova] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Refreshing network info cache for port eda8feac-2d2d-4be0-aa50-ef4d7b2448d8 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Start _get_guest_xml network_info=[{"id": "eda8feac-2d2d-4be0-aa50-ef4d7b2448d8", "address": "fa:16:3e:8e:ff:6b", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeda8feac-2d", "ovs_interfaceid": "eda8feac-2d2d-4be0-aa50-ef4d7b2448d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:41:18 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:41:18 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-30452314',display_name='tempest-AttachVolumeNegativeTest-server-30452314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-30452314',id=24,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZU4CH7h09l1iR9y8X6W4zTHKYzeHDr/5xbTsfXnh8w5xjlewCnrFHMP/PopFBThF0MDUClNR3QeifUvv38QC3XAFT9BZToQ/joxGyeFUDqX/CGtd5OawKJl0b+UThU/Q==',key_name='tempest-keypair-126278438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b6b2c4a38374459b73fa76b8dde9db4',ramdisk_id='',reservation_id='r-mty1zcz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1395123327',owner_user_name='tempest-AttachVolumeNegativeTest-1395123327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:41:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='700d6c84a40547e99f3e364d6447ad4e',uuid=5d834837-a1a1-436d-9015-b9b3bf048170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eda8feac-2d2d-4be0-aa50-ef4d7b2448d8", "address": "fa:16:3e:8e:ff:6b", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeda8feac-2d", "ovs_interfaceid": "eda8feac-2d2d-4be0-aa50-ef4d7b2448d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Converting VIF {"id": "eda8feac-2d2d-4be0-aa50-ef4d7b2448d8", "address": "fa:16:3e:8e:ff:6b", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeda8feac-2d", "ovs_interfaceid": "eda8feac-2d2d-4be0-aa50-ef4d7b2448d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ff:6b,bridge_name='br-int',has_traffic_filtering=True,id=eda8feac-2d2d-4be0-aa50-ef4d7b2448d8,network=Network(d18bfd38-1454-4665-a175-2c7d0e2002ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeda8feac-2d') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.objects.instance [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d834837-a1a1-436d-9015-b9b3bf048170 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:41:18 user nova-compute[74996]:   <uuid>5d834837-a1a1-436d-9015-b9b3bf048170</uuid>
Nov 02 01:41:18 user nova-compute[74996]:   <name>instance-00000018</name>
Nov 02 01:41:18 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:41:18 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:41:18 user nova-compute[74996]:   <metadata>
Nov 02 01:41:18 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:41:18 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:41:18 user nova-compute[74996]:       <nova:name>tempest-AttachVolumeNegativeTest-server-30452314</nova:name>
Nov 02 01:41:18 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:41:18</nova:creationTime>
Nov 02 01:41:18 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:41:18 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:41:18 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:41:18 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:41:18 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:41:18 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:41:18 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:41:18 user nova-compute[74996]:       <nova:owner>
Nov 02 01:41:18 user nova-compute[74996]:         <nova:user uuid="700d6c84a40547e99f3e364d6447ad4e">tempest-AttachVolumeNegativeTest-1395123327-project-member</nova:user>
Nov 02 01:41:18 user nova-compute[74996]:         <nova:project uuid="9b6b2c4a38374459b73fa76b8dde9db4">tempest-AttachVolumeNegativeTest-1395123327</nova:project>
Nov 02 01:41:18 user nova-compute[74996]:       </nova:owner>
Nov 02 01:41:18 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:41:18 user nova-compute[74996]:       <nova:ports>
Nov 02 01:41:18 user nova-compute[74996]:         <nova:port uuid="eda8feac-2d2d-4be0-aa50-ef4d7b2448d8">
Nov 02 01:41:18 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 01:41:18 user nova-compute[74996]:         </nova:port>
Nov 02 01:41:18 user nova-compute[74996]:       </nova:ports>
Nov 02 01:41:18 user nova-compute[74996]:     </nova:instance>
Nov 02 01:41:18 user nova-compute[74996]:   </metadata>
Nov 02 01:41:18 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:41:18 user nova-compute[74996]:     <system>
Nov 02 01:41:18 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:41:18 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:41:18 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:41:18 user nova-compute[74996]:       <entry name="serial">5d834837-a1a1-436d-9015-b9b3bf048170</entry>
Nov 02 01:41:18 user nova-compute[74996]:       <entry name="uuid">5d834837-a1a1-436d-9015-b9b3bf048170</entry>
Nov 02 01:41:18 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:41:18 user nova-compute[74996]:     </system>
Nov 02 01:41:18 user nova-compute[74996]:   </sysinfo>
Nov 02 01:41:18 user nova-compute[74996]:   <os>
Nov 02 01:41:18 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:41:18 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:41:18 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:41:18 user nova-compute[74996]:   </os>
Nov 02 01:41:18 user nova-compute[74996]:   <features>
Nov 02 01:41:18 user nova-compute[74996]:     <acpi/>
Nov 02 01:41:18 user nova-compute[74996]:     <apic/>
Nov 02 01:41:18 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:41:18 user nova-compute[74996]:   </features>
Nov 02 01:41:18 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:41:18 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:41:18 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:41:18 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:41:18 user nova-compute[74996]:   </clock>
Nov 02 01:41:18 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:41:18 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:41:18 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:41:18 user nova-compute[74996]:   </cpu>
Nov 02 01:41:18 user nova-compute[74996]:   <devices>
Nov 02 01:41:18 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:41:18 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:41:18 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/5d834837-a1a1-436d-9015-b9b3bf048170/disk"/>
Nov 02 01:41:18 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:41:18 user nova-compute[74996]:     </disk>
Nov 02 01:41:18 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:41:18 user nova-compute[74996]:       <mac address="fa:16:3e:8e:ff:6b"/>
Nov 02 01:41:18 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:41:18 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:41:18 user nova-compute[74996]:       <target dev="tapeda8feac-2d"/>
Nov 02 01:41:18 user nova-compute[74996]:     </interface>
Nov 02 01:41:18 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:41:18 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/5d834837-a1a1-436d-9015-b9b3bf048170/console.log" append="off"/>
Nov 02 01:41:18 user nova-compute[74996]:     </serial>
Nov 02 01:41:18 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:41:18 user nova-compute[74996]:     <video>
Nov 02 01:41:18 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:41:18 user nova-compute[74996]:     </video>
Nov 02 01:41:18 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:41:18 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:41:18 user nova-compute[74996]:     </rng>
Nov 02 01:41:18 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:41:18 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:41:18 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:41:18 user nova-compute[74996]:     </memballoon>
Nov 02 01:41:18 user nova-compute[74996]:   </devices>
Nov 02 01:41:18 user nova-compute[74996]: </domain>
Nov 02 01:41:18 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-30452314',display_name='tempest-AttachVolumeNegativeTest-server-30452314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-30452314',id=24,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZU4CH7h09l1iR9y8X6W4zTHKYzeHDr/5xbTsfXnh8w5xjlewCnrFHMP/PopFBThF0MDUClNR3QeifUvv38QC3XAFT9BZToQ/joxGyeFUDqX/CGtd5OawKJl0b+UThU/Q==',key_name='tempest-keypair-126278438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b6b2c4a38374459b73fa76b8dde9db4',ramdisk_id='',reservation_id='r-mty1zcz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1395123327',owner_user_name='tempest-AttachVolumeNegativeTest-1395123327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:41:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='700d6c84a40547e99f3e364d6447ad4e',uuid=5d834837-a1a1-436d-9015-b9b3bf048170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eda8feac-2d2d-4be0-aa50-ef4d7b2448d8", "address": "fa:16:3e:8e:ff:6b", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeda8feac-2d", "ovs_interfaceid": "eda8feac-2d2d-4be0-aa50-ef4d7b2448d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Converting VIF {"id": "eda8feac-2d2d-4be0-aa50-ef4d7b2448d8", "address": "fa:16:3e:8e:ff:6b", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeda8feac-2d", "ovs_interfaceid": "eda8feac-2d2d-4be0-aa50-ef4d7b2448d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ff:6b,bridge_name='br-int',has_traffic_filtering=True,id=eda8feac-2d2d-4be0-aa50-ef4d7b2448d8,network=Network(d18bfd38-1454-4665-a175-2c7d0e2002ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeda8feac-2d') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG os_vif [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ff:6b,bridge_name='br-int',has_traffic_filtering=True,id=eda8feac-2d2d-4be0-aa50-ef4d7b2448d8,network=Network(d18bfd38-1454-4665-a175-2c7d0e2002ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeda8feac-2d') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a338dd0-88fd-5057-97c1-d11c953c242a', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeda8feac-2d, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeda8feac-2d, col_values=(('qos', UUID('a1bbf901-c99a-4cc9-bfa9-c2fbe5f213e7')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeda8feac-2d, col_values=(('external_ids', {'iface-id': 'eda8feac-2d2d-4be0-aa50-ef4d7b2448d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:ff:6b', 'vm-uuid': '5d834837-a1a1-436d-9015-b9b3bf048170'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:18 user nova-compute[74996]: INFO os_vif [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ff:6b,bridge_name='br-int',has_traffic_filtering=True,id=eda8feac-2d2d-4be0-aa50-ef4d7b2448d8,network=Network(d18bfd38-1454-4665-a175-2c7d0e2002ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeda8feac-2d')
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] No VIF found with MAC fa:16:3e:8e:ff:6b, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.438s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.network.neutron [req-149e55fa-149d-47ae-ba42-7032ed8f855a req-47b38414-c62b-447e-b55c-ce6070220eeb service nova] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Updated VIF entry in instance network info cache for port eda8feac-2d2d-4be0-aa50-ef4d7b2448d8. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG nova.network.neutron [req-149e55fa-149d-47ae-ba42-7032ed8f855a req-47b38414-c62b-447e-b55c-ce6070220eeb service nova] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Updating instance_info_cache with network_info: [{"id": "eda8feac-2d2d-4be0-aa50-ef4d7b2448d8", "address": "fa:16:3e:8e:ff:6b", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeda8feac-2d", "ovs_interfaceid": "eda8feac-2d2d-4be0-aa50-ef4d7b2448d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:41:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-149e55fa-149d-47ae-ba42-7032ed8f855a req-47b38414-c62b-447e-b55c-ce6070220eeb service nova] Releasing lock "refresh_cache-5d834837-a1a1-436d-9015-b9b3bf048170" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:41:19 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:41:19 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:41:19 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Didn't find any instances for network info cache update. {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 01:41:19 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:41:19 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:41:19 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:41:19 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:41:19 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:41:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:20 user nova-compute[74996]: DEBUG nova.compute.manager [req-afbf5a67-b907-4c56-93cb-22134ecbd543 req-f1f9277d-91ba-4529-98dd-6b43444436dc service nova] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Received event network-vif-plugged-eda8feac-2d2d-4be0-aa50-ef4d7b2448d8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:41:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-afbf5a67-b907-4c56-93cb-22134ecbd543 req-f1f9277d-91ba-4529-98dd-6b43444436dc service nova] Acquiring lock "5d834837-a1a1-436d-9015-b9b3bf048170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:41:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-afbf5a67-b907-4c56-93cb-22134ecbd543 req-f1f9277d-91ba-4529-98dd-6b43444436dc service nova] Lock "5d834837-a1a1-436d-9015-b9b3bf048170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:41:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-afbf5a67-b907-4c56-93cb-22134ecbd543 req-f1f9277d-91ba-4529-98dd-6b43444436dc service nova] Lock "5d834837-a1a1-436d-9015-b9b3bf048170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:41:20 user nova-compute[74996]: DEBUG nova.compute.manager [req-afbf5a67-b907-4c56-93cb-22134ecbd543 req-f1f9277d-91ba-4529-98dd-6b43444436dc service nova] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] No waiting events found dispatching network-vif-plugged-eda8feac-2d2d-4be0-aa50-ef4d7b2448d8 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:41:20 user nova-compute[74996]: WARNING nova.compute.manager [req-afbf5a67-b907-4c56-93cb-22134ecbd543 req-f1f9277d-91ba-4529-98dd-6b43444436dc service nova] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Received unexpected event network-vif-plugged-eda8feac-2d2d-4be0-aa50-ef4d7b2448d8 for instance with vm_state building and task_state spawning.
Nov 02 01:41:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:21 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:41:22 user nova-compute[74996]: DEBUG nova.compute.manager [req-26578033-0812-4bfe-afce-d7ddf694edca req-86b44dc5-04e0-48cf-a9a9-8a37081d6a21 service nova] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Received event network-vif-plugged-eda8feac-2d2d-4be0-aa50-ef4d7b2448d8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:41:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-26578033-0812-4bfe-afce-d7ddf694edca req-86b44dc5-04e0-48cf-a9a9-8a37081d6a21 service nova] Acquiring lock "5d834837-a1a1-436d-9015-b9b3bf048170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:41:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-26578033-0812-4bfe-afce-d7ddf694edca req-86b44dc5-04e0-48cf-a9a9-8a37081d6a21 service nova] Lock "5d834837-a1a1-436d-9015-b9b3bf048170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:41:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-26578033-0812-4bfe-afce-d7ddf694edca req-86b44dc5-04e0-48cf-a9a9-8a37081d6a21 service nova] Lock "5d834837-a1a1-436d-9015-b9b3bf048170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:41:22 user nova-compute[74996]: DEBUG nova.compute.manager [req-26578033-0812-4bfe-afce-d7ddf694edca req-86b44dc5-04e0-48cf-a9a9-8a37081d6a21 service nova] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] No waiting events found dispatching network-vif-plugged-eda8feac-2d2d-4be0-aa50-ef4d7b2448d8 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:41:22 user nova-compute[74996]: WARNING nova.compute.manager [req-26578033-0812-4bfe-afce-d7ddf694edca req-86b44dc5-04e0-48cf-a9a9-8a37081d6a21 service nova] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Received unexpected event network-vif-plugged-eda8feac-2d2d-4be0-aa50-ef4d7b2448d8 for instance with vm_state building and task_state spawning.
Nov 02 01:41:22 user nova-compute[74996]: DEBUG nova.compute.manager [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:41:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:41:22 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Instance spawned successfully.
Nov 02 01:41:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:41:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:41:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:41:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:41:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:41:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:41:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:41:22 user nova-compute[74996]: INFO nova.compute.manager [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Took 7.86 seconds to spawn the instance on the hypervisor.
Nov 02 01:41:22 user nova-compute[74996]: DEBUG nova.compute.manager [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:41:22 user nova-compute[74996]: INFO nova.compute.manager [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Took 8.90 seconds to build instance.
Nov 02 01:41:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-56390b44-d724-48cb-8c51-812d0f101cb3 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "5d834837-a1a1-436d-9015-b9b3bf048170" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.012s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:41:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:23 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:41:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "d28b9820-c059-46cb-9bb0-132e447fca1b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:41:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "d28b9820-c059-46cb-9bb0-132e447fca1b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:41:28 user nova-compute[74996]: DEBUG nova.compute.manager [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:41:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:41:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:41:28 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:41:28 user nova-compute[74996]: INFO nova.compute.claims [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Claim successful on node user
Nov 02 01:41:28 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:41:28 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:41:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:41:29 user nova-compute[74996]: DEBUG nova.compute.manager [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:41:29 user nova-compute[74996]: DEBUG nova.compute.manager [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:41:29 user nova-compute[74996]: DEBUG nova.network.neutron [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:41:29 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:41:29 user nova-compute[74996]: DEBUG nova.compute.manager [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:41:29 user nova-compute[74996]: INFO nova.virt.block_device [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Booting with volume c5a76a61-6046-4d4d-9acc-1213893f10a8 at /dev/vda
Nov 02 01:41:29 user nova-compute[74996]: DEBUG nova.policy [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f0ac87391a0140ba83743c0a2cd193fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f462793d4eb4433c9c27d92f80518db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:41:29 user nova-compute[74996]: DEBUG os_brick.utils [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:41:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:41:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:41:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43b862e-23f6-4846-9fec-2fbc64385c8c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:41:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:41:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:41:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5175d75c-2c45-40ca-a6cd-a1815a6d23f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:41:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:41:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:41:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db58fe5-4e8b-4b9c-bd63-70ae3230d88d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:41:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[04626286-3b20-4b8d-b1c3-fc6d8a5d6aec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:41:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:41:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:41:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:41:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:41:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:41:29 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:41:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a265e154-6431-46c1-ace1-3f572a904ca6]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:41:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:41:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:41:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:41:29 user nova-compute[74996]: DEBUG os_brick.utils [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:41:29 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Updating existing volume attachment record: 9b2be019-4682-43ac-a93f-51ba27afb4b6 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:41:30 user nova-compute[74996]: DEBUG nova.network.neutron [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Successfully created port: 498304ed-92a0-4c70-88e1-d668894f583a {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:41:30 user nova-compute[74996]: DEBUG nova.network.neutron [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Successfully updated port: 498304ed-92a0-4c70-88e1-d668894f583a {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:41:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "refresh_cache-d28b9820-c059-46cb-9bb0-132e447fca1b" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:41:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquired lock "refresh_cache-d28b9820-c059-46cb-9bb0-132e447fca1b" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:41:30 user nova-compute[74996]: DEBUG nova.network.neutron [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:41:30 user nova-compute[74996]: DEBUG nova.compute.manager [req-499e9041-648c-4397-831d-c0ee5420c0a0 req-7769b84d-31be-48f5-a080-0a49dec1188b service nova] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Received event network-changed-498304ed-92a0-4c70-88e1-d668894f583a {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:41:30 user nova-compute[74996]: DEBUG nova.compute.manager [req-499e9041-648c-4397-831d-c0ee5420c0a0 req-7769b84d-31be-48f5-a080-0a49dec1188b service nova] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Refreshing instance network info cache due to event network-changed-498304ed-92a0-4c70-88e1-d668894f583a. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:41:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-499e9041-648c-4397-831d-c0ee5420c0a0 req-7769b84d-31be-48f5-a080-0a49dec1188b service nova] Acquiring lock "refresh_cache-d28b9820-c059-46cb-9bb0-132e447fca1b" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:41:30 user nova-compute[74996]: DEBUG nova.network.neutron [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:41:31 user nova-compute[74996]: DEBUG nova.network.neutron [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Updating instance_info_cache with network_info: [{"id": "498304ed-92a0-4c70-88e1-d668894f583a", "address": "fa:16:3e:7e:df:ab", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap498304ed-92", "ovs_interfaceid": "498304ed-92a0-4c70-88e1-d668894f583a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:41:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Releasing lock "refresh_cache-d28b9820-c059-46cb-9bb0-132e447fca1b" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:41:31 user nova-compute[74996]: DEBUG nova.compute.manager [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Instance network_info: |[{"id": "498304ed-92a0-4c70-88e1-d668894f583a", "address": "fa:16:3e:7e:df:ab", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap498304ed-92", "ovs_interfaceid": "498304ed-92a0-4c70-88e1-d668894f583a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:41:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-499e9041-648c-4397-831d-c0ee5420c0a0 req-7769b84d-31be-48f5-a080-0a49dec1188b service nova] Acquired lock "refresh_cache-d28b9820-c059-46cb-9bb0-132e447fca1b" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:41:31 user nova-compute[74996]: DEBUG nova.network.neutron [req-499e9041-648c-4397-831d-c0ee5420c0a0 req-7769b84d-31be-48f5-a080-0a49dec1188b service nova] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Refreshing network info cache for port 498304ed-92a0-4c70-88e1-d668894f583a {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:41:31 user nova-compute[74996]: DEBUG nova.network.neutron [req-499e9041-648c-4397-831d-c0ee5420c0a0 req-7769b84d-31be-48f5-a080-0a49dec1188b service nova] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Updated VIF entry in instance network info cache for port 498304ed-92a0-4c70-88e1-d668894f583a. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:41:31 user nova-compute[74996]: DEBUG nova.network.neutron [req-499e9041-648c-4397-831d-c0ee5420c0a0 req-7769b84d-31be-48f5-a080-0a49dec1188b service nova] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Updating instance_info_cache with network_info: [{"id": "498304ed-92a0-4c70-88e1-d668894f583a", "address": "fa:16:3e:7e:df:ab", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap498304ed-92", "ovs_interfaceid": "498304ed-92a0-4c70-88e1-d668894f583a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:41:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-499e9041-648c-4397-831d-c0ee5420c0a0 req-7769b84d-31be-48f5-a080-0a49dec1188b service nova] Releasing lock "refresh_cache-d28b9820-c059-46cb-9bb0-132e447fca1b" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:41:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Acquiring lock "382dce4d-dd73-4929-81dc-bcc3bb987045" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:41:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "382dce4d-dd73-4929-81dc-bcc3bb987045" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:41:53 user nova-compute[74996]: DEBUG nova.compute.manager [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:41:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:41:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:41:54 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:41:54 user nova-compute[74996]: INFO nova.compute.claims [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Claim successful on node user
Nov 02 01:41:54 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:41:54 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:41:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:41:54 user nova-compute[74996]: DEBUG nova.compute.manager [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:41:54 user nova-compute[74996]: DEBUG nova.compute.manager [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:41:54 user nova-compute[74996]: DEBUG nova.network.neutron [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:41:54 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:41:54 user nova-compute[74996]: DEBUG nova.compute.manager [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:41:54 user nova-compute[74996]: INFO nova.virt.block_device [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Booting with volume 5f7cff97-bd0e-4b25-a3da-398d425d9ed4 at /dev/vda
Nov 02 01:41:54 user nova-compute[74996]: DEBUG nova.policy [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3295b6af73fe474ca0c00efe655866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b53bc3f0b994ceeb8e6cff9f8fb1980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:41:54 user nova-compute[74996]: DEBUG os_brick.utils [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:41:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:41:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:41:54 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e9e097-02e9-42cc-9da1-1aafa35b4f71]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:41:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:41:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:41:54 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fe153c-a381-4622-93a2-6ae9b4e06bec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:41:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:41:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:41:54 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[67137532-d72a-44d3-a3a6-9bc0243d8991]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:41:54 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d027c88-d413-4ee1-984e-3c063e0b61a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:41:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:41:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:41:54 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:41:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:41:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:41:54 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:41:54 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[66001585-6b74-4761-9c0d-1dbd48e40785]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:41:54 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:41:54 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:41:54 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:41:54 user nova-compute[74996]: DEBUG os_brick.utils [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:41:54 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Updating existing volume attachment record: d48dbf4c-43ef-4b9e-9fbc-30f778d6f869 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:41:55 user nova-compute[74996]: DEBUG nova.network.neutron [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Successfully created port: ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:41:55 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:56 user nova-compute[74996]: DEBUG nova.network.neutron [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Successfully updated port: ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:41:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Acquiring lock "refresh_cache-382dce4d-dd73-4929-81dc-bcc3bb987045" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:41:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Acquired lock "refresh_cache-382dce4d-dd73-4929-81dc-bcc3bb987045" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:41:56 user nova-compute[74996]: DEBUG nova.network.neutron [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:41:56 user nova-compute[74996]: DEBUG nova.compute.manager [req-a80f63b4-8ad2-48bc-b591-a447e1a8866d req-c0ee0c27-92b0-4304-bc0e-a2cf73c1e61f service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Received event network-changed-ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:41:56 user nova-compute[74996]: DEBUG nova.compute.manager [req-a80f63b4-8ad2-48bc-b591-a447e1a8866d req-c0ee0c27-92b0-4304-bc0e-a2cf73c1e61f service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Refreshing instance network info cache due to event network-changed-ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:41:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a80f63b4-8ad2-48bc-b591-a447e1a8866d req-c0ee0c27-92b0-4304-bc0e-a2cf73c1e61f service nova] Acquiring lock "refresh_cache-382dce4d-dd73-4929-81dc-bcc3bb987045" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:41:56 user nova-compute[74996]: DEBUG nova.network.neutron [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:41:56 user nova-compute[74996]: DEBUG nova.network.neutron [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Updating instance_info_cache with network_info: [{"id": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "address": "fa:16:3e:a3:71:72", "network": {"id": "2923ade6-4530-4109-8e37-67123fa93c05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-147878200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b53bc3f0b994ceeb8e6cff9f8fb1980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce4de8d2-0f", "ovs_interfaceid": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:41:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Releasing lock "refresh_cache-382dce4d-dd73-4929-81dc-bcc3bb987045" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:41:56 user nova-compute[74996]: DEBUG nova.compute.manager [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Instance network_info: |[{"id": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "address": "fa:16:3e:a3:71:72", "network": {"id": "2923ade6-4530-4109-8e37-67123fa93c05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-147878200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b53bc3f0b994ceeb8e6cff9f8fb1980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce4de8d2-0f", "ovs_interfaceid": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:41:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a80f63b4-8ad2-48bc-b591-a447e1a8866d req-c0ee0c27-92b0-4304-bc0e-a2cf73c1e61f service nova] Acquired lock "refresh_cache-382dce4d-dd73-4929-81dc-bcc3bb987045" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:41:56 user nova-compute[74996]: DEBUG nova.network.neutron [req-a80f63b4-8ad2-48bc-b591-a447e1a8866d req-c0ee0c27-92b0-4304-bc0e-a2cf73c1e61f service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Refreshing network info cache for port ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:41:57 user nova-compute[74996]: DEBUG nova.network.neutron [req-a80f63b4-8ad2-48bc-b591-a447e1a8866d req-c0ee0c27-92b0-4304-bc0e-a2cf73c1e61f service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Updated VIF entry in instance network info cache for port ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:41:57 user nova-compute[74996]: DEBUG nova.network.neutron [req-a80f63b4-8ad2-48bc-b591-a447e1a8866d req-c0ee0c27-92b0-4304-bc0e-a2cf73c1e61f service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Updating instance_info_cache with network_info: [{"id": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "address": "fa:16:3e:a3:71:72", "network": {"id": "2923ade6-4530-4109-8e37-67123fa93c05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-147878200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b53bc3f0b994ceeb8e6cff9f8fb1980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce4de8d2-0f", "ovs_interfaceid": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:41:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a80f63b4-8ad2-48bc-b591-a447e1a8866d req-c0ee0c27-92b0-4304-bc0e-a2cf73c1e61f service nova] Releasing lock "refresh_cache-382dce4d-dd73-4929-81dc-bcc3bb987045" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:41:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:41:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:42:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 01:42:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:42:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:42:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:10 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:42:13 user nova-compute[74996]: DEBUG nova.compute.manager [req-695d488a-1736-4eba-bacb-0b10ca9f53ca req-4bd5159e-77aa-43f3-b86c-389818458256 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Received event network-changed-a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:42:13 user nova-compute[74996]: DEBUG nova.compute.manager [req-695d488a-1736-4eba-bacb-0b10ca9f53ca req-4bd5159e-77aa-43f3-b86c-389818458256 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Refreshing instance network info cache due to event network-changed-a8fe6401-b45e-4c64-b975-963eeecc7516. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:42:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-695d488a-1736-4eba-bacb-0b10ca9f53ca req-4bd5159e-77aa-43f3-b86c-389818458256 service nova] Acquiring lock "refresh_cache-f0de5980-334b-4654-8b1a-88c4c861aa49" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:42:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-695d488a-1736-4eba-bacb-0b10ca9f53ca req-4bd5159e-77aa-43f3-b86c-389818458256 service nova] Acquired lock "refresh_cache-f0de5980-334b-4654-8b1a-88c4c861aa49" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:42:13 user nova-compute[74996]: DEBUG nova.network.neutron [req-695d488a-1736-4eba-bacb-0b10ca9f53ca req-4bd5159e-77aa-43f3-b86c-389818458256 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Refreshing network info cache for port a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:42:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:13 user nova-compute[74996]: DEBUG nova.network.neutron [req-695d488a-1736-4eba-bacb-0b10ca9f53ca req-4bd5159e-77aa-43f3-b86c-389818458256 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Updated VIF entry in instance network info cache for port a8fe6401-b45e-4c64-b975-963eeecc7516. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:42:13 user nova-compute[74996]: DEBUG nova.network.neutron [req-695d488a-1736-4eba-bacb-0b10ca9f53ca req-4bd5159e-77aa-43f3-b86c-389818458256 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Updating instance_info_cache with network_info: [{"id": "a8fe6401-b45e-4c64-b975-963eeecc7516", "address": "fa:16:3e:02:4b:04", "network": {"id": "7de1ec81-4bf0-4099-a317-52e3c4b64f4e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-840004831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cafad1855f4b3b98cba6bb24f7562b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8fe6401-b4", "ovs_interfaceid": "a8fe6401-b45e-4c64-b975-963eeecc7516", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:42:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-695d488a-1736-4eba-bacb-0b10ca9f53ca req-4bd5159e-77aa-43f3-b86c-389818458256 service nova] Releasing lock "refresh_cache-f0de5980-334b-4654-8b1a-88c4c861aa49" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:42:14 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:42:14 user nova-compute[74996]: DEBUG nova.compute.manager [None req-3bce4a33-96c5-4850-8efb-c49845e47acf tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:42:14 user nova-compute[74996]: INFO nova.compute.manager [None req-3bce4a33-96c5-4850-8efb-c49845e47acf tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] instance snapshotting
Nov 02 01:42:14 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-3bce4a33-96c5-4850-8efb-c49845e47acf tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Beginning live snapshot process
Nov 02 01:42:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3bce4a33-96c5-4850-8efb-c49845e47acf tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json -f qcow2 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3bce4a33-96c5-4850-8efb-c49845e47acf tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json -f qcow2" returned: 0 in 0.202s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3bce4a33-96c5-4850-8efb-c49845e47acf tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json -f qcow2 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3bce4a33-96c5-4850-8efb-c49845e47acf tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3bce4a33-96c5-4850-8efb-c49845e47acf tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3bce4a33-96c5-4850-8efb-c49845e47acf tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.213s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3bce4a33-96c5-4850-8efb-c49845e47acf tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmps_r6tbm7/9feceb81358245ffa099b6f859db593e.delta 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3bce4a33-96c5-4850-8efb-c49845e47acf tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmps_r6tbm7/9feceb81358245ffa099b6f859db593e.delta 1073741824" returned: 0 in 0.051s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:15 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-3bce4a33-96c5-4850-8efb-c49845e47acf tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 02 01:42:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-3bce4a33-96c5-4850-8efb-c49845e47acf tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74996) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 01:42:16 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:42:16 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:42:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:42:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:42:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:42:16 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:42:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-3bce4a33-96c5-4850-8efb-c49845e47acf tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74996) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 01:42:16 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-3bce4a33-96c5-4850-8efb-c49845e47acf tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 02 01:42:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:16 user nova-compute[74996]: DEBUG nova.privsep.utils [None req-3bce4a33-96c5-4850-8efb-c49845e47acf tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74996) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 01:42:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3bce4a33-96c5-4850-8efb-c49845e47acf tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmps_r6tbm7/9feceb81358245ffa099b6f859db593e.delta /opt/stack/data/nova/instances/snapshots/tmps_r6tbm7/9feceb81358245ffa099b6f859db593e {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3bce4a33-96c5-4850-8efb-c49845e47acf tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmps_r6tbm7/9feceb81358245ffa099b6f859db593e.delta /opt/stack/data/nova/instances/snapshots/tmps_r6tbm7/9feceb81358245ffa099b6f859db593e" returned: 0 in 0.355s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:17 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-3bce4a33-96c5-4850-8efb-c49845e47acf tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Snapshot extracted, beginning image upload
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG nova.compute.manager [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:42:17 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Creating image(s)
Nov 02 01:42:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Did not create local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Ensure instance console log exists: /opt/stack/data/nova/instances/d28b9820-c059-46cb-9bb0-132e447fca1b/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Start _get_guest_xml network_info=[{"id": "498304ed-92a0-4c70-88e1-d668894f583a", "address": "fa:16:3e:7e:df:ab", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap498304ed-92", "ovs_interfaceid": "498304ed-92a0-4c70-88e1-d668894f583a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9b2be019-4682-43ac-a93f-51ba27afb4b6', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCNKbdPs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd28b9820-c059-46cb-9bb0-132e447fca1b', 'attached_at': '', 'detached_at': '', 'volume_id': 'c5a76a61-6046-4d4d-9acc-1213893f10a8', 'serial': 'c5a76a61-6046-4d4d-9acc-1213893f10a8'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:42:17 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:42:17 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:42:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCNKbdPs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:42:17 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:42:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:42:17 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:42:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:42:17 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[523c5dc7-fbfa-4191-95b0-83b54711490e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:42:17 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d706c1a-883b-4b26-8972-4083df064e93/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a20cdb-6b28-4636-8df5-a80b47e03d8b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8] added
Nov 02 01:42:17 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[565a313c-1eee-4f68-9b00-7b5564e9d33b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[78defc72-973f-4138-8334-853b2dd9c6f9]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UCNKbdPs {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UCNKbdPs" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a546dd6-b3c8-4a71-995f-9e6d10e059bb]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UCNKbdPs'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[db44292a-89f7-477c-9e60-202a2890ba24]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40bcd23-27a5-49d4-bde0-7d5325472085]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:42:17 user nova-compute[74996]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:42:17 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:42:17 user nova-compute[74996]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:42:17 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d706c1a-883b-4b26-8972-4083df064e93/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d706c1a-883b-4b26-8972-4083df064e93/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde3c2f9-8b7e-4086-9433-f0536fa40913]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8, portal: 172.16.0.220,3260]
Nov 02 01:42:17 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8, portal: 172.16.0.220,3260] successful.
Nov 02 01:42:17 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab86881d-be91-42cd-adc5-f67319986c28]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6b7e24-645b-4db5-95a7-1f46bd516d7e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:42:17 user nova-compute[74996]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:42:17 user nova-compute[74996]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)
Nov 02 01:42:17 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:42:17 user nova-compute[74996]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:42:17 user nova-compute[74996]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)
Nov 02 01:42:17 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b1a80d-c340-4215-8e4e-87a2f1e3746f]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCNKbdPs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d706c1a-883b-4b26-8972-4083df064e93/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d834837-a1a1-436d-9015-b9b3bf048170/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d834837-a1a1-436d-9015-b9b3bf048170/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d834837-a1a1-436d-9015-b9b3bf048170/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d834837-a1a1-436d-9015-b9b3bf048170/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '26538353035383665', 'path': '/dev/sdd'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538353035383665', 'path': '/dev/sdd'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:41:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1119191985',display_name='tempest-ServerActionsTestOtherA-server-1119191985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1119191985',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuGPSdhZpoJV1Cta3eTfZjI1QRYRGe6Y8DzUdNt6ZIoysubzlLd36OVzphJd/MOKltwOpW5QoJYEARWlOQfh2pk3msvJuTgQKOLlFS0wLTIMWMdtr2LMQxjw6cacUWITQ==',key_name='tempest-keypair-1376755092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f462793d4eb4433c9c27d92f80518db1',ramdisk_id='',reservation_id='r-ptctrwds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-852070362',owner_user_name='tempest-ServerActionsTestOtherA-852070362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0ac87391a0140ba83743c0a2cd193fe',uuid=d28b9820-c059-46cb-9bb0-132e447fca1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "498304ed-92a0-4c70-88e1-d668894f583a", "address": "fa:16:3e:7e:df:ab", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap498304ed-92", "ovs_interfaceid": "498304ed-92a0-4c70-88e1-d668894f583a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Converting VIF {"id": "498304ed-92a0-4c70-88e1-d668894f583a", "address": "fa:16:3e:7e:df:ab", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap498304ed-92", "ovs_interfaceid": "498304ed-92a0-4c70-88e1-d668894f583a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:df:ab,bridge_name='br-int',has_traffic_filtering=True,id=498304ed-92a0-4c70-88e1-d668894f583a,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap498304ed-92') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG nova.objects.instance [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lazy-loading 'pci_devices' on Instance uuid d28b9820-c059-46cb-9bb0-132e447fca1b {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:42:18 user nova-compute[74996]:   <uuid>d28b9820-c059-46cb-9bb0-132e447fca1b</uuid>
Nov 02 01:42:18 user nova-compute[74996]:   <name>instance-00000019</name>
Nov 02 01:42:18 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:42:18 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:42:18 user nova-compute[74996]:   <metadata>
Nov 02 01:42:18 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:42:18 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:42:18 user nova-compute[74996]:       <nova:name>tempest-ServerActionsTestOtherA-server-1119191985</nova:name>
Nov 02 01:42:18 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:42:17</nova:creationTime>
Nov 02 01:42:18 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:42:18 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:42:18 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:42:18 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:42:18 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:42:18 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:42:18 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:42:18 user nova-compute[74996]:       <nova:owner>
Nov 02 01:42:18 user nova-compute[74996]:         <nova:user uuid="f0ac87391a0140ba83743c0a2cd193fe">tempest-ServerActionsTestOtherA-852070362-project-member</nova:user>
Nov 02 01:42:18 user nova-compute[74996]:         <nova:project uuid="f462793d4eb4433c9c27d92f80518db1">tempest-ServerActionsTestOtherA-852070362</nova:project>
Nov 02 01:42:18 user nova-compute[74996]:       </nova:owner>
Nov 02 01:42:18 user nova-compute[74996]:       <nova:ports>
Nov 02 01:42:18 user nova-compute[74996]:         <nova:port uuid="498304ed-92a0-4c70-88e1-d668894f583a">
Nov 02 01:42:18 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 02 01:42:18 user nova-compute[74996]:         </nova:port>
Nov 02 01:42:18 user nova-compute[74996]:       </nova:ports>
Nov 02 01:42:18 user nova-compute[74996]:     </nova:instance>
Nov 02 01:42:18 user nova-compute[74996]:   </metadata>
Nov 02 01:42:18 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:42:18 user nova-compute[74996]:     <system>
Nov 02 01:42:18 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:42:18 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:42:18 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:42:18 user nova-compute[74996]:       <entry name="serial">d28b9820-c059-46cb-9bb0-132e447fca1b</entry>
Nov 02 01:42:18 user nova-compute[74996]:       <entry name="uuid">d28b9820-c059-46cb-9bb0-132e447fca1b</entry>
Nov 02 01:42:18 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:42:18 user nova-compute[74996]:     </system>
Nov 02 01:42:18 user nova-compute[74996]:   </sysinfo>
Nov 02 01:42:18 user nova-compute[74996]:   <os>
Nov 02 01:42:18 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:42:18 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:42:18 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:42:18 user nova-compute[74996]:   </os>
Nov 02 01:42:18 user nova-compute[74996]:   <features>
Nov 02 01:42:18 user nova-compute[74996]:     <acpi/>
Nov 02 01:42:18 user nova-compute[74996]:     <apic/>
Nov 02 01:42:18 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:42:18 user nova-compute[74996]:   </features>
Nov 02 01:42:18 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:42:18 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:42:18 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:42:18 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:42:18 user nova-compute[74996]:   </clock>
Nov 02 01:42:18 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:42:18 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:42:18 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:42:18 user nova-compute[74996]:   </cpu>
Nov 02 01:42:18 user nova-compute[74996]:   <devices>
Nov 02 01:42:18 user nova-compute[74996]:     <disk type="block" device="disk">
Nov 02 01:42:18 user nova-compute[74996]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:42:18 user nova-compute[74996]:       <source dev="/dev/sdd"/>
Nov 02 01:42:18 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:42:18 user nova-compute[74996]:       <serial>c5a76a61-6046-4d4d-9acc-1213893f10a8</serial>
Nov 02 01:42:18 user nova-compute[74996]:     </disk>
Nov 02 01:42:18 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:42:18 user nova-compute[74996]:       <mac address="fa:16:3e:7e:df:ab"/>
Nov 02 01:42:18 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:42:18 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:42:18 user nova-compute[74996]:       <target dev="tap498304ed-92"/>
Nov 02 01:42:18 user nova-compute[74996]:     </interface>
Nov 02 01:42:18 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:42:18 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/d28b9820-c059-46cb-9bb0-132e447fca1b/console.log" append="off"/>
Nov 02 01:42:18 user nova-compute[74996]:     </serial>
Nov 02 01:42:18 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:42:18 user nova-compute[74996]:     <video>
Nov 02 01:42:18 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:42:18 user nova-compute[74996]:     </video>
Nov 02 01:42:18 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:42:18 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:42:18 user nova-compute[74996]:     </rng>
Nov 02 01:42:18 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:42:18 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:42:18 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:42:18 user nova-compute[74996]:     </memballoon>
Nov 02 01:42:18 user nova-compute[74996]:   </devices>
Nov 02 01:42:18 user nova-compute[74996]: </domain>
Nov 02 01:42:18 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:41:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1119191985',display_name='tempest-ServerActionsTestOtherA-server-1119191985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1119191985',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuGPSdhZpoJV1Cta3eTfZjI1QRYRGe6Y8DzUdNt6ZIoysubzlLd36OVzphJd/MOKltwOpW5QoJYEARWlOQfh2pk3msvJuTgQKOLlFS0wLTIMWMdtr2LMQxjw6cacUWITQ==',key_name='tempest-keypair-1376755092',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f462793d4eb4433c9c27d92f80518db1',ramdisk_id='',reservation_id='r-ptctrwds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-852070362',owner_user_name='tempest-ServerActionsTestOtherA-852070362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0ac87391a0140ba83743c0a2cd193fe',uuid=d28b9820-c059-46cb-9bb0-132e447fca1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "498304ed-92a0-4c70-88e1-d668894f583a", "address": "fa:16:3e:7e:df:ab", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap498304ed-92", "ovs_interfaceid": "498304ed-92a0-4c70-88e1-d668894f583a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Converting VIF {"id": "498304ed-92a0-4c70-88e1-d668894f583a", "address": "fa:16:3e:7e:df:ab", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap498304ed-92", "ovs_interfaceid": "498304ed-92a0-4c70-88e1-d668894f583a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:df:ab,bridge_name='br-int',has_traffic_filtering=True,id=498304ed-92a0-4c70-88e1-d668894f583a,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap498304ed-92') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG os_vif [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:df:ab,bridge_name='br-int',has_traffic_filtering=True,id=498304ed-92a0-4c70-88e1-d668894f583a,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap498304ed-92') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f803a9e-8ce2-5855-be26-6426b0dc2cc4', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap498304ed-92, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap498304ed-92, col_values=(('qos', UUID('e4708de0-f6ac-493b-bc76-7cceb6c2172b')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap498304ed-92, col_values=(('external_ids', {'iface-id': '498304ed-92a0-4c70-88e1-d668894f583a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:df:ab', 'vm-uuid': 'd28b9820-c059-46cb-9bb0-132e447fca1b'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:18 user nova-compute[74996]: INFO os_vif [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:df:ab,bridge_name='br-int',has_traffic_filtering=True,id=498304ed-92a0-4c70-88e1-d668894f583a,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap498304ed-92')
Nov 02 01:42:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:42:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] No VIF found with MAC fa:16:3e:7e:df:ab, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:42:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG nova.compute.manager [req-cfad6013-63f1-4b3f-a9f8-f8a803e604cb req-bbbcc953-5555-4d23-b319-d2bbbf6f32cd service nova] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Received event network-vif-plugged-498304ed-92a0-4c70-88e1-d668894f583a {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cfad6013-63f1-4b3f-a9f8-f8a803e604cb req-bbbcc953-5555-4d23-b319-d2bbbf6f32cd service nova] Acquiring lock "d28b9820-c059-46cb-9bb0-132e447fca1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cfad6013-63f1-4b3f-a9f8-f8a803e604cb req-bbbcc953-5555-4d23-b319-d2bbbf6f32cd service nova] Lock "d28b9820-c059-46cb-9bb0-132e447fca1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cfad6013-63f1-4b3f-a9f8-f8a803e604cb req-bbbcc953-5555-4d23-b319-d2bbbf6f32cd service nova] Lock "d28b9820-c059-46cb-9bb0-132e447fca1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG nova.compute.manager [req-cfad6013-63f1-4b3f-a9f8-f8a803e604cb req-bbbcc953-5555-4d23-b319-d2bbbf6f32cd service nova] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] No waiting events found dispatching network-vif-plugged-498304ed-92a0-4c70-88e1-d668894f583a {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:42:23 user nova-compute[74996]: WARNING nova.compute.manager [req-cfad6013-63f1-4b3f-a9f8-f8a803e604cb req-bbbcc953-5555-4d23-b319-d2bbbf6f32cd service nova] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Received unexpected event network-vif-plugged-498304ed-92a0-4c70-88e1-d668894f583a for instance with vm_state building and task_state spawning.
Nov 02 01:42:23 user nova-compute[74996]: DEBUG nova.compute.manager [req-a972d4d6-5f68-452d-ae01-d9fadae4c640 req-df69eb3b-1128-4ee7-ba85-b46dad5b7482 service nova] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Received event network-vif-plugged-498304ed-92a0-4c70-88e1-d668894f583a {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a972d4d6-5f68-452d-ae01-d9fadae4c640 req-df69eb3b-1128-4ee7-ba85-b46dad5b7482 service nova] Acquiring lock "d28b9820-c059-46cb-9bb0-132e447fca1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a972d4d6-5f68-452d-ae01-d9fadae4c640 req-df69eb3b-1128-4ee7-ba85-b46dad5b7482 service nova] Lock "d28b9820-c059-46cb-9bb0-132e447fca1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a972d4d6-5f68-452d-ae01-d9fadae4c640 req-df69eb3b-1128-4ee7-ba85-b46dad5b7482 service nova] Lock "d28b9820-c059-46cb-9bb0-132e447fca1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG nova.compute.manager [req-a972d4d6-5f68-452d-ae01-d9fadae4c640 req-df69eb3b-1128-4ee7-ba85-b46dad5b7482 service nova] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] No waiting events found dispatching network-vif-plugged-498304ed-92a0-4c70-88e1-d668894f583a {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:42:23 user nova-compute[74996]: WARNING nova.compute.manager [req-a972d4d6-5f68-452d-ae01-d9fadae4c640 req-df69eb3b-1128-4ee7-ba85-b46dad5b7482 service nova] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Received unexpected event network-vif-plugged-498304ed-92a0-4c70-88e1-d668894f583a for instance with vm_state building and task_state spawning.
Nov 02 01:42:23 user nova-compute[74996]: DEBUG nova.compute.manager [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:42:23 user nova-compute[74996]: INFO nova.compute.manager [None req-e59c0bbc-f5dc-4ab3-8cf2-bfd88d9486c1 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Unrescuing
Nov 02 01:42:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e59c0bbc-f5dc-4ab3-8cf2-bfd88d9486c1 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "refresh_cache-9d706c1a-883b-4b26-8972-4083df064e93" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e59c0bbc-f5dc-4ab3-8cf2-bfd88d9486c1 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquired lock "refresh_cache-9d706c1a-883b-4b26-8972-4083df064e93" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG nova.network.neutron [None req-e59c0bbc-f5dc-4ab3-8cf2-bfd88d9486c1 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:42:23 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Instance spawned successfully.
Nov 02 01:42:23 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:42:23 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:42:23 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=7752MB free_disk=25.133155822753906GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:42:23 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-3bce4a33-96c5-4850-8efb-c49845e47acf tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Snapshot image upload complete
Nov 02 01:42:23 user nova-compute[74996]: INFO nova.compute.manager [None req-3bce4a33-96c5-4850-8efb-c49845e47acf tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Took 9.12 seconds to snapshot the instance on the hypervisor.
Nov 02 01:42:23 user nova-compute[74996]: INFO nova.compute.manager [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Took 6.37 seconds to spawn the instance on the hypervisor.
Nov 02 01:42:23 user nova-compute[74996]: DEBUG nova.compute.manager [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance fea802b7-64d9-4c77-87a7-eaba1dce5c22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7307f3a3-1ad1-43f7-be49-9cd03a626cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance d8f51f7d-c9de-4914-883e-7a875d3d73ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 9d706c1a-883b-4b26-8972-4083df064e93 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 3b5719c9-08ad-4a01-b960-23328b537283 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance f0de5980-334b-4654-8b1a-88c4c861aa49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 5d834837-a1a1-436d-9015-b9b3bf048170 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance d28b9820-c059-46cb-9bb0-132e447fca1b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 382dce4d-dd73-4929-81dc-bcc3bb987045 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:42:23 user nova-compute[74996]: INFO nova.compute.manager [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Took 55.16 seconds to build instance.
Nov 02 01:42:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-06b3e7ba-c593-4295-8770-119d25177530 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "d28b9820-c059-46cb-9bb0-132e447fca1b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 55.320s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:42:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:24 user nova-compute[74996]: DEBUG nova.network.neutron [None req-e59c0bbc-f5dc-4ab3-8cf2-bfd88d9486c1 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Updating instance_info_cache with network_info: [{"id": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "address": "fa:16:3e:f0:bd:77", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9071ad51-8c", "ovs_interfaceid": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:42:24 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:42:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e59c0bbc-f5dc-4ab3-8cf2-bfd88d9486c1 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Releasing lock "refresh_cache-9d706c1a-883b-4b26-8972-4083df064e93" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:42:24 user nova-compute[74996]: DEBUG nova.objects.instance [None req-e59c0bbc-f5dc-4ab3-8cf2-bfd88d9486c1 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lazy-loading 'flavor' on Instance uuid 9d706c1a-883b-4b26-8972-4083df064e93 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:42:24 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:42:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:42:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.707s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:42:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:24 user nova-compute[74996]: DEBUG nova.compute.manager [req-09477857-8320-4bdb-ab2b-9d481f3abfdf req-dbe457d3-29f0-4cf9-be58-4f812b5e6ad4 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Received event network-vif-unplugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:42:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-09477857-8320-4bdb-ab2b-9d481f3abfdf req-dbe457d3-29f0-4cf9-be58-4f812b5e6ad4 service nova] Acquiring lock "9d706c1a-883b-4b26-8972-4083df064e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:42:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-09477857-8320-4bdb-ab2b-9d481f3abfdf req-dbe457d3-29f0-4cf9-be58-4f812b5e6ad4 service nova] Lock "9d706c1a-883b-4b26-8972-4083df064e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:42:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-09477857-8320-4bdb-ab2b-9d481f3abfdf req-dbe457d3-29f0-4cf9-be58-4f812b5e6ad4 service nova] Lock "9d706c1a-883b-4b26-8972-4083df064e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:42:24 user nova-compute[74996]: DEBUG nova.compute.manager [req-09477857-8320-4bdb-ab2b-9d481f3abfdf req-dbe457d3-29f0-4cf9-be58-4f812b5e6ad4 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] No waiting events found dispatching network-vif-unplugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:42:24 user nova-compute[74996]: WARNING nova.compute.manager [req-09477857-8320-4bdb-ab2b-9d481f3abfdf req-dbe457d3-29f0-4cf9-be58-4f812b5e6ad4 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Received unexpected event network-vif-unplugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c for instance with vm_state rescued and task_state unrescuing.
Nov 02 01:42:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:24 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Instance destroyed successfully.
Nov 02 01:42:25 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:42:25 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:42:25 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Rebuilding the list of instances to heal {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 01:42:25 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Skipping network cache update for instance because it is Building. {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Nov 02 01:42:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-fea802b7-64d9-4c77-87a7-eaba1dce5c22" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:42:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-fea802b7-64d9-4c77-87a7-eaba1dce5c22" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:42:25 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 01:42:25 user nova-compute[74996]: DEBUG nova.objects.instance [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lazy-loading 'info_cache' on Instance uuid fea802b7-64d9-4c77-87a7-eaba1dce5c22 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:42:25 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Updating instance_info_cache with network_info: [{"id": "c458c481-1588-4776-a269-8f95b72195dd", "address": "fa:16:3e:7f:23:3e", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc458c481-15", "ovs_interfaceid": "c458c481-1588-4776-a269-8f95b72195dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:42:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-fea802b7-64d9-4c77-87a7-eaba1dce5c22" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:42:25 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 01:42:25 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:42:25 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:42:25 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:42:25 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:42:25 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:42:26 user nova-compute[74996]: DEBUG nova.compute.manager [req-38ed18bb-b216-4626-a926-f700e8cde718 req-4df643e5-3d50-4a5d-a870-65c4ceb3cf9b service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Received event network-vif-plugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:42:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-38ed18bb-b216-4626-a926-f700e8cde718 req-4df643e5-3d50-4a5d-a870-65c4ceb3cf9b service nova] Acquiring lock "9d706c1a-883b-4b26-8972-4083df064e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:42:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-38ed18bb-b216-4626-a926-f700e8cde718 req-4df643e5-3d50-4a5d-a870-65c4ceb3cf9b service nova] Lock "9d706c1a-883b-4b26-8972-4083df064e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:42:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-38ed18bb-b216-4626-a926-f700e8cde718 req-4df643e5-3d50-4a5d-a870-65c4ceb3cf9b service nova] Lock "9d706c1a-883b-4b26-8972-4083df064e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:42:26 user nova-compute[74996]: DEBUG nova.compute.manager [req-38ed18bb-b216-4626-a926-f700e8cde718 req-4df643e5-3d50-4a5d-a870-65c4ceb3cf9b service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] No waiting events found dispatching network-vif-plugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:42:26 user nova-compute[74996]: WARNING nova.compute.manager [req-38ed18bb-b216-4626-a926-f700e8cde718 req-4df643e5-3d50-4a5d-a870-65c4ceb3cf9b service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Received unexpected event network-vif-plugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c for instance with vm_state rescued and task_state unrescuing.
Nov 02 01:42:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Acquiring lock "effec7f0-1006-4081-91f4-e2d96fd0a87a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:42:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "effec7f0-1006-4081-91f4-e2d96fd0a87a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:42:27 user nova-compute[74996]: DEBUG nova.compute.manager [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:42:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:42:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:42:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:42:27 user nova-compute[74996]: INFO nova.compute.claims [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Claim successful on node user
Nov 02 01:42:27 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:42:27 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:42:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:42:27 user nova-compute[74996]: DEBUG nova.compute.manager [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG nova.compute.manager [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG nova.network.neutron [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:42:28 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:42:28 user nova-compute[74996]: DEBUG nova.compute.manager [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:28 user nova-compute[74996]: INFO nova.virt.block_device [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Booting with volume 5b222ba0-7f5f-4d31-acb2-79257672c494 at /dev/vda
Nov 02 01:42:28 user nova-compute[74996]: DEBUG nova.policy [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '670f527ebd064a39a3d19edffd8393f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca87a25a8b244b7989ea459300036d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG os_brick.utils [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67b3d20-d6d6-42a1-b006-dcf644d12705]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[052bee95-b29b-4639-b686-00fc17d233d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[640309a4-4ca6-4ac6-b9a1-9d6515e3ea1d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8e9f2a-f7bd-4d9b-a16f-8c44a740697e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:42:28 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:42:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f903119a-0a8b-4f3c-82f1-a5173e68e755]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG os_brick.utils [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Updating existing volume attachment record: ef6104c2-d21b-4c90-9e5b-b827da2bb20b {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG nova.compute.manager [req-1104bced-1297-4d23-a5db-51a0bfa7b93f req-0f58aebc-9674-475b-97cc-edd2fa5a68f5 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Received event network-vif-plugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1104bced-1297-4d23-a5db-51a0bfa7b93f req-0f58aebc-9674-475b-97cc-edd2fa5a68f5 service nova] Acquiring lock "9d706c1a-883b-4b26-8972-4083df064e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1104bced-1297-4d23-a5db-51a0bfa7b93f req-0f58aebc-9674-475b-97cc-edd2fa5a68f5 service nova] Lock "9d706c1a-883b-4b26-8972-4083df064e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1104bced-1297-4d23-a5db-51a0bfa7b93f req-0f58aebc-9674-475b-97cc-edd2fa5a68f5 service nova] Lock "9d706c1a-883b-4b26-8972-4083df064e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG nova.compute.manager [req-1104bced-1297-4d23-a5db-51a0bfa7b93f req-0f58aebc-9674-475b-97cc-edd2fa5a68f5 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] No waiting events found dispatching network-vif-plugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:42:28 user nova-compute[74996]: WARNING nova.compute.manager [req-1104bced-1297-4d23-a5db-51a0bfa7b93f req-0f58aebc-9674-475b-97cc-edd2fa5a68f5 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Received unexpected event network-vif-plugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c for instance with vm_state rescued and task_state unrescuing.
Nov 02 01:42:28 user nova-compute[74996]: DEBUG nova.compute.manager [req-1104bced-1297-4d23-a5db-51a0bfa7b93f req-0f58aebc-9674-475b-97cc-edd2fa5a68f5 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Received event network-vif-plugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1104bced-1297-4d23-a5db-51a0bfa7b93f req-0f58aebc-9674-475b-97cc-edd2fa5a68f5 service nova] Acquiring lock "9d706c1a-883b-4b26-8972-4083df064e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1104bced-1297-4d23-a5db-51a0bfa7b93f req-0f58aebc-9674-475b-97cc-edd2fa5a68f5 service nova] Lock "9d706c1a-883b-4b26-8972-4083df064e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1104bced-1297-4d23-a5db-51a0bfa7b93f req-0f58aebc-9674-475b-97cc-edd2fa5a68f5 service nova] Lock "9d706c1a-883b-4b26-8972-4083df064e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:42:28 user nova-compute[74996]: DEBUG nova.compute.manager [req-1104bced-1297-4d23-a5db-51a0bfa7b93f req-0f58aebc-9674-475b-97cc-edd2fa5a68f5 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] No waiting events found dispatching network-vif-plugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:42:28 user nova-compute[74996]: WARNING nova.compute.manager [req-1104bced-1297-4d23-a5db-51a0bfa7b93f req-0f58aebc-9674-475b-97cc-edd2fa5a68f5 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Received unexpected event network-vif-plugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c for instance with vm_state rescued and task_state unrescuing.
Nov 02 01:42:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:29 user nova-compute[74996]: DEBUG nova.compute.manager [None req-e59c0bbc-f5dc-4ab3-8cf2-bfd88d9486c1 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:42:29 user nova-compute[74996]: DEBUG nova.network.neutron [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Successfully created port: 8cf50e3d-3da4-48fc-9cc9-bfe88441b531 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:42:30 user nova-compute[74996]: DEBUG nova.network.neutron [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Successfully updated port: 8cf50e3d-3da4-48fc-9cc9-bfe88441b531 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:42:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Acquiring lock "refresh_cache-effec7f0-1006-4081-91f4-e2d96fd0a87a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:42:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Acquired lock "refresh_cache-effec7f0-1006-4081-91f4-e2d96fd0a87a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:42:30 user nova-compute[74996]: DEBUG nova.network.neutron [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:42:30 user nova-compute[74996]: DEBUG nova.network.neutron [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:42:30 user nova-compute[74996]: DEBUG nova.network.neutron [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Updating instance_info_cache with network_info: [{"id": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "address": "fa:16:3e:56:0b:6b", "network": {"id": "b3014958-040c-44b4-94cc-1099e8fe3750", "bridge": "br-int", "label": "tempest-TestShelveInstance-1407890304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca87a25a8b244b7989ea459300036d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf50e3d-3d", "ovs_interfaceid": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:42:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Releasing lock "refresh_cache-effec7f0-1006-4081-91f4-e2d96fd0a87a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:42:30 user nova-compute[74996]: DEBUG nova.compute.manager [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Instance network_info: |[{"id": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "address": "fa:16:3e:56:0b:6b", "network": {"id": "b3014958-040c-44b4-94cc-1099e8fe3750", "bridge": "br-int", "label": "tempest-TestShelveInstance-1407890304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca87a25a8b244b7989ea459300036d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf50e3d-3d", "ovs_interfaceid": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:42:30 user nova-compute[74996]: DEBUG nova.compute.manager [req-2cf8c7b8-a29f-4981-aee4-9868cbf6a2d9 req-af109ba1-7385-4003-9bfa-b0627984caff service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Received event network-changed-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:42:30 user nova-compute[74996]: DEBUG nova.compute.manager [req-2cf8c7b8-a29f-4981-aee4-9868cbf6a2d9 req-af109ba1-7385-4003-9bfa-b0627984caff service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Refreshing instance network info cache due to event network-changed-8cf50e3d-3da4-48fc-9cc9-bfe88441b531. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:42:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2cf8c7b8-a29f-4981-aee4-9868cbf6a2d9 req-af109ba1-7385-4003-9bfa-b0627984caff service nova] Acquiring lock "refresh_cache-effec7f0-1006-4081-91f4-e2d96fd0a87a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:42:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2cf8c7b8-a29f-4981-aee4-9868cbf6a2d9 req-af109ba1-7385-4003-9bfa-b0627984caff service nova] Acquired lock "refresh_cache-effec7f0-1006-4081-91f4-e2d96fd0a87a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:42:30 user nova-compute[74996]: DEBUG nova.network.neutron [req-2cf8c7b8-a29f-4981-aee4-9868cbf6a2d9 req-af109ba1-7385-4003-9bfa-b0627984caff service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Refreshing network info cache for port 8cf50e3d-3da4-48fc-9cc9-bfe88441b531 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG nova.network.neutron [req-2cf8c7b8-a29f-4981-aee4-9868cbf6a2d9 req-af109ba1-7385-4003-9bfa-b0627984caff service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Updated VIF entry in instance network info cache for port 8cf50e3d-3da4-48fc-9cc9-bfe88441b531. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG nova.network.neutron [req-2cf8c7b8-a29f-4981-aee4-9868cbf6a2d9 req-af109ba1-7385-4003-9bfa-b0627984caff service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Updating instance_info_cache with network_info: [{"id": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "address": "fa:16:3e:56:0b:6b", "network": {"id": "b3014958-040c-44b4-94cc-1099e8fe3750", "bridge": "br-int", "label": "tempest-TestShelveInstance-1407890304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca87a25a8b244b7989ea459300036d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf50e3d-3d", "ovs_interfaceid": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2cf8c7b8-a29f-4981-aee4-9868cbf6a2d9 req-af109ba1-7385-4003-9bfa-b0627984caff service nova] Releasing lock "refresh_cache-effec7f0-1006-4081-91f4-e2d96fd0a87a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG nova.compute.manager [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:42:31 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Creating image(s)
Nov 02 01:42:31 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Did not create local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Ensure instance console log exists: /opt/stack/data/nova/instances/382dce4d-dd73-4929-81dc-bcc3bb987045/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Start _get_guest_xml network_info=[{"id": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "address": "fa:16:3e:a3:71:72", "network": {"id": "2923ade6-4530-4109-8e37-67123fa93c05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-147878200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b53bc3f0b994ceeb8e6cff9f8fb1980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce4de8d2-0f", "ovs_interfaceid": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd48dbf4c-43ef-4b9e-9fbc-30f778d6f869', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MOdlBbYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '382dce4d-dd73-4929-81dc-bcc3bb987045', 'attached_at': '', 'detached_at': '', 'volume_id': '5f7cff97-bd0e-4b25-a3da-398d425d9ed4', 'serial': '5f7cff97-bd0e-4b25-a3da-398d425d9ed4'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:42:31 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:42:31 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:42:31 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MOdlBbYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:42:31 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:42:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:42:31 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:42:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:42:31 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cebcc2-67da-4fda-80f4-2211f7b2fdd6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:42:31 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[84891e8b-2bd7-4587-b911-9aea48414b94]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4] added
Nov 02 01:42:31 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[55778568-6efd-41f8-a1a3-a73d4d002e9d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b372577b-d63c-46e0-9e15-4a81c302727f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MOdlBbYq {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MOdlBbYq" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ab31dd-9da8-41f5-9c6f-dbc2e5b72ee9]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MOdlBbYq'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[832ad92d-2d90-453b-9286-48ecb52d07b2]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6255aae6-ed13-4c24-ba78-db5e6c02b8e7]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:42:31 user nova-compute[74996]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:42:31 user nova-compute[74996]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)
Nov 02 01:42:31 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:42:31 user nova-compute[74996]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:42:31 user nova-compute[74996]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)
Nov 02 01:42:31 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[68aea32d-8ea2-4ed3-a9f3-4cac66846082]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4, portal: 172.16.0.220,3260]
Nov 02 01:42:31 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4, portal: 172.16.0.220,3260] successful.
Nov 02 01:42:31 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[789c3dcd-2c37-4a5b-b975-38c9a8423644]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11624dc-af21-4726-b166-4b601ff5065e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:42:31 user nova-compute[74996]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:42:31 user nova-compute[74996]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)
Nov 02 01:42:31 user nova-compute[74996]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)
Nov 02 01:42:31 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:42:31 user nova-compute[74996]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:42:31 user nova-compute[74996]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)
Nov 02 01:42:31 user nova-compute[74996]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)
Nov 02 01:42:31 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[52544096-db60-4271-b78b-0743c87e2526]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:42:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MOdlBbYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:42:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:42:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '26633346133383932', 'path': '/dev/sde'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:42:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633346133383932', 'path': '/dev/sde'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:42:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-692359628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-692359628',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY+Zv0aRo1up7UitzxFVT1vKWf8cixyY3iz2qNf6VRlBWYW6c7XWIJe+dxRZCmSX/K8EfSE0Gl/Oobz82iIrY1fQpASD+/UO110wRUprmiqDBAkbDpFOw/i0LToaceywQ==',key_name='tempest-keypair-693568396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b53bc3f0b994ceeb8e6cff9f8fb1980',ramdisk_id='',reservation_id='r-uylmojhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-272873490',owner_user_name='tempest-ServerActionsV293TestJSON-272873490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:41:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3295b6af73fe474ca0c00efe655866ec',uuid=382dce4d-dd73-4929-81dc-bcc3bb987045,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "address": "fa:16:3e:a3:71:72", "network": {"id": "2923ade6-4530-4109-8e37-67123fa93c05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-147878200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b53bc3f0b994ceeb8e6cff9f8fb1980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce4de8d2-0f", "ovs_interfaceid": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:42:32 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Converting VIF {"id": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "address": "fa:16:3e:a3:71:72", "network": {"id": "2923ade6-4530-4109-8e37-67123fa93c05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-147878200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b53bc3f0b994ceeb8e6cff9f8fb1980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce4de8d2-0f", "ovs_interfaceid": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:42:32 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:71:72,bridge_name='br-int',has_traffic_filtering=True,id=ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf,network=Network(2923ade6-4530-4109-8e37-67123fa93c05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce4de8d2-0f') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:42:32 user nova-compute[74996]: DEBUG nova.objects.instance [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lazy-loading 'pci_devices' on Instance uuid 382dce4d-dd73-4929-81dc-bcc3bb987045 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:42:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:42:32 user nova-compute[74996]:   <uuid>382dce4d-dd73-4929-81dc-bcc3bb987045</uuid>
Nov 02 01:42:32 user nova-compute[74996]:   <name>instance-0000001a</name>
Nov 02 01:42:32 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:42:32 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:42:32 user nova-compute[74996]:   <metadata>
Nov 02 01:42:32 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:42:32 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:42:32 user nova-compute[74996]:       <nova:name>tempest-ServerActionsV293TestJSON-server-692359628</nova:name>
Nov 02 01:42:32 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:42:31</nova:creationTime>
Nov 02 01:42:32 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:42:32 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:42:32 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:42:32 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:42:32 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:42:32 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:42:32 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:42:32 user nova-compute[74996]:       <nova:owner>
Nov 02 01:42:32 user nova-compute[74996]:         <nova:user uuid="3295b6af73fe474ca0c00efe655866ec">tempest-ServerActionsV293TestJSON-272873490-project-member</nova:user>
Nov 02 01:42:32 user nova-compute[74996]:         <nova:project uuid="3b53bc3f0b994ceeb8e6cff9f8fb1980">tempest-ServerActionsV293TestJSON-272873490</nova:project>
Nov 02 01:42:32 user nova-compute[74996]:       </nova:owner>
Nov 02 01:42:32 user nova-compute[74996]:       <nova:ports>
Nov 02 01:42:32 user nova-compute[74996]:         <nova:port uuid="ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf">
Nov 02 01:42:32 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 02 01:42:32 user nova-compute[74996]:         </nova:port>
Nov 02 01:42:32 user nova-compute[74996]:       </nova:ports>
Nov 02 01:42:32 user nova-compute[74996]:     </nova:instance>
Nov 02 01:42:32 user nova-compute[74996]:   </metadata>
Nov 02 01:42:32 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:42:32 user nova-compute[74996]:     <system>
Nov 02 01:42:32 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:42:32 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:42:32 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:42:32 user nova-compute[74996]:       <entry name="serial">382dce4d-dd73-4929-81dc-bcc3bb987045</entry>
Nov 02 01:42:32 user nova-compute[74996]:       <entry name="uuid">382dce4d-dd73-4929-81dc-bcc3bb987045</entry>
Nov 02 01:42:32 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:42:32 user nova-compute[74996]:     </system>
Nov 02 01:42:32 user nova-compute[74996]:   </sysinfo>
Nov 02 01:42:32 user nova-compute[74996]:   <os>
Nov 02 01:42:32 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:42:32 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:42:32 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:42:32 user nova-compute[74996]:   </os>
Nov 02 01:42:32 user nova-compute[74996]:   <features>
Nov 02 01:42:32 user nova-compute[74996]:     <acpi/>
Nov 02 01:42:32 user nova-compute[74996]:     <apic/>
Nov 02 01:42:32 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:42:32 user nova-compute[74996]:   </features>
Nov 02 01:42:32 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:42:32 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:42:32 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:42:32 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:42:32 user nova-compute[74996]:   </clock>
Nov 02 01:42:32 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:42:32 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:42:32 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:42:32 user nova-compute[74996]:   </cpu>
Nov 02 01:42:32 user nova-compute[74996]:   <devices>
Nov 02 01:42:32 user nova-compute[74996]:     <disk type="block" device="disk">
Nov 02 01:42:32 user nova-compute[74996]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:42:32 user nova-compute[74996]:       <source dev="/dev/sde"/>
Nov 02 01:42:32 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:42:32 user nova-compute[74996]:       <serial>5f7cff97-bd0e-4b25-a3da-398d425d9ed4</serial>
Nov 02 01:42:32 user nova-compute[74996]:     </disk>
Nov 02 01:42:32 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:42:32 user nova-compute[74996]:       <mac address="fa:16:3e:a3:71:72"/>
Nov 02 01:42:32 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:42:32 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:42:32 user nova-compute[74996]:       <target dev="tapce4de8d2-0f"/>
Nov 02 01:42:32 user nova-compute[74996]:     </interface>
Nov 02 01:42:32 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:42:32 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/382dce4d-dd73-4929-81dc-bcc3bb987045/console.log" append="off"/>
Nov 02 01:42:32 user nova-compute[74996]:     </serial>
Nov 02 01:42:32 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:42:32 user nova-compute[74996]:     <video>
Nov 02 01:42:32 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:42:32 user nova-compute[74996]:     </video>
Nov 02 01:42:32 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:42:32 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:42:32 user nova-compute[74996]:     </rng>
Nov 02 01:42:32 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:42:32 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:42:32 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:42:32 user nova-compute[74996]:     </memballoon>
Nov 02 01:42:32 user nova-compute[74996]:   </devices>
Nov 02 01:42:32 user nova-compute[74996]: </domain>
Nov 02 01:42:32 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:42:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-692359628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-692359628',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY+Zv0aRo1up7UitzxFVT1vKWf8cixyY3iz2qNf6VRlBWYW6c7XWIJe+dxRZCmSX/K8EfSE0Gl/Oobz82iIrY1fQpASD+/UO110wRUprmiqDBAkbDpFOw/i0LToaceywQ==',key_name='tempest-keypair-693568396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b53bc3f0b994ceeb8e6cff9f8fb1980',ramdisk_id='',reservation_id='r-uylmojhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-272873490',owner_user_name='tempest-ServerActionsV293TestJSON-272873490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:41:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3295b6af73fe474ca0c00efe655866ec',uuid=382dce4d-dd73-4929-81dc-bcc3bb987045,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "address": "fa:16:3e:a3:71:72", "network": {"id": "2923ade6-4530-4109-8e37-67123fa93c05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-147878200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b53bc3f0b994ceeb8e6cff9f8fb1980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce4de8d2-0f", "ovs_interfaceid": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:42:32 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Converting VIF {"id": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "address": "fa:16:3e:a3:71:72", "network": {"id": "2923ade6-4530-4109-8e37-67123fa93c05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-147878200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b53bc3f0b994ceeb8e6cff9f8fb1980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce4de8d2-0f", "ovs_interfaceid": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:42:32 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:71:72,bridge_name='br-int',has_traffic_filtering=True,id=ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf,network=Network(2923ade6-4530-4109-8e37-67123fa93c05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce4de8d2-0f') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:42:32 user nova-compute[74996]: DEBUG os_vif [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:71:72,bridge_name='br-int',has_traffic_filtering=True,id=ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf,network=Network(2923ade6-4530-4109-8e37-67123fa93c05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce4de8d2-0f') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:42:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:42:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:42:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f885463-0f88-51c9-a83b-33f97e2ff533', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:42:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:42:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce4de8d2-0f, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:42:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapce4de8d2-0f, col_values=(('qos', UUID('50025818-5eea-4f13-af3c-6f1852c97d18')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:42:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapce4de8d2-0f, col_values=(('external_ids', {'iface-id': 'ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:71:72', 'vm-uuid': '382dce4d-dd73-4929-81dc-bcc3bb987045'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:42:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:42:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:32 user nova-compute[74996]: INFO os_vif [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:71:72,bridge_name='br-int',has_traffic_filtering=True,id=ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf,network=Network(2923ade6-4530-4109-8e37-67123fa93c05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce4de8d2-0f')
Nov 02 01:42:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:42:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] No VIF found with MAC fa:16:3e:a3:71:72, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:42:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:34 user nova-compute[74996]: DEBUG nova.compute.manager [req-cb46fb1a-5985-44d3-af75-26f497479a93 req-6e42ac00-1ccb-4dbd-9a55-974bc66631a4 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Received event network-changed-39bb24a8-37e5-43fc-839b-203634b56ad6 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:42:34 user nova-compute[74996]: DEBUG nova.compute.manager [req-cb46fb1a-5985-44d3-af75-26f497479a93 req-6e42ac00-1ccb-4dbd-9a55-974bc66631a4 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Refreshing instance network info cache due to event network-changed-39bb24a8-37e5-43fc-839b-203634b56ad6. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:42:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cb46fb1a-5985-44d3-af75-26f497479a93 req-6e42ac00-1ccb-4dbd-9a55-974bc66631a4 service nova] Acquiring lock "refresh_cache-3b5719c9-08ad-4a01-b960-23328b537283" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:42:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cb46fb1a-5985-44d3-af75-26f497479a93 req-6e42ac00-1ccb-4dbd-9a55-974bc66631a4 service nova] Acquired lock "refresh_cache-3b5719c9-08ad-4a01-b960-23328b537283" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:42:34 user nova-compute[74996]: DEBUG nova.network.neutron [req-cb46fb1a-5985-44d3-af75-26f497479a93 req-6e42ac00-1ccb-4dbd-9a55-974bc66631a4 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Refreshing network info cache for port 39bb24a8-37e5-43fc-839b-203634b56ad6 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:42:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:34 user nova-compute[74996]: DEBUG nova.compute.manager [req-79a103c6-2cb1-4335-a9df-d4d1b1099561 req-32e15eb2-4b7c-456c-a6a2-3fd79935083e service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Received event network-vif-plugged-ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:42:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-79a103c6-2cb1-4335-a9df-d4d1b1099561 req-32e15eb2-4b7c-456c-a6a2-3fd79935083e service nova] Acquiring lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:42:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-79a103c6-2cb1-4335-a9df-d4d1b1099561 req-32e15eb2-4b7c-456c-a6a2-3fd79935083e service nova] Lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:42:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-79a103c6-2cb1-4335-a9df-d4d1b1099561 req-32e15eb2-4b7c-456c-a6a2-3fd79935083e service nova] Lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:42:34 user nova-compute[74996]: DEBUG nova.compute.manager [req-79a103c6-2cb1-4335-a9df-d4d1b1099561 req-32e15eb2-4b7c-456c-a6a2-3fd79935083e service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] No waiting events found dispatching network-vif-plugged-ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:42:34 user nova-compute[74996]: WARNING nova.compute.manager [req-79a103c6-2cb1-4335-a9df-d4d1b1099561 req-32e15eb2-4b7c-456c-a6a2-3fd79935083e service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Received unexpected event network-vif-plugged-ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf for instance with vm_state building and task_state spawning.
Nov 02 01:42:35 user nova-compute[74996]: DEBUG nova.network.neutron [req-cb46fb1a-5985-44d3-af75-26f497479a93 req-6e42ac00-1ccb-4dbd-9a55-974bc66631a4 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Updated VIF entry in instance network info cache for port 39bb24a8-37e5-43fc-839b-203634b56ad6. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:42:35 user nova-compute[74996]: DEBUG nova.network.neutron [req-cb46fb1a-5985-44d3-af75-26f497479a93 req-6e42ac00-1ccb-4dbd-9a55-974bc66631a4 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Updating instance_info_cache with network_info: [{"id": "39bb24a8-37e5-43fc-839b-203634b56ad6", "address": "fa:16:3e:31:e2:fb", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bb24a8-37", "ovs_interfaceid": "39bb24a8-37e5-43fc-839b-203634b56ad6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:42:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cb46fb1a-5985-44d3-af75-26f497479a93 req-6e42ac00-1ccb-4dbd-9a55-974bc66631a4 service nova] Releasing lock "refresh_cache-3b5719c9-08ad-4a01-b960-23328b537283" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:42:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-681bb13c-53f9-4d57-91e2-29fc63835099 req-1dc9a83d-9466-450f-a412-0a77614b2b37 service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Received event network-vif-plugged-ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:42:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-681bb13c-53f9-4d57-91e2-29fc63835099 req-1dc9a83d-9466-450f-a412-0a77614b2b37 service nova] Acquiring lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:42:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-681bb13c-53f9-4d57-91e2-29fc63835099 req-1dc9a83d-9466-450f-a412-0a77614b2b37 service nova] Lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:42:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-681bb13c-53f9-4d57-91e2-29fc63835099 req-1dc9a83d-9466-450f-a412-0a77614b2b37 service nova] Lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:42:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-681bb13c-53f9-4d57-91e2-29fc63835099 req-1dc9a83d-9466-450f-a412-0a77614b2b37 service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] No waiting events found dispatching network-vif-plugged-ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:42:36 user nova-compute[74996]: WARNING nova.compute.manager [req-681bb13c-53f9-4d57-91e2-29fc63835099 req-1dc9a83d-9466-450f-a412-0a77614b2b37 service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Received unexpected event network-vif-plugged-ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf for instance with vm_state building and task_state spawning.
Nov 02 01:42:37 user nova-compute[74996]: DEBUG nova.compute.manager [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:42:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:42:37 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Instance spawned successfully.
Nov 02 01:42:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:42:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:42:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:42:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:42:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:42:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:42:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:42:37 user nova-compute[74996]: INFO nova.compute.manager [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Took 6.13 seconds to spawn the instance on the hypervisor.
Nov 02 01:42:37 user nova-compute[74996]: DEBUG nova.compute.manager [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:42:37 user nova-compute[74996]: INFO nova.compute.manager [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Took 43.66 seconds to build instance.
Nov 02 01:42:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bf09fd38-7a20-41aa-aecd-c3a5b604754e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "382dce4d-dd73-4929-81dc-bcc3bb987045" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.821s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:42:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:42:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:42:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:42:59 user nova-compute[74996]: DEBUG nova.compute.manager [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:42:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:42:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:42:59 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:42:59 user nova-compute[74996]: INFO nova.compute.claims [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Claim successful on node user
Nov 02 01:43:00 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:43:00 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:43:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:43:00 user nova-compute[74996]: DEBUG nova.compute.manager [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:43:00 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:43:00 user nova-compute[74996]: DEBUG nova.compute.manager [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:43:00 user nova-compute[74996]: DEBUG nova.network.neutron [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:43:00 user nova-compute[74996]: DEBUG nova.compute.manager [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:43:00 user nova-compute[74996]: DEBUG nova.policy [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be6bf504c3a649898e8c83399f6fee8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31965b482eb243a69112a49bf1302779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:43:00 user nova-compute[74996]: INFO nova.virt.block_device [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Booting with volume snapshot b9ba5074-ee46-4615-b0cb-d54cfd757403 at /dev/vda
Nov 02 01:43:00 user nova-compute[74996]: DEBUG nova.network.neutron [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Successfully created port: 2fc01b4a-295e-4fa2-97c2-f76e903c1a41 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:43:01 user nova-compute[74996]: DEBUG nova.network.neutron [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Successfully updated port: 2fc01b4a-295e-4fa2-97c2-f76e903c1a41 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:43:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "refresh_cache-2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:43:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquired lock "refresh_cache-2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:43:01 user nova-compute[74996]: DEBUG nova.network.neutron [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:43:01 user nova-compute[74996]: DEBUG nova.compute.manager [req-ec2714d7-9988-4291-a7bd-051cc08c39fb req-f99575f8-1103-42fe-9380-2b300eac44fb service nova] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Received event network-changed-2fc01b4a-295e-4fa2-97c2-f76e903c1a41 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:43:01 user nova-compute[74996]: DEBUG nova.compute.manager [req-ec2714d7-9988-4291-a7bd-051cc08c39fb req-f99575f8-1103-42fe-9380-2b300eac44fb service nova] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Refreshing instance network info cache due to event network-changed-2fc01b4a-295e-4fa2-97c2-f76e903c1a41. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:43:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ec2714d7-9988-4291-a7bd-051cc08c39fb req-f99575f8-1103-42fe-9380-2b300eac44fb service nova] Acquiring lock "refresh_cache-2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:43:01 user nova-compute[74996]: DEBUG nova.network.neutron [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:43:01 user nova-compute[74996]: DEBUG nova.network.neutron [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Updating instance_info_cache with network_info: [{"id": "2fc01b4a-295e-4fa2-97c2-f76e903c1a41", "address": "fa:16:3e:25:84:57", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc01b4a-29", "ovs_interfaceid": "2fc01b4a-295e-4fa2-97c2-f76e903c1a41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:43:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Releasing lock "refresh_cache-2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:43:01 user nova-compute[74996]: DEBUG nova.compute.manager [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Instance network_info: |[{"id": "2fc01b4a-295e-4fa2-97c2-f76e903c1a41", "address": "fa:16:3e:25:84:57", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc01b4a-29", "ovs_interfaceid": "2fc01b4a-295e-4fa2-97c2-f76e903c1a41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:43:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ec2714d7-9988-4291-a7bd-051cc08c39fb req-f99575f8-1103-42fe-9380-2b300eac44fb service nova] Acquired lock "refresh_cache-2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:43:01 user nova-compute[74996]: DEBUG nova.network.neutron [req-ec2714d7-9988-4291-a7bd-051cc08c39fb req-f99575f8-1103-42fe-9380-2b300eac44fb service nova] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Refreshing network info cache for port 2fc01b4a-295e-4fa2-97c2-f76e903c1a41 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:43:02 user nova-compute[74996]: DEBUG nova.network.neutron [req-ec2714d7-9988-4291-a7bd-051cc08c39fb req-f99575f8-1103-42fe-9380-2b300eac44fb service nova] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Updated VIF entry in instance network info cache for port 2fc01b4a-295e-4fa2-97c2-f76e903c1a41. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:43:02 user nova-compute[74996]: DEBUG nova.network.neutron [req-ec2714d7-9988-4291-a7bd-051cc08c39fb req-f99575f8-1103-42fe-9380-2b300eac44fb service nova] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Updating instance_info_cache with network_info: [{"id": "2fc01b4a-295e-4fa2-97c2-f76e903c1a41", "address": "fa:16:3e:25:84:57", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc01b4a-29", "ovs_interfaceid": "2fc01b4a-295e-4fa2-97c2-f76e903c1a41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:43:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ec2714d7-9988-4291-a7bd-051cc08c39fb req-f99575f8-1103-42fe-9380-2b300eac44fb service nova] Releasing lock "refresh_cache-2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:43:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:04 user nova-compute[74996]: DEBUG nova.compute.manager [req-96f5a399-2f91-4883-97d2-1e3474c79eee req-40e5bc6f-e01f-4fdd-89f4-1d4f87a87fff service nova] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Received event network-changed-eda8feac-2d2d-4be0-aa50-ef4d7b2448d8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:43:04 user nova-compute[74996]: DEBUG nova.compute.manager [req-96f5a399-2f91-4883-97d2-1e3474c79eee req-40e5bc6f-e01f-4fdd-89f4-1d4f87a87fff service nova] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Refreshing instance network info cache due to event network-changed-eda8feac-2d2d-4be0-aa50-ef4d7b2448d8. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:43:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-96f5a399-2f91-4883-97d2-1e3474c79eee req-40e5bc6f-e01f-4fdd-89f4-1d4f87a87fff service nova] Acquiring lock "refresh_cache-5d834837-a1a1-436d-9015-b9b3bf048170" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:43:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-96f5a399-2f91-4883-97d2-1e3474c79eee req-40e5bc6f-e01f-4fdd-89f4-1d4f87a87fff service nova] Acquired lock "refresh_cache-5d834837-a1a1-436d-9015-b9b3bf048170" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:43:04 user nova-compute[74996]: DEBUG nova.network.neutron [req-96f5a399-2f91-4883-97d2-1e3474c79eee req-40e5bc6f-e01f-4fdd-89f4-1d4f87a87fff service nova] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Refreshing network info cache for port eda8feac-2d2d-4be0-aa50-ef4d7b2448d8 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:43:05 user nova-compute[74996]: DEBUG nova.network.neutron [req-96f5a399-2f91-4883-97d2-1e3474c79eee req-40e5bc6f-e01f-4fdd-89f4-1d4f87a87fff service nova] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Updated VIF entry in instance network info cache for port eda8feac-2d2d-4be0-aa50-ef4d7b2448d8. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:43:05 user nova-compute[74996]: DEBUG nova.network.neutron [req-96f5a399-2f91-4883-97d2-1e3474c79eee req-40e5bc6f-e01f-4fdd-89f4-1d4f87a87fff service nova] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Updating instance_info_cache with network_info: [{"id": "eda8feac-2d2d-4be0-aa50-ef4d7b2448d8", "address": "fa:16:3e:8e:ff:6b", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeda8feac-2d", "ovs_interfaceid": "eda8feac-2d2d-4be0-aa50-ef4d7b2448d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:43:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-96f5a399-2f91-4883-97d2-1e3474c79eee req-40e5bc6f-e01f-4fdd-89f4-1d4f87a87fff service nova] Releasing lock "refresh_cache-5d834837-a1a1-436d-9015-b9b3bf048170" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:43:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:11 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:43:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "5d834837-a1a1-436d-9015-b9b3bf048170" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:43:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "5d834837-a1a1-436d-9015-b9b3bf048170" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:43:14 user nova-compute[74996]: DEBUG nova.objects.instance [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lazy-loading 'flavor' on Instance uuid 5d834837-a1a1-436d-9015-b9b3bf048170 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:43:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "5d834837-a1a1-436d-9015-b9b3bf048170" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:43:14 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:43:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "5d834837-a1a1-436d-9015-b9b3bf048170" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:43:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "5d834837-a1a1-436d-9015-b9b3bf048170" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:43:14 user nova-compute[74996]: INFO nova.compute.manager [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Attaching volume deb4bea3-2efc-4eae-a22d-174ac978701e to /dev/vdb
Nov 02 01:43:14 user nova-compute[74996]: DEBUG os_brick.utils [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:43:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:14 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[79389c01-a0d4-42b3-95f8-e0d0610b26ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:14 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c42412a-7a99-4a6e-8c45-a8f9efb65435]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:14 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b1cfc6-841c-4adb-bc88-2bf812cf3d59]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:14 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a86ffa-096a-437c-b836-83fd93ccbd81]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:43:14 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:43:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:43:14 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:43:14 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[306b8f0e-f298-4159-a8b1-23c8d70d7e49]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:14 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:43:14 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:43:14 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:43:14 user nova-compute[74996]: DEBUG os_brick.utils [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:43:14 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Updating existing volume attachment record: da33048e-d452-4afe-823e-57cd0ed33ad8 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:43:16 user nova-compute[74996]: DEBUG os_brick.utils [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:43:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd7736a-d7d3-4a67-815e-9c3725f2855c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d96de4f-879d-4b0b-9904-327721e31888]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29486a7-b09b-4d3f-a322-8bbf06ce5a4c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fe3725-eb0f-48c7-9582-aa434fbcf17a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:43:16 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:43:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:43:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:43:16 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:43:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40f31bb-bd27-468a-ace5-3104cdb4f077]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:43:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:43:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:43:16 user nova-compute[74996]: DEBUG os_brick.utils [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:43:16 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Updating existing volume attachment record: b135cfcd-8cb7-46be-9d8e-485939071bc2 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:43:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:18 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:43:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:43:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:43:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:43:18 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:43:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:43:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d834837-a1a1-436d-9015-b9b3bf048170/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d834837-a1a1-436d-9015-b9b3bf048170/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d834837-a1a1-436d-9015-b9b3bf048170/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d834837-a1a1-436d-9015-b9b3bf048170/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:43:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:20 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:43:20 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:43:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:20 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:43:20 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:43:20 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=7480MB free_disk=25.091442108154297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:43:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:43:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:43:21 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance fea802b7-64d9-4c77-87a7-eaba1dce5c22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:43:21 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7307f3a3-1ad1-43f7-be49-9cd03a626cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:43:21 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance d8f51f7d-c9de-4914-883e-7a875d3d73ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:43:21 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 9d706c1a-883b-4b26-8972-4083df064e93 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:43:21 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 3b5719c9-08ad-4a01-b960-23328b537283 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:43:21 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance f0de5980-334b-4654-8b1a-88c4c861aa49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:43:21 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 5d834837-a1a1-436d-9015-b9b3bf048170 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:43:21 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance d28b9820-c059-46cb-9bb0-132e447fca1b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:43:21 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 382dce4d-dd73-4929-81dc-bcc3bb987045 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:43:21 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance effec7f0-1006-4081-91f4-e2d96fd0a87a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:43:21 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:43:21 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:43:21 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:43:21 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:43:21 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:43:21 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:43:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.635s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:43:22 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:43:22 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:43:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-7307f3a3-1ad1-43f7-be49-9cd03a626cd7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:43:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-7307f3a3-1ad1-43f7-be49-9cd03a626cd7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:43:22 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 01:43:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:43:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:23 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Updating instance_info_cache with network_info: [{"id": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "address": "fa:16:3e:97:27:02", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb645a26c-6f", "ovs_interfaceid": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:43:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-7307f3a3-1ad1-43f7-be49-9cd03a626cd7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:43:23 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 01:43:23 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:43:23 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:43:23 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:43:23 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:43:23 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:43:27 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:43:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:30 user nova-compute[74996]: DEBUG nova.compute.manager [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:43:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:43:30 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Creating image(s)
Nov 02 01:43:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Did not create local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 01:43:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Ensure instance console log exists: /opt/stack/data/nova/instances/effec7f0-1006-4081-91f4-e2d96fd0a87a/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:43:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:43:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:43:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:43:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Start _get_guest_xml network_info=[{"id": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "address": "fa:16:3e:56:0b:6b", "network": {"id": "b3014958-040c-44b4-94cc-1099e8fe3750", "bridge": "br-int", "label": "tempest-TestShelveInstance-1407890304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca87a25a8b244b7989ea459300036d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf50e3d-3d", "ovs_interfaceid": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ef6104c2-d21b-4c90-9e5b-b827da2bb20b', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VOtcoRsW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'effec7f0-1006-4081-91f4-e2d96fd0a87a', 'attached_at': '', 'detached_at': '', 'volume_id': '5b222ba0-7f5f-4d31-acb2-79257672c494', 'serial': '5b222ba0-7f5f-4d31-acb2-79257672c494'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:43:30 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:43:30 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:43:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:43:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:43:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:43:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:43:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:43:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:43:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:43:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:43:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:43:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:43:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:43:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:43:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:43:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:43:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:43:30 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:43:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:43:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VOtcoRsW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:43:30 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:43:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:43:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:43:30 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:43:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:43:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:43:30 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:43:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2d6c3e-ed81-4b62-be23-694710579b30]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:43:31 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd09e98e-aa04-4a41-ad8b-7c7048b2ad52]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494] added
Nov 02 01:43:31 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.080s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14e7031-f5b4-46c8-9f9a-8d217fb8bd21]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3a625f-d629-44ac-bb5b-cfc7f62d7fd3]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VOtcoRsW {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VOtcoRsW" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[243f9f7e-d35a-4df0-8a31-71495772de55]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VOtcoRsW'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2523d98a-e3f9-49aa-8f39-adcc2f795c4e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e37805-608f-43b8-b850-ae1c6c4d5b88]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:43:31 user nova-compute[74996]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:43:31 user nova-compute[74996]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)
Nov 02 01:43:31 user nova-compute[74996]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)
Nov 02 01:43:31 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:43:31 user nova-compute[74996]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:43:31 user nova-compute[74996]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)
Nov 02 01:43:31 user nova-compute[74996]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)
Nov 02 01:43:31 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb0d4bd-22d6-4c79-916d-874c87a1e228]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494, portal: 172.16.0.220,3260]
Nov 02 01:43:31 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494, portal: 172.16.0.220,3260] successful.
Nov 02 01:43:31 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bbcc1b-1174-4829-953e-94c5b2986ad7]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d454f667-5f12-4639-8c42-8ab98c9160d9]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:43:31 user nova-compute[74996]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:43:31 user nova-compute[74996]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)
Nov 02 01:43:31 user nova-compute[74996]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)
Nov 02 01:43:31 user nova-compute[74996]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:43:31 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:43:31 user nova-compute[74996]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:43:31 user nova-compute[74996]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)
Nov 02 01:43:31 user nova-compute[74996]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)
Nov 02 01:43:31 user nova-compute[74996]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:43:31 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4316520a-5fe8-40da-8270-6d8c16b0ad94]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:31 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: None {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:43:32 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:43:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VOtcoRsW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:43:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:43:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23064636433383066', 'path': '/dev/sdf'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:43:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064636433383066', 'path': '/dev/sdf'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:43:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1689709328',display_name='tempest-TestShelveInstance-server-1689709328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1689709328',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaTyRcwo/6qh2VUUUZQ7imznM0w+FhHVOMS4herOMA8kinuWHPKCco0BceOOJ4BPGCiEDQ5X04+2lK+/NaW63fmgUUQ8Q7OZ2TCFIlqp/8mjZzYpCt3Sstoj3ztaAlirQ==',key_name='tempest-TestShelveInstance-1132842490',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca87a25a8b244b7989ea459300036d8d',ramdisk_id='',reservation_id='r-tfi2zjgk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-457210861',owner_user_name='tempest-TestShelveInstance-457210861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:42:28Z,user_data=None,user_id='670f527ebd064a39a3d19edffd8393f3',uuid=effec7f0-1006-4081-91f4-e2d96fd0a87a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "address": "fa:16:3e:56:0b:6b", "network": {"id": "b3014958-040c-44b4-94cc-1099e8fe3750", "bridge": "br-int", "label": "tempest-TestShelveInstance-1407890304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca87a25a8b244b7989ea459300036d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf50e3d-3d", "ovs_interfaceid": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:43:32 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Converting VIF {"id": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "address": "fa:16:3e:56:0b:6b", "network": {"id": "b3014958-040c-44b4-94cc-1099e8fe3750", "bridge": "br-int", "label": "tempest-TestShelveInstance-1407890304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca87a25a8b244b7989ea459300036d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf50e3d-3d", "ovs_interfaceid": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:43:32 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=8cf50e3d-3da4-48fc-9cc9-bfe88441b531,network=Network(b3014958-040c-44b4-94cc-1099e8fe3750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cf50e3d-3d') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:43:32 user nova-compute[74996]: DEBUG nova.objects.instance [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lazy-loading 'pci_devices' on Instance uuid effec7f0-1006-4081-91f4-e2d96fd0a87a {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:43:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:43:32 user nova-compute[74996]:   <uuid>effec7f0-1006-4081-91f4-e2d96fd0a87a</uuid>
Nov 02 01:43:32 user nova-compute[74996]:   <name>instance-0000001b</name>
Nov 02 01:43:32 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:43:32 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:43:32 user nova-compute[74996]:   <metadata>
Nov 02 01:43:32 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:43:32 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:43:32 user nova-compute[74996]:       <nova:name>tempest-TestShelveInstance-server-1689709328</nova:name>
Nov 02 01:43:32 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:43:30</nova:creationTime>
Nov 02 01:43:32 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:43:32 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:43:32 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:43:32 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:43:32 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:43:32 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:43:32 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:43:32 user nova-compute[74996]:       <nova:owner>
Nov 02 01:43:32 user nova-compute[74996]:         <nova:user uuid="670f527ebd064a39a3d19edffd8393f3">tempest-TestShelveInstance-457210861-project-member</nova:user>
Nov 02 01:43:32 user nova-compute[74996]:         <nova:project uuid="ca87a25a8b244b7989ea459300036d8d">tempest-TestShelveInstance-457210861</nova:project>
Nov 02 01:43:32 user nova-compute[74996]:       </nova:owner>
Nov 02 01:43:32 user nova-compute[74996]:       <nova:ports>
Nov 02 01:43:32 user nova-compute[74996]:         <nova:port uuid="8cf50e3d-3da4-48fc-9cc9-bfe88441b531">
Nov 02 01:43:32 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 01:43:32 user nova-compute[74996]:         </nova:port>
Nov 02 01:43:32 user nova-compute[74996]:       </nova:ports>
Nov 02 01:43:32 user nova-compute[74996]:     </nova:instance>
Nov 02 01:43:32 user nova-compute[74996]:   </metadata>
Nov 02 01:43:32 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:43:32 user nova-compute[74996]:     <system>
Nov 02 01:43:32 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:43:32 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:43:32 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:43:32 user nova-compute[74996]:       <entry name="serial">effec7f0-1006-4081-91f4-e2d96fd0a87a</entry>
Nov 02 01:43:32 user nova-compute[74996]:       <entry name="uuid">effec7f0-1006-4081-91f4-e2d96fd0a87a</entry>
Nov 02 01:43:32 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:43:32 user nova-compute[74996]:     </system>
Nov 02 01:43:32 user nova-compute[74996]:   </sysinfo>
Nov 02 01:43:32 user nova-compute[74996]:   <os>
Nov 02 01:43:32 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:43:32 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:43:32 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:43:32 user nova-compute[74996]:   </os>
Nov 02 01:43:32 user nova-compute[74996]:   <features>
Nov 02 01:43:32 user nova-compute[74996]:     <acpi/>
Nov 02 01:43:32 user nova-compute[74996]:     <apic/>
Nov 02 01:43:32 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:43:32 user nova-compute[74996]:   </features>
Nov 02 01:43:32 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:43:32 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:43:32 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:43:32 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:43:32 user nova-compute[74996]:   </clock>
Nov 02 01:43:32 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:43:32 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:43:32 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:43:32 user nova-compute[74996]:   </cpu>
Nov 02 01:43:32 user nova-compute[74996]:   <devices>
Nov 02 01:43:32 user nova-compute[74996]:     <disk type="block" device="disk">
Nov 02 01:43:32 user nova-compute[74996]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:43:32 user nova-compute[74996]:       <source dev="/dev/sdf"/>
Nov 02 01:43:32 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:43:32 user nova-compute[74996]:       <serial>5b222ba0-7f5f-4d31-acb2-79257672c494</serial>
Nov 02 01:43:32 user nova-compute[74996]:     </disk>
Nov 02 01:43:32 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:43:32 user nova-compute[74996]:       <mac address="fa:16:3e:56:0b:6b"/>
Nov 02 01:43:32 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:43:32 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:43:32 user nova-compute[74996]:       <target dev="tap8cf50e3d-3d"/>
Nov 02 01:43:32 user nova-compute[74996]:     </interface>
Nov 02 01:43:32 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:43:32 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/effec7f0-1006-4081-91f4-e2d96fd0a87a/console.log" append="off"/>
Nov 02 01:43:32 user nova-compute[74996]:     </serial>
Nov 02 01:43:32 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:43:32 user nova-compute[74996]:     <video>
Nov 02 01:43:32 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:43:32 user nova-compute[74996]:     </video>
Nov 02 01:43:32 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:43:32 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:43:32 user nova-compute[74996]:     </rng>
Nov 02 01:43:32 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:43:32 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:43:32 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:43:32 user nova-compute[74996]:     </memballoon>
Nov 02 01:43:32 user nova-compute[74996]:   </devices>
Nov 02 01:43:32 user nova-compute[74996]: </domain>
Nov 02 01:43:32 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:43:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1689709328',display_name='tempest-TestShelveInstance-server-1689709328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1689709328',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaTyRcwo/6qh2VUUUZQ7imznM0w+FhHVOMS4herOMA8kinuWHPKCco0BceOOJ4BPGCiEDQ5X04+2lK+/NaW63fmgUUQ8Q7OZ2TCFIlqp/8mjZzYpCt3Sstoj3ztaAlirQ==',key_name='tempest-TestShelveInstance-1132842490',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca87a25a8b244b7989ea459300036d8d',ramdisk_id='',reservation_id='r-tfi2zjgk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-457210861',owner_user_name='tempest-TestShelveInstance-457210861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:42:28Z,user_data=None,user_id='670f527ebd064a39a3d19edffd8393f3',uuid=effec7f0-1006-4081-91f4-e2d96fd0a87a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "address": "fa:16:3e:56:0b:6b", "network": {"id": "b3014958-040c-44b4-94cc-1099e8fe3750", "bridge": "br-int", "label": "tempest-TestShelveInstance-1407890304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca87a25a8b244b7989ea459300036d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf50e3d-3d", "ovs_interfaceid": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:43:32 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Converting VIF {"id": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "address": "fa:16:3e:56:0b:6b", "network": {"id": "b3014958-040c-44b4-94cc-1099e8fe3750", "bridge": "br-int", "label": "tempest-TestShelveInstance-1407890304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca87a25a8b244b7989ea459300036d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf50e3d-3d", "ovs_interfaceid": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:43:32 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=8cf50e3d-3da4-48fc-9cc9-bfe88441b531,network=Network(b3014958-040c-44b4-94cc-1099e8fe3750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cf50e3d-3d') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:43:32 user nova-compute[74996]: DEBUG os_vif [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=8cf50e3d-3da4-48fc-9cc9-bfe88441b531,network=Network(b3014958-040c-44b4-94cc-1099e8fe3750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cf50e3d-3d') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:43:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:43:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:43:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47c51be3-c9b4-5a98-be7d-6bce1864bf64', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:43:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8cf50e3d-3d, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:43:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8cf50e3d-3d, col_values=(('qos', UUID('f3deef76-b2b3-4818-8218-f4506b0e6d14')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:43:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8cf50e3d-3d, col_values=(('external_ids', {'iface-id': '8cf50e3d-3da4-48fc-9cc9-bfe88441b531', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:0b:6b', 'vm-uuid': 'effec7f0-1006-4081-91f4-e2d96fd0a87a'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:43:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:43:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:32 user nova-compute[74996]: INFO os_vif [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=8cf50e3d-3da4-48fc-9cc9-bfe88441b531,network=Network(b3014958-040c-44b4-94cc-1099e8fe3750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cf50e3d-3d')
Nov 02 01:43:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:43:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] No VIF found with MAC fa:16:3e:56:0b:6b, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:43:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:34 user nova-compute[74996]: DEBUG nova.compute.manager [req-e74e3583-ffd4-482d-b717-6bc334c0f561 req-7d686b93-38f5-4365-9ac1-4de38de21120 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Received event network-vif-plugged-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:43:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-e74e3583-ffd4-482d-b717-6bc334c0f561 req-7d686b93-38f5-4365-9ac1-4de38de21120 service nova] Acquiring lock "effec7f0-1006-4081-91f4-e2d96fd0a87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:43:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-e74e3583-ffd4-482d-b717-6bc334c0f561 req-7d686b93-38f5-4365-9ac1-4de38de21120 service nova] Lock "effec7f0-1006-4081-91f4-e2d96fd0a87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:43:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-e74e3583-ffd4-482d-b717-6bc334c0f561 req-7d686b93-38f5-4365-9ac1-4de38de21120 service nova] Lock "effec7f0-1006-4081-91f4-e2d96fd0a87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:43:34 user nova-compute[74996]: DEBUG nova.compute.manager [req-e74e3583-ffd4-482d-b717-6bc334c0f561 req-7d686b93-38f5-4365-9ac1-4de38de21120 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] No waiting events found dispatching network-vif-plugged-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:43:34 user nova-compute[74996]: WARNING nova.compute.manager [req-e74e3583-ffd4-482d-b717-6bc334c0f561 req-7d686b93-38f5-4365-9ac1-4de38de21120 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Received unexpected event network-vif-plugged-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 for instance with vm_state building and task_state spawning.
Nov 02 01:43:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:35 user nova-compute[74996]: DEBUG nova.compute.manager [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:43:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:43:35 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Instance spawned successfully.
Nov 02 01:43:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:43:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:43:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:43:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:43:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:43:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:43:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:43:36 user nova-compute[74996]: INFO nova.compute.manager [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 02 01:43:36 user nova-compute[74996]: DEBUG nova.compute.manager [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:43:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-69f269b0-91f7-40c5-a901-671d8d98c6eb req-e07d541c-f735-40ee-83b2-5c71b65c5aae service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Received event network-vif-plugged-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:43:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-69f269b0-91f7-40c5-a901-671d8d98c6eb req-e07d541c-f735-40ee-83b2-5c71b65c5aae service nova] Acquiring lock "effec7f0-1006-4081-91f4-e2d96fd0a87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:43:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-69f269b0-91f7-40c5-a901-671d8d98c6eb req-e07d541c-f735-40ee-83b2-5c71b65c5aae service nova] Lock "effec7f0-1006-4081-91f4-e2d96fd0a87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:43:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-69f269b0-91f7-40c5-a901-671d8d98c6eb req-e07d541c-f735-40ee-83b2-5c71b65c5aae service nova] Lock "effec7f0-1006-4081-91f4-e2d96fd0a87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:43:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-69f269b0-91f7-40c5-a901-671d8d98c6eb req-e07d541c-f735-40ee-83b2-5c71b65c5aae service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] No waiting events found dispatching network-vif-plugged-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:43:36 user nova-compute[74996]: WARNING nova.compute.manager [req-69f269b0-91f7-40c5-a901-671d8d98c6eb req-e07d541c-f735-40ee-83b2-5c71b65c5aae service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Received unexpected event network-vif-plugged-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 for instance with vm_state building and task_state spawning.
Nov 02 01:43:36 user nova-compute[74996]: INFO nova.compute.manager [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Took 68.79 seconds to build instance.
Nov 02 01:43:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0337cf56-604a-4f18-9a92-48c58329d50a tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "effec7f0-1006-4081-91f4-e2d96fd0a87a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 68.909s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:43:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-6fd0ba16-902f-4507-8416-49151f5c7e09 req-0d280764-ebe7-4b89-9f0d-6f0cd8aa80d0 service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Received event network-changed-ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:43:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-6fd0ba16-902f-4507-8416-49151f5c7e09 req-0d280764-ebe7-4b89-9f0d-6f0cd8aa80d0 service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Refreshing instance network info cache due to event network-changed-ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:43:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6fd0ba16-902f-4507-8416-49151f5c7e09 req-0d280764-ebe7-4b89-9f0d-6f0cd8aa80d0 service nova] Acquiring lock "refresh_cache-382dce4d-dd73-4929-81dc-bcc3bb987045" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:43:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6fd0ba16-902f-4507-8416-49151f5c7e09 req-0d280764-ebe7-4b89-9f0d-6f0cd8aa80d0 service nova] Acquired lock "refresh_cache-382dce4d-dd73-4929-81dc-bcc3bb987045" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:43:45 user nova-compute[74996]: DEBUG nova.network.neutron [req-6fd0ba16-902f-4507-8416-49151f5c7e09 req-0d280764-ebe7-4b89-9f0d-6f0cd8aa80d0 service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Refreshing network info cache for port ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:43:45 user nova-compute[74996]: DEBUG nova.network.neutron [req-6fd0ba16-902f-4507-8416-49151f5c7e09 req-0d280764-ebe7-4b89-9f0d-6f0cd8aa80d0 service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Updated VIF entry in instance network info cache for port ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:43:45 user nova-compute[74996]: DEBUG nova.network.neutron [req-6fd0ba16-902f-4507-8416-49151f5c7e09 req-0d280764-ebe7-4b89-9f0d-6f0cd8aa80d0 service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Updating instance_info_cache with network_info: [{"id": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "address": "fa:16:3e:a3:71:72", "network": {"id": "2923ade6-4530-4109-8e37-67123fa93c05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-147878200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b53bc3f0b994ceeb8e6cff9f8fb1980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce4de8d2-0f", "ovs_interfaceid": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:43:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6fd0ba16-902f-4507-8416-49151f5c7e09 req-0d280764-ebe7-4b89-9f0d-6f0cd8aa80d0 service nova] Releasing lock "refresh_cache-382dce4d-dd73-4929-81dc-bcc3bb987045" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:43:46 user nova-compute[74996]: INFO nova.compute.manager [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Rebuilding instance
Nov 02 01:43:46 user nova-compute[74996]: DEBUG nova.compute.manager [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:43:46 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:46 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:46 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:46 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:46 user nova-compute[74996]: DEBUG nova.compute.manager [req-0c6c9e42-c6e3-424a-89b2-7c61aeb22d71 req-878c164f-65ca-4f4f-a99a-2265579a42f1 service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Received event network-vif-unplugged-ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:43:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0c6c9e42-c6e3-424a-89b2-7c61aeb22d71 req-878c164f-65ca-4f4f-a99a-2265579a42f1 service nova] Acquiring lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:43:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0c6c9e42-c6e3-424a-89b2-7c61aeb22d71 req-878c164f-65ca-4f4f-a99a-2265579a42f1 service nova] Lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:43:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0c6c9e42-c6e3-424a-89b2-7c61aeb22d71 req-878c164f-65ca-4f4f-a99a-2265579a42f1 service nova] Lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:43:46 user nova-compute[74996]: DEBUG nova.compute.manager [req-0c6c9e42-c6e3-424a-89b2-7c61aeb22d71 req-878c164f-65ca-4f4f-a99a-2265579a42f1 service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] No waiting events found dispatching network-vif-unplugged-ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:43:46 user nova-compute[74996]: WARNING nova.compute.manager [req-0c6c9e42-c6e3-424a-89b2-7c61aeb22d71 req-878c164f-65ca-4f4f-a99a-2265579a42f1 service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Received unexpected event network-vif-unplugged-ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf for instance with vm_state active and task_state rebuilding.
Nov 02 01:43:47 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Instance destroyed successfully.
Nov 02 01:43:47 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Instance destroyed successfully.
Nov 02 01:43:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-27410822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-692359628',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY+Zv0aRo1up7UitzxFVT1vKWf8cixyY3iz2qNf6VRlBWYW6c7XWIJe+dxRZCmSX/K8EfSE0Gl/Oobz82iIrY1fQpASD+/UO110wRUprmiqDBAkbDpFOw/i0LToaceywQ==',key_name='tempest-keypair-693568396',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:42:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3b53bc3f0b994ceeb8e6cff9f8fb1980',ramdisk_id='',reservation_id='r-uylmojhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-272873490',owner_user_name='tempest-ServerActionsV293TestJSON-272873490-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3295b6af73fe474ca0c00efe655866ec',uuid=382dce4d-dd73-4929-81dc-bcc3bb987045,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "address": "fa:16:3e:a3:71:72", "network": {"id": "2923ade6-4530-4109-8e37-67123fa93c05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-147878200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b53bc3f0b994ceeb8e6cff9f8fb1980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce4de8d2-0f", "ovs_interfaceid": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Converting VIF {"id": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "address": "fa:16:3e:a3:71:72", "network": {"id": "2923ade6-4530-4109-8e37-67123fa93c05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-147878200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b53bc3f0b994ceeb8e6cff9f8fb1980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce4de8d2-0f", "ovs_interfaceid": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:71:72,bridge_name='br-int',has_traffic_filtering=True,id=ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf,network=Network(2923ade6-4530-4109-8e37-67123fa93c05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce4de8d2-0f') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG os_vif [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:71:72,bridge_name='br-int',has_traffic_filtering=True,id=ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf,network=Network(2923ade6-4530-4109-8e37-67123fa93c05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce4de8d2-0f') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce4de8d2-0f, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50025818-5eea-4f13-af3c-6f1852c97d18) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:43:47 user nova-compute[74996]: INFO os_vif [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:71:72,bridge_name='br-int',has_traffic_filtering=True,id=ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf,network=Network(2923ade6-4530-4109-8e37-67123fa93c05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce4de8d2-0f')
Nov 02 01:43:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MOdlBbYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:43:47 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 01:43:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fc1d8e-0c9c-45cf-9ba7-28ce15adb0c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:43:47 user nova-compute[74996]: No targets found.
Nov 02 01:43:47 user nova-compute[74996]: iSNS:
Nov 02 01:43:47 user nova-compute[74996]: No targets found.
Nov 02 01:43:47 user nova-compute[74996]: STATIC:
Nov 02 01:43:47 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494
Nov 02 01:43:47 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:43:47 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:43:47 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7
Nov 02 01:43:47 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:43:47 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:43:47 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8
Nov 02 01:43:47 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:43:47 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:43:47 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d
Nov 02 01:43:47 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:43:47 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:43:47 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4
Nov 02 01:43:47 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:43:47 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:43:47 user nova-compute[74996]: FIRMWARE:
Nov 02 01:43:47 user nova-compute[74996]: No targets found.
Nov 02 01:43:47 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:43:47 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:43:47 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae91d86-4524-431e-948a-ae2101da5a5a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b0c3e7-c79d-4250-ae6d-9db48f28a8a2]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:43:47 user nova-compute[74996]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:43:47 user nova-compute[74996]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)
Nov 02 01:43:47 user nova-compute[74996]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)
Nov 02 01:43:47 user nova-compute[74996]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:43:47 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:43:47 user nova-compute[74996]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:43:47 user nova-compute[74996]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)
Nov 02 01:43:47 user nova-compute[74996]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)
Nov 02 01:43:47 user nova-compute[74996]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:43:47 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e865a290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4'): ({'sde'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Removing single pathed devices sde {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d164d5a3-6ad1-4dfe-a8ed-e0f363c1b07b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[496148cb-a257-4e3f-98d7-93fb9c35a025]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Flushing IO for device /dev/sde {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba47ecbf-e6d7-4097-ae16-e046c7114700]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7004ec08-eb0c-4990-8aa9-a201d4a4b2e3]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] SCSI volumes sde have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO12d1e88-f34a389291e357a6', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_12d1e88', '/dev/disk/by-id/scsi-26633346133383932') {{(pid=86449) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec2707f-992f-417c-bacb-03ca186e2d42]: (4, None) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd852971-bd0f-4030-ad2a-370b54f4e516]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9586cc-7977-48af-a96d-884d86e21a6b]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4, portal: 172.16.0.220,3260]
Nov 02 01:43:47 user nova-compute[74996]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4, portal: 172.16.0.220,3260] successful.
Nov 02 01:43:47 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a71cf6-3191-4ff7-a41e-0534cb3cecfc]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] <== disconnect_volume: return (361ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:43:47 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Deleting instance files /opt/stack/data/nova/instances/382dce4d-dd73-4929-81dc-bcc3bb987045_del
Nov 02 01:43:47 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Deletion of /opt/stack/data/nova/instances/382dce4d-dd73-4929-81dc-bcc3bb987045_del complete
Nov 02 01:43:47 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 382dce4d-dd73-4929-81dc-bcc3bb987045 could not be found.
Nov 02 01:43:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MOdlBbYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:43:47 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 01:43:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:43:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:48 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe63523-b2e4-4c2d-a94c-81a99fc2b2d6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:43:48 user nova-compute[74996]: No targets found.
Nov 02 01:43:48 user nova-compute[74996]: iSNS:
Nov 02 01:43:48 user nova-compute[74996]: No targets found.
Nov 02 01:43:48 user nova-compute[74996]: STATIC:
Nov 02 01:43:48 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494
Nov 02 01:43:48 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:43:48 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:43:48 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7
Nov 02 01:43:48 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:43:48 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:43:48 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8
Nov 02 01:43:48 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:43:48 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:43:48 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d
Nov 02 01:43:48 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:43:48 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:43:48 user nova-compute[74996]: FIRMWARE:
Nov 02 01:43:48 user nova-compute[74996]: No targets found.
Nov 02 01:43:48 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:43:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:43:48 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:43:48 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:43:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:43:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:48 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac51059c-5d87-4b2e-87d0-cd80c17dcf16]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:48 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c5ecb4-8731-41a5-ae0c-e8c365c34b62]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:43:48 user nova-compute[74996]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:43:48 user nova-compute[74996]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)
Nov 02 01:43:48 user nova-compute[74996]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:43:48 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:43:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:43:48 user nova-compute[74996]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:43:48 user nova-compute[74996]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)
Nov 02 01:43:48 user nova-compute[74996]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:43:48 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:43:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830c7b1990>, {}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:43:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Disconnecting from: [] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:43:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.086s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:43:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] <== disconnect_volume: return (87ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:43:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:43:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:48 user nova-compute[74996]: DEBUG nova.compute.manager [req-a0c8dae7-f3f4-4168-8824-b3b4f3da9599 req-77948bd3-1dee-40d3-b6c7-8d5270acae19 service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Received event network-vif-plugged-ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:43:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a0c8dae7-f3f4-4168-8824-b3b4f3da9599 req-77948bd3-1dee-40d3-b6c7-8d5270acae19 service nova] Acquiring lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:43:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a0c8dae7-f3f4-4168-8824-b3b4f3da9599 req-77948bd3-1dee-40d3-b6c7-8d5270acae19 service nova] Lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:43:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a0c8dae7-f3f4-4168-8824-b3b4f3da9599 req-77948bd3-1dee-40d3-b6c7-8d5270acae19 service nova] Lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:43:48 user nova-compute[74996]: DEBUG nova.compute.manager [req-a0c8dae7-f3f4-4168-8824-b3b4f3da9599 req-77948bd3-1dee-40d3-b6c7-8d5270acae19 service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] No waiting events found dispatching network-vif-plugged-ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:43:48 user nova-compute[74996]: WARNING nova.compute.manager [req-a0c8dae7-f3f4-4168-8824-b3b4f3da9599 req-77948bd3-1dee-40d3-b6c7-8d5270acae19 service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Received unexpected event network-vif-plugged-ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf for instance with vm_state active and task_state rebuilding.
Nov 02 01:43:49 user nova-compute[74996]: DEBUG nova.compute.manager [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Preparing to wait for external event volume-reimaged-5f7cff97-bd0e-4b25-a3da-398d425d9ed4 {{(pid=74996) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 02 01:43:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Acquiring lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:43:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:43:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:43:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IiwLGsyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:43:59 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:43:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:43:59 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:43:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:43:59 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[172efd98-c953-4b2a-ba9a-298c7b5475b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:43:59 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4e8a71-7b59-4e5b-a5e4-d6e9fbe13c2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e] added
Nov 02 01:43:59 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ad164e-685c-4144-8947-664166897945]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31c049f-6f5a-45f9-9af3-601f4ddb45bd]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IiwLGsyq {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IiwLGsyq" returned: 0 in 0.107s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[87206ad0-d823-4320-95ff-7572b0f444ff]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IiwLGsyq'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[68816977-af62-4dfa-b101-d3534d642657]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[649e3f66-f8bb-45ab-803a-68fea769ef9d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:43:59 user nova-compute[74996]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:43:59 user nova-compute[74996]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)
Nov 02 01:43:59 user nova-compute[74996]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:43:59 user nova-compute[74996]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f (non-flash)
Nov 02 01:43:59 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:43:59 user nova-compute[74996]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:43:59 user nova-compute[74996]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)
Nov 02 01:43:59 user nova-compute[74996]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:43:59 user nova-compute[74996]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f (non-flash)
Nov 02 01:43:59 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG nova.compute.manager [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:43:59 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Creating image(s)
Nov 02 01:43:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Did not create local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Ensure instance console log exists: /opt/stack/data/nova/instances/2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Start _get_guest_xml network_info=[{"id": "2fc01b4a-295e-4fa2-97c2-f76e903c1a41", "address": "fa:16:3e:25:84:57", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc01b4a-29", "ovs_interfaceid": "2fc01b4a-295e-4fa2-97c2-f76e903c1a41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-02T01:42:37Z,direct_url=<?>,disk_format='qcow2',id=d3d953ec-9220-4634-b8d7-483843069272,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-171118540',owner='31965b482eb243a69112a49bf1302779',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-02T01:42:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b135cfcd-8cb7-46be-9d8e-485939071bc2', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sUJyIEBb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6', 'attached_at': '', 'detached_at': '', 'volume_id': '9434b777-eacc-4c26-b844-5f0515395a7b', 'serial': '9434b777-eacc-4c26-b844-5f0515395a7b'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:43:59 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:43:59 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:43:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-02T01:42:37Z,direct_url=<?>,disk_format='qcow2',id=d3d953ec-9220-4634-b8d7-483843069272,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-171118540',owner='31965b482eb243a69112a49bf1302779',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-02T01:42:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sUJyIEBb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:43:59 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:43:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8692c368-50c9-470b-ac0a-161baa921305]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e, portal: 172.16.0.220,3260]
Nov 02 01:43:59 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e, portal: 172.16.0.220,3260] successful.
Nov 02 01:43:59 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9717a608-ba0f-4917-ac99-a43de435d4dc]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6670d4df-b7c3-4ea4-b383-c887575159f3]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:43:59 user nova-compute[74996]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:43:59 user nova-compute[74996]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)
Nov 02 01:43:59 user nova-compute[74996]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:43:59 user nova-compute[74996]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f (non-flash)
Nov 02 01:43:59 user nova-compute[74996]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e (non-flash)
Nov 02 01:43:59 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:43:59 user nova-compute[74996]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:43:59 user nova-compute[74996]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)
Nov 02 01:43:59 user nova-compute[74996]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:43:59 user nova-compute[74996]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f (non-flash)
Nov 02 01:43:59 user nova-compute[74996]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e (non-flash)
Nov 02 01:43:59 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.442s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] HCTL ('38', '-', '-', 0) found on session 28 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b50ed2-03bc-4955-bd71-4251ae5e8a27]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:43:59 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Searching for a device in session 28 and hctl ['38', '*', '*', 0] yield: None {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:44:00 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Searching for a device in session 28 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:44:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IiwLGsyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:44:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.471s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:44:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] <== connect_volume: return (1472ms) {'type': 'block', 'scsi_wwn': '26435333964376134', 'path': '/dev/sdg'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:44:00 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435333964376134', 'path': '/dev/sdg'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:44:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.084s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:44:00 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:44:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:44:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:44:00 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:44:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:00 user nova-compute[74996]: DEBUG nova.objects.instance [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lazy-loading 'flavor' on Instance uuid 5d834837-a1a1-436d-9015-b9b3bf048170 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:44:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:00 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c48d65c-43b8-49b6-83b9-2b161c20e13e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:44:00 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:00 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 01:44:00 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:44:00 user nova-compute[74996]:   <source dev="/dev/sdg"/>
Nov 02 01:44:00 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:44:00 user nova-compute[74996]:   <serial>deb4bea3-2efc-4eae-a22d-174ac978701e</serial>
Nov 02 01:44:00 user nova-compute[74996]: </disk>
Nov 02 01:44:00 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 01:44:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:00 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cbfa8b-19ab-4723-a40f-1120ab2bbc90]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b] added
Nov 02 01:44:00 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:00 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d125970-2550-46b0-98bd-5a009cd3c6a0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:00 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2a7a8c-8c19-47e9-84b3-7c396271f88e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sUJyIEBb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sUJyIEBb" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1568c0d0-6e39-41c3-9284-3536d5d356b9]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sUJyIEBb'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4c76a2-4658-43d7-8274-b75abd5b7ab6]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5d305b-8778-4502-b527-c1b995f11034]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:44:01 user nova-compute[74996]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:44:01 user nova-compute[74996]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)
Nov 02 01:44:01 user nova-compute[74996]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:44:01 user nova-compute[74996]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f (non-flash)
Nov 02 01:44:01 user nova-compute[74996]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e (non-flash)
Nov 02 01:44:01 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:44:01 user nova-compute[74996]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:44:01 user nova-compute[74996]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)
Nov 02 01:44:01 user nova-compute[74996]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:44:01 user nova-compute[74996]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f (non-flash)
Nov 02 01:44:01 user nova-compute[74996]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e (non-flash)
Nov 02 01:44:01 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[760bc9db-cf0c-43b6-aad9-775eb21e41e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b, portal: 172.16.0.220,3260]
Nov 02 01:44:01 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b, portal: 172.16.0.220,3260] successful.
Nov 02 01:44:01 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3184384b-d4c7-4a8d-bebd-c6951365352e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adc0312-f7a0-44a5-b8a4-259876fc3c35]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:44:01 user nova-compute[74996]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:44:01 user nova-compute[74996]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)
Nov 02 01:44:01 user nova-compute[74996]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:44:01 user nova-compute[74996]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f (non-flash)
Nov 02 01:44:01 user nova-compute[74996]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e (non-flash)
Nov 02 01:44:01 user nova-compute[74996]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)
Nov 02 01:44:01 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:44:01 user nova-compute[74996]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:44:01 user nova-compute[74996]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)
Nov 02 01:44:01 user nova-compute[74996]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:44:01 user nova-compute[74996]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f (non-flash)
Nov 02 01:44:01 user nova-compute[74996]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e (non-flash)
Nov 02 01:44:01 user nova-compute[74996]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)
Nov 02 01:44:01 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] HCTL ('39', '-', '-', 0) found on session 29 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0f1439-1c88-4354-afef-b84eeafafa52]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Searching for a device in session 29 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sUJyIEBb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] No VIF found with MAC fa:16:3e:8e:ff:6b, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:44:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-16d07a97-d61e-47e8-aafd-395295493c9c tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "5d834837-a1a1-436d-9015-b9b3bf048170" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 47.256s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] <== connect_volume: return (2459ms) {'type': 'block', 'scsi_wwn': '26366663339666164', 'path': '/dev/sdh'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366663339666164', 'path': '/dev/sdh'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:42:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1148286830',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1148286830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1148286830',id=28,image_ref='d3d953ec-9220-4634-b8d7-483843069272',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+EIEgzLU1isk3JNPYYaGgR6oj5RqJMig8ul/3Wh+D1BCOWlnvZJYtVl3TZHRUu2AeW8xXQMeVGdfePhkI5Tomd+UzCSYw09hqMIWYiJDB59odqgDRCp+1g8wSK/a6S/g==',key_name='tempest-keypair-1597605523',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31965b482eb243a69112a49bf1302779',ramdisk_id='',reservation_id='r-6kcyvfj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-216720976',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-216720976-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-216720976',owner_user_name='tempest-TestVolumeBootPattern-216720976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:43:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be6bf504c3a649898e8c83399f6fee8e',uuid=2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2fc01b4a-295e-4fa2-97c2-f76e903c1a41", "address": "fa:16:3e:25:84:57", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc01b4a-29", "ovs_interfaceid": "2fc01b4a-295e-4fa2-97c2-f76e903c1a41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converting VIF {"id": "2fc01b4a-295e-4fa2-97c2-f76e903c1a41", "address": "fa:16:3e:25:84:57", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc01b4a-29", "ovs_interfaceid": "2fc01b4a-295e-4fa2-97c2-f76e903c1a41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:84:57,bridge_name='br-int',has_traffic_filtering=True,id=2fc01b4a-295e-4fa2-97c2-f76e903c1a41,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fc01b4a-29') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG nova.objects.instance [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lazy-loading 'pci_devices' on Instance uuid 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:44:02 user nova-compute[74996]:   <uuid>2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6</uuid>
Nov 02 01:44:02 user nova-compute[74996]:   <name>instance-0000001c</name>
Nov 02 01:44:02 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:44:02 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:44:02 user nova-compute[74996]:   <metadata>
Nov 02 01:44:02 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:44:02 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:44:02 user nova-compute[74996]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1148286830</nova:name>
Nov 02 01:44:02 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:43:59</nova:creationTime>
Nov 02 01:44:02 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:44:02 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:44:02 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:44:02 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:44:02 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:44:02 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:44:02 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:44:02 user nova-compute[74996]:       <nova:owner>
Nov 02 01:44:02 user nova-compute[74996]:         <nova:user uuid="be6bf504c3a649898e8c83399f6fee8e">tempest-TestVolumeBootPattern-216720976-project-member</nova:user>
Nov 02 01:44:02 user nova-compute[74996]:         <nova:project uuid="31965b482eb243a69112a49bf1302779">tempest-TestVolumeBootPattern-216720976</nova:project>
Nov 02 01:44:02 user nova-compute[74996]:       </nova:owner>
Nov 02 01:44:02 user nova-compute[74996]:       <nova:root type="image" uuid="d3d953ec-9220-4634-b8d7-483843069272"/>
Nov 02 01:44:02 user nova-compute[74996]:       <nova:ports>
Nov 02 01:44:02 user nova-compute[74996]:         <nova:port uuid="2fc01b4a-295e-4fa2-97c2-f76e903c1a41">
Nov 02 01:44:02 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 02 01:44:02 user nova-compute[74996]:         </nova:port>
Nov 02 01:44:02 user nova-compute[74996]:       </nova:ports>
Nov 02 01:44:02 user nova-compute[74996]:     </nova:instance>
Nov 02 01:44:02 user nova-compute[74996]:   </metadata>
Nov 02 01:44:02 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:44:02 user nova-compute[74996]:     <system>
Nov 02 01:44:02 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:44:02 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:44:02 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:44:02 user nova-compute[74996]:       <entry name="serial">2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6</entry>
Nov 02 01:44:02 user nova-compute[74996]:       <entry name="uuid">2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6</entry>
Nov 02 01:44:02 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:44:02 user nova-compute[74996]:     </system>
Nov 02 01:44:02 user nova-compute[74996]:   </sysinfo>
Nov 02 01:44:02 user nova-compute[74996]:   <os>
Nov 02 01:44:02 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:44:02 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:44:02 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:44:02 user nova-compute[74996]:   </os>
Nov 02 01:44:02 user nova-compute[74996]:   <features>
Nov 02 01:44:02 user nova-compute[74996]:     <acpi/>
Nov 02 01:44:02 user nova-compute[74996]:     <apic/>
Nov 02 01:44:02 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:44:02 user nova-compute[74996]:   </features>
Nov 02 01:44:02 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:44:02 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:44:02 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:44:02 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:44:02 user nova-compute[74996]:   </clock>
Nov 02 01:44:02 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:44:02 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:44:02 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:44:02 user nova-compute[74996]:   </cpu>
Nov 02 01:44:02 user nova-compute[74996]:   <devices>
Nov 02 01:44:02 user nova-compute[74996]:     <disk type="block" device="disk">
Nov 02 01:44:02 user nova-compute[74996]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:44:02 user nova-compute[74996]:       <source dev="/dev/sdh"/>
Nov 02 01:44:02 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:44:02 user nova-compute[74996]:       <serial>9434b777-eacc-4c26-b844-5f0515395a7b</serial>
Nov 02 01:44:02 user nova-compute[74996]:     </disk>
Nov 02 01:44:02 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:44:02 user nova-compute[74996]:       <mac address="fa:16:3e:25:84:57"/>
Nov 02 01:44:02 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:44:02 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:44:02 user nova-compute[74996]:       <target dev="tap2fc01b4a-29"/>
Nov 02 01:44:02 user nova-compute[74996]:     </interface>
Nov 02 01:44:02 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:44:02 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6/console.log" append="off"/>
Nov 02 01:44:02 user nova-compute[74996]:     </serial>
Nov 02 01:44:02 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:44:02 user nova-compute[74996]:     <video>
Nov 02 01:44:02 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:44:02 user nova-compute[74996]:     </video>
Nov 02 01:44:02 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:44:02 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:44:02 user nova-compute[74996]:     </rng>
Nov 02 01:44:02 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:44:02 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:44:02 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:44:02 user nova-compute[74996]:     </memballoon>
Nov 02 01:44:02 user nova-compute[74996]:   </devices>
Nov 02 01:44:02 user nova-compute[74996]: </domain>
Nov 02 01:44:02 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:42:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1148286830',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1148286830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1148286830',id=28,image_ref='d3d953ec-9220-4634-b8d7-483843069272',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+EIEgzLU1isk3JNPYYaGgR6oj5RqJMig8ul/3Wh+D1BCOWlnvZJYtVl3TZHRUu2AeW8xXQMeVGdfePhkI5Tomd+UzCSYw09hqMIWYiJDB59odqgDRCp+1g8wSK/a6S/g==',key_name='tempest-keypair-1597605523',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31965b482eb243a69112a49bf1302779',ramdisk_id='',reservation_id='r-6kcyvfj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-216720976',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-216720976-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-216720976',owner_user_name='tempest-TestVolumeBootPattern-216720976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:43:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be6bf504c3a649898e8c83399f6fee8e',uuid=2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2fc01b4a-295e-4fa2-97c2-f76e903c1a41", "address": "fa:16:3e:25:84:57", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc01b4a-29", "ovs_interfaceid": "2fc01b4a-295e-4fa2-97c2-f76e903c1a41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converting VIF {"id": "2fc01b4a-295e-4fa2-97c2-f76e903c1a41", "address": "fa:16:3e:25:84:57", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc01b4a-29", "ovs_interfaceid": "2fc01b4a-295e-4fa2-97c2-f76e903c1a41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:84:57,bridge_name='br-int',has_traffic_filtering=True,id=2fc01b4a-295e-4fa2-97c2-f76e903c1a41,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fc01b4a-29') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG os_vif [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:84:57,bridge_name='br-int',has_traffic_filtering=True,id=2fc01b4a-295e-4fa2-97c2-f76e903c1a41,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fc01b4a-29') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '644e89fb-40e5-5f78-8062-0f526c355a26', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2fc01b4a-29, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2fc01b4a-29, col_values=(('qos', UUID('6abb3482-9254-4742-a5c2-7171f417962e')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2fc01b4a-29, col_values=(('external_ids', {'iface-id': '2fc01b4a-295e-4fa2-97c2-f76e903c1a41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:84:57', 'vm-uuid': '2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:02 user nova-compute[74996]: INFO os_vif [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:84:57,bridge_name='br-int',has_traffic_filtering=True,id=2fc01b4a-295e-4fa2-97c2-f76e903c1a41,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fc01b4a-29')
Nov 02 01:44:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] No VIF found with MAC fa:16:3e:25:84:57, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "5d834837-a1a1-436d-9015-b9b3bf048170" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "5d834837-a1a1-436d-9015-b9b3bf048170" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:02 user nova-compute[74996]: INFO nova.compute.manager [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Detaching volume deb4bea3-2efc-4eae-a22d-174ac978701e
Nov 02 01:44:02 user nova-compute[74996]: INFO nova.virt.block_device [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Attempting to driver detach volume deb4bea3-2efc-4eae-a22d-174ac978701e from mountpoint /dev/vdb
Nov 02 01:44:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Attempting to detach device vdb from instance 5d834837-a1a1-436d-9015-b9b3bf048170 from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 01:44:02 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:44:02 user nova-compute[74996]:   <source dev="/dev/sdg"/>
Nov 02 01:44:02 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:44:02 user nova-compute[74996]:   <serial>deb4bea3-2efc-4eae-a22d-174ac978701e</serial>
Nov 02 01:44:02 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 01:44:02 user nova-compute[74996]: </disk>
Nov 02 01:44:02 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:44:02 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Successfully detached device vdb from instance 5d834837-a1a1-436d-9015-b9b3bf048170 from the persistent domain config.
Nov 02 01:44:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5d834837-a1a1-436d-9015-b9b3bf048170 from the live domain config. {{(pid=74996) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 01:44:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 01:44:02 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:44:02 user nova-compute[74996]:   <source dev="/dev/sdg"/>
Nov 02 01:44:02 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:44:02 user nova-compute[74996]:   <serial>deb4bea3-2efc-4eae-a22d-174ac978701e</serial>
Nov 02 01:44:02 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 01:44:02 user nova-compute[74996]: </disk>
Nov 02 01:44:02 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:44:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5d834837-a1a1-436d-9015-b9b3bf048170 {{(pid=74996) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 01:44:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:04 user nova-compute[74996]: DEBUG nova.compute.manager [req-eb7257f9-710e-4cf9-b6f8-2714cffc788c req-9dc5fbc0-83e2-4869-8c6b-b56136d0b0cd service nova] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Received event network-vif-plugged-2fc01b4a-295e-4fa2-97c2-f76e903c1a41 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:44:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-eb7257f9-710e-4cf9-b6f8-2714cffc788c req-9dc5fbc0-83e2-4869-8c6b-b56136d0b0cd service nova] Acquiring lock "2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-eb7257f9-710e-4cf9-b6f8-2714cffc788c req-9dc5fbc0-83e2-4869-8c6b-b56136d0b0cd service nova] Lock "2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-eb7257f9-710e-4cf9-b6f8-2714cffc788c req-9dc5fbc0-83e2-4869-8c6b-b56136d0b0cd service nova] Lock "2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:04 user nova-compute[74996]: DEBUG nova.compute.manager [req-eb7257f9-710e-4cf9-b6f8-2714cffc788c req-9dc5fbc0-83e2-4869-8c6b-b56136d0b0cd service nova] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] No waiting events found dispatching network-vif-plugged-2fc01b4a-295e-4fa2-97c2-f76e903c1a41 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:44:04 user nova-compute[74996]: WARNING nova.compute.manager [req-eb7257f9-710e-4cf9-b6f8-2714cffc788c req-9dc5fbc0-83e2-4869-8c6b-b56136d0b0cd service nova] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Received unexpected event network-vif-plugged-2fc01b4a-295e-4fa2-97c2-f76e903c1a41 for instance with vm_state building and task_state spawning.
Nov 02 01:44:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Acquiring lock "f0de5980-334b-4654-8b1a-88c4c861aa49" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:05 user nova-compute[74996]: DEBUG nova.objects.instance [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lazy-loading 'flavor' on Instance uuid f0de5980-334b-4654-8b1a-88c4c861aa49 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:44:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Acquiring lock "f0de5980-334b-4654-8b1a-88c4c861aa49" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:05 user nova-compute[74996]: INFO nova.compute.manager [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Attaching volume 6d78e413-aba3-423c-a337-cede9e863e67 to /dev/vdb
Nov 02 01:44:05 user nova-compute[74996]: DEBUG os_brick.utils [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:44:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:05 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fc9c5a-59e4-4008-9ca7-0a524df5b5a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:05 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5fd601-bd31-4733-8b26-65d9b6b3b3ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:05 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[55464d00-ee64-4244-9215-908548e9685c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:05 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[45291fba-eeca-400f-a727-764f6e64231d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:44:05 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:44:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:05 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:44:05 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:44:05 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c329536-9b3e-4171-9ebd-a3a8e035f9f7]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:05 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:44:05 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:44:05 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:44:05 user nova-compute[74996]: DEBUG os_brick.utils [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:44:05 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Updating existing volume attachment record: 9048526a-b54a-41e6-90fd-1c4505fac409 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:44:06 user nova-compute[74996]: DEBUG nova.compute.manager [req-6dfde584-c02b-4c0c-a16b-1c7f89f0e4fe req-559c65e9-71dc-4b18-af71-d78eac536675 service nova] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Received event network-vif-plugged-2fc01b4a-295e-4fa2-97c2-f76e903c1a41 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:44:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6dfde584-c02b-4c0c-a16b-1c7f89f0e4fe req-559c65e9-71dc-4b18-af71-d78eac536675 service nova] Acquiring lock "2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6dfde584-c02b-4c0c-a16b-1c7f89f0e4fe req-559c65e9-71dc-4b18-af71-d78eac536675 service nova] Lock "2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6dfde584-c02b-4c0c-a16b-1c7f89f0e4fe req-559c65e9-71dc-4b18-af71-d78eac536675 service nova] Lock "2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:06 user nova-compute[74996]: DEBUG nova.compute.manager [req-6dfde584-c02b-4c0c-a16b-1c7f89f0e4fe req-559c65e9-71dc-4b18-af71-d78eac536675 service nova] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] No waiting events found dispatching network-vif-plugged-2fc01b4a-295e-4fa2-97c2-f76e903c1a41 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:44:06 user nova-compute[74996]: WARNING nova.compute.manager [req-6dfde584-c02b-4c0c-a16b-1c7f89f0e4fe req-559c65e9-71dc-4b18-af71-d78eac536675 service nova] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Received unexpected event network-vif-plugged-2fc01b4a-295e-4fa2-97c2-f76e903c1a41 for instance with vm_state building and task_state spawning.
Nov 02 01:44:06 user nova-compute[74996]: DEBUG nova.compute.manager [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:44:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:44:06 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Instance spawned successfully.
Nov 02 01:44:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:44:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:44:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:44:06 user nova-compute[74996]: INFO nova.compute.manager [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Took 6.73 seconds to spawn the instance on the hypervisor.
Nov 02 01:44:06 user nova-compute[74996]: DEBUG nova.compute.manager [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:44:06 user nova-compute[74996]: INFO nova.compute.manager [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Took 67.02 seconds to build instance.
Nov 02 01:44:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cf3de9e8-d934-4f0e-9661-ec10054d9fee tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 67.118s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Acquiring lock "f395088d-c7db-4a64-ab03-38cefee60231" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Lock "f395088d-c7db-4a64-ab03-38cefee60231" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:08 user nova-compute[74996]: DEBUG nova.compute.manager [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:44:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:08 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:44:08 user nova-compute[74996]: INFO nova.compute.claims [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Claim successful on node user
Nov 02 01:44:09 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:44:09 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:44:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.661s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:09 user nova-compute[74996]: DEBUG nova.compute.manager [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:44:09 user nova-compute[74996]: DEBUG nova.compute.manager [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:44:09 user nova-compute[74996]: DEBUG nova.network.neutron [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:44:09 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:44:09 user nova-compute[74996]: DEBUG nova.compute.manager [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:44:09 user nova-compute[74996]: DEBUG nova.compute.manager [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:44:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:44:09 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Creating image(s)
Nov 02 01:44:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Acquiring lock "/opt/stack/data/nova/instances/f395088d-c7db-4a64-ab03-38cefee60231/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Lock "/opt/stack/data/nova/instances/f395088d-c7db-4a64-ab03-38cefee60231/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Lock "/opt/stack/data/nova/instances/f395088d-c7db-4a64-ab03-38cefee60231/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:09 user nova-compute[74996]: DEBUG nova.policy [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '46ff1a9da6e3470eadc46cc13c482fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4eebeae2fa47399c9c1064ac8ebafa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:44:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.253s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.241s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/f395088d-c7db-4a64-ab03-38cefee60231/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/f395088d-c7db-4a64-ab03-38cefee60231/disk 1073741824" returned: 0 in 0.059s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:10 user nova-compute[74996]: DEBUG nova.compute.manager [req-b2299d60-1c4a-4e3a-a85b-260c431fda89 req-958f28bc-73bc-4e04-b56b-97aab8210725 service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Received event network-changed-b645a26c-6fae-4cfc-97ee-951a1cf5aec9 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:44:10 user nova-compute[74996]: DEBUG nova.compute.manager [req-b2299d60-1c4a-4e3a-a85b-260c431fda89 req-958f28bc-73bc-4e04-b56b-97aab8210725 service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Refreshing instance network info cache due to event network-changed-b645a26c-6fae-4cfc-97ee-951a1cf5aec9. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:44:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b2299d60-1c4a-4e3a-a85b-260c431fda89 req-958f28bc-73bc-4e04-b56b-97aab8210725 service nova] Acquiring lock "refresh_cache-7307f3a3-1ad1-43f7-be49-9cd03a626cd7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:44:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b2299d60-1c4a-4e3a-a85b-260c431fda89 req-958f28bc-73bc-4e04-b56b-97aab8210725 service nova] Acquired lock "refresh_cache-7307f3a3-1ad1-43f7-be49-9cd03a626cd7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:44:10 user nova-compute[74996]: DEBUG nova.network.neutron [req-b2299d60-1c4a-4e3a-a85b-260c431fda89 req-958f28bc-73bc-4e04-b56b-97aab8210725 service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Refreshing network info cache for port b645a26c-6fae-4cfc-97ee-951a1cf5aec9 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:44:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.235s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:10 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f395088d-c7db-4a64-ab03-38cefee60231/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:44:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f395088d-c7db-4a64-ab03-38cefee60231/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f395088d-c7db-4a64-ab03-38cefee60231/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:10 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Cannot resize image /opt/stack/data/nova/instances/f395088d-c7db-4a64-ab03-38cefee60231/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:44:10 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:44:10 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Ensure instance console log exists: /opt/stack/data/nova/instances/f395088d-c7db-4a64-ab03-38cefee60231/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:44:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:11 user nova-compute[74996]: DEBUG nova.network.neutron [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Successfully created port: cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:44:11 user nova-compute[74996]: DEBUG nova.network.neutron [req-b2299d60-1c4a-4e3a-a85b-260c431fda89 req-958f28bc-73bc-4e04-b56b-97aab8210725 service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Updated VIF entry in instance network info cache for port b645a26c-6fae-4cfc-97ee-951a1cf5aec9. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:44:11 user nova-compute[74996]: DEBUG nova.network.neutron [req-b2299d60-1c4a-4e3a-a85b-260c431fda89 req-958f28bc-73bc-4e04-b56b-97aab8210725 service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Updating instance_info_cache with network_info: [{"id": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "address": "fa:16:3e:97:27:02", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb645a26c-6f", "ovs_interfaceid": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:44:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b2299d60-1c4a-4e3a-a85b-260c431fda89 req-958f28bc-73bc-4e04-b56b-97aab8210725 service nova] Releasing lock "refresh_cache-7307f3a3-1ad1-43f7-be49-9cd03a626cd7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.network.neutron [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Successfully updated port: cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Acquiring lock "refresh_cache-f395088d-c7db-4a64-ab03-38cefee60231" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Acquired lock "refresh_cache-f395088d-c7db-4a64-ab03-38cefee60231" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.network.neutron [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.network.neutron [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.compute.manager [req-0d085dbc-6a65-4e26-9c70-dbbda595398b req-b84c41b2-60dc-4c48-99b3-5b5e7da5e923 service nova] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Received event network-changed-498304ed-92a0-4c70-88e1-d668894f583a {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.compute.manager [req-0d085dbc-6a65-4e26-9c70-dbbda595398b req-b84c41b2-60dc-4c48-99b3-5b5e7da5e923 service nova] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Refreshing instance network info cache due to event network-changed-498304ed-92a0-4c70-88e1-d668894f583a. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0d085dbc-6a65-4e26-9c70-dbbda595398b req-b84c41b2-60dc-4c48-99b3-5b5e7da5e923 service nova] Acquiring lock "refresh_cache-d28b9820-c059-46cb-9bb0-132e447fca1b" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0d085dbc-6a65-4e26-9c70-dbbda595398b req-b84c41b2-60dc-4c48-99b3-5b5e7da5e923 service nova] Acquired lock "refresh_cache-d28b9820-c059-46cb-9bb0-132e447fca1b" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.network.neutron [req-0d085dbc-6a65-4e26-9c70-dbbda595398b req-b84c41b2-60dc-4c48-99b3-5b5e7da5e923 service nova] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Refreshing network info cache for port 498304ed-92a0-4c70-88e1-d668894f583a {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.network.neutron [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Updating instance_info_cache with network_info: [{"id": "cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0", "address": "fa:16:3e:88:bc:1a", "network": {"id": "f4effa4b-9479-42c3-b5fe-2e997f187ec7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b7bb81c16b2f458a85ebcf2fb18f7709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc0b256e-e9", "ovs_interfaceid": "cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Releasing lock "refresh_cache-f395088d-c7db-4a64-ab03-38cefee60231" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.compute.manager [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Instance network_info: |[{"id": "cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0", "address": "fa:16:3e:88:bc:1a", "network": {"id": "f4effa4b-9479-42c3-b5fe-2e997f187ec7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b7bb81c16b2f458a85ebcf2fb18f7709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc0b256e-e9", "ovs_interfaceid": "cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Start _get_guest_xml network_info=[{"id": "cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0", "address": "fa:16:3e:88:bc:1a", "network": {"id": "f4effa4b-9479-42c3-b5fe-2e997f187ec7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b7bb81c16b2f458a85ebcf2fb18f7709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc0b256e-e9", "ovs_interfaceid": "cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:44:12 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:44:12 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:44:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1957960014',display_name='tempest-VolumesNegativeTest-instance-1957960014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1957960014',id=29,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c4eebeae2fa47399c9c1064ac8ebafa',ramdisk_id='',reservation_id='r-v6drfr3s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-285716449',owner_user_name='tempest-VolumesNegativeTest-285716449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:44:10Z,user_data=None,user_id='46ff1a9da6e3470eadc46cc13c482fb0',uuid=f395088d-c7db-4a64-ab03-38cefee60231,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0", "address": "fa:16:3e:88:bc:1a", "network": {"id": "f4effa4b-9479-42c3-b5fe-2e997f187ec7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b7bb81c16b2f458a85ebcf2fb18f7709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc0b256e-e9", "ovs_interfaceid": "cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Converting VIF {"id": "cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0", "address": "fa:16:3e:88:bc:1a", "network": {"id": "f4effa4b-9479-42c3-b5fe-2e997f187ec7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b7bb81c16b2f458a85ebcf2fb18f7709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc0b256e-e9", "ovs_interfaceid": "cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:bc:1a,bridge_name='br-int',has_traffic_filtering=True,id=cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0,network=Network(f4effa4b-9479-42c3-b5fe-2e997f187ec7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc0b256e-e9') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.objects.instance [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Lazy-loading 'pci_devices' on Instance uuid f395088d-c7db-4a64-ab03-38cefee60231 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:44:12 user nova-compute[74996]:   <uuid>f395088d-c7db-4a64-ab03-38cefee60231</uuid>
Nov 02 01:44:12 user nova-compute[74996]:   <name>instance-0000001d</name>
Nov 02 01:44:12 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:44:12 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:44:12 user nova-compute[74996]:   <metadata>
Nov 02 01:44:12 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:44:12 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:44:12 user nova-compute[74996]:       <nova:name>tempest-VolumesNegativeTest-instance-1957960014</nova:name>
Nov 02 01:44:12 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:44:12</nova:creationTime>
Nov 02 01:44:12 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:44:12 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:44:12 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:44:12 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:44:12 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:44:12 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:44:12 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:44:12 user nova-compute[74996]:       <nova:owner>
Nov 02 01:44:12 user nova-compute[74996]:         <nova:user uuid="46ff1a9da6e3470eadc46cc13c482fb0">tempest-VolumesNegativeTest-285716449-project-member</nova:user>
Nov 02 01:44:12 user nova-compute[74996]:         <nova:project uuid="1c4eebeae2fa47399c9c1064ac8ebafa">tempest-VolumesNegativeTest-285716449</nova:project>
Nov 02 01:44:12 user nova-compute[74996]:       </nova:owner>
Nov 02 01:44:12 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:44:12 user nova-compute[74996]:       <nova:ports>
Nov 02 01:44:12 user nova-compute[74996]:         <nova:port uuid="cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0">
Nov 02 01:44:12 user nova-compute[74996]:           <nova:ip type="fixed" address="192.168.233.16" ipVersion="4"/>
Nov 02 01:44:12 user nova-compute[74996]:         </nova:port>
Nov 02 01:44:12 user nova-compute[74996]:       </nova:ports>
Nov 02 01:44:12 user nova-compute[74996]:     </nova:instance>
Nov 02 01:44:12 user nova-compute[74996]:   </metadata>
Nov 02 01:44:12 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:44:12 user nova-compute[74996]:     <system>
Nov 02 01:44:12 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:44:12 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:44:12 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:44:12 user nova-compute[74996]:       <entry name="serial">f395088d-c7db-4a64-ab03-38cefee60231</entry>
Nov 02 01:44:12 user nova-compute[74996]:       <entry name="uuid">f395088d-c7db-4a64-ab03-38cefee60231</entry>
Nov 02 01:44:12 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:44:12 user nova-compute[74996]:     </system>
Nov 02 01:44:12 user nova-compute[74996]:   </sysinfo>
Nov 02 01:44:12 user nova-compute[74996]:   <os>
Nov 02 01:44:12 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:44:12 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:44:12 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:44:12 user nova-compute[74996]:   </os>
Nov 02 01:44:12 user nova-compute[74996]:   <features>
Nov 02 01:44:12 user nova-compute[74996]:     <acpi/>
Nov 02 01:44:12 user nova-compute[74996]:     <apic/>
Nov 02 01:44:12 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:44:12 user nova-compute[74996]:   </features>
Nov 02 01:44:12 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:44:12 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:44:12 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:44:12 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:44:12 user nova-compute[74996]:   </clock>
Nov 02 01:44:12 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:44:12 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:44:12 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:44:12 user nova-compute[74996]:   </cpu>
Nov 02 01:44:12 user nova-compute[74996]:   <devices>
Nov 02 01:44:12 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:44:12 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:44:12 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/f395088d-c7db-4a64-ab03-38cefee60231/disk"/>
Nov 02 01:44:12 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:44:12 user nova-compute[74996]:     </disk>
Nov 02 01:44:12 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:44:12 user nova-compute[74996]:       <mac address="fa:16:3e:88:bc:1a"/>
Nov 02 01:44:12 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:44:12 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:44:12 user nova-compute[74996]:       <target dev="tapcc0b256e-e9"/>
Nov 02 01:44:12 user nova-compute[74996]:     </interface>
Nov 02 01:44:12 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:44:12 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/f395088d-c7db-4a64-ab03-38cefee60231/console.log" append="off"/>
Nov 02 01:44:12 user nova-compute[74996]:     </serial>
Nov 02 01:44:12 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:44:12 user nova-compute[74996]:     <video>
Nov 02 01:44:12 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:44:12 user nova-compute[74996]:     </video>
Nov 02 01:44:12 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:44:12 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:44:12 user nova-compute[74996]:     </rng>
Nov 02 01:44:12 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:44:12 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:44:12 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:44:12 user nova-compute[74996]:     </memballoon>
Nov 02 01:44:12 user nova-compute[74996]:   </devices>
Nov 02 01:44:12 user nova-compute[74996]: </domain>
Nov 02 01:44:12 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:44:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1957960014',display_name='tempest-VolumesNegativeTest-instance-1957960014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1957960014',id=29,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c4eebeae2fa47399c9c1064ac8ebafa',ramdisk_id='',reservation_id='r-v6drfr3s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-285716449',owner_user_name='tempest-VolumesNegativeTest-285716449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:44:10Z,user_data=None,user_id='46ff1a9da6e3470eadc46cc13c482fb0',uuid=f395088d-c7db-4a64-ab03-38cefee60231,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0", "address": "fa:16:3e:88:bc:1a", "network": {"id": "f4effa4b-9479-42c3-b5fe-2e997f187ec7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b7bb81c16b2f458a85ebcf2fb18f7709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc0b256e-e9", "ovs_interfaceid": "cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Converting VIF {"id": "cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0", "address": "fa:16:3e:88:bc:1a", "network": {"id": "f4effa4b-9479-42c3-b5fe-2e997f187ec7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b7bb81c16b2f458a85ebcf2fb18f7709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc0b256e-e9", "ovs_interfaceid": "cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:bc:1a,bridge_name='br-int',has_traffic_filtering=True,id=cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0,network=Network(f4effa4b-9479-42c3-b5fe-2e997f187ec7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc0b256e-e9') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG os_vif [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:bc:1a,bridge_name='br-int',has_traffic_filtering=True,id=cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0,network=Network(f4effa4b-9479-42c3-b5fe-2e997f187ec7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc0b256e-e9') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '075c5b24-f138-5b06-923a-072267ebcf21', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc0b256e-e9, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc0b256e-e9, col_values=(('qos', UUID('cade3079-0a07-4b9c-af03-11d6f8cacf8f')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc0b256e-e9, col_values=(('external_ids', {'iface-id': 'cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:bc:1a', 'vm-uuid': 'f395088d-c7db-4a64-ab03-38cefee60231'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:44:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:12 user nova-compute[74996]: INFO os_vif [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:bc:1a,bridge_name='br-int',has_traffic_filtering=True,id=cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0,network=Network(f4effa4b-9479-42c3-b5fe-2e997f187ec7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc0b256e-e9')
Nov 02 01:44:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:44:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] No VIF found with MAC fa:16:3e:88:bc:1a, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:44:13 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:44:13 user nova-compute[74996]: DEBUG nova.network.neutron [req-0d085dbc-6a65-4e26-9c70-dbbda595398b req-b84c41b2-60dc-4c48-99b3-5b5e7da5e923 service nova] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Updated VIF entry in instance network info cache for port 498304ed-92a0-4c70-88e1-d668894f583a. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:44:13 user nova-compute[74996]: DEBUG nova.network.neutron [req-0d085dbc-6a65-4e26-9c70-dbbda595398b req-b84c41b2-60dc-4c48-99b3-5b5e7da5e923 service nova] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Updating instance_info_cache with network_info: [{"id": "498304ed-92a0-4c70-88e1-d668894f583a", "address": "fa:16:3e:7e:df:ab", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap498304ed-92", "ovs_interfaceid": "498304ed-92a0-4c70-88e1-d668894f583a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:44:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0d085dbc-6a65-4e26-9c70-dbbda595398b req-b84c41b2-60dc-4c48-99b3-5b5e7da5e923 service nova] Releasing lock "refresh_cache-d28b9820-c059-46cb-9bb0-132e447fca1b" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:44:13 user nova-compute[74996]: DEBUG nova.compute.manager [req-0d085dbc-6a65-4e26-9c70-dbbda595398b req-b84c41b2-60dc-4c48-99b3-5b5e7da5e923 service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Received event network-changed-cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:44:13 user nova-compute[74996]: DEBUG nova.compute.manager [req-0d085dbc-6a65-4e26-9c70-dbbda595398b req-b84c41b2-60dc-4c48-99b3-5b5e7da5e923 service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Refreshing instance network info cache due to event network-changed-cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:44:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0d085dbc-6a65-4e26-9c70-dbbda595398b req-b84c41b2-60dc-4c48-99b3-5b5e7da5e923 service nova] Acquiring lock "refresh_cache-f395088d-c7db-4a64-ab03-38cefee60231" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:44:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0d085dbc-6a65-4e26-9c70-dbbda595398b req-b84c41b2-60dc-4c48-99b3-5b5e7da5e923 service nova] Acquired lock "refresh_cache-f395088d-c7db-4a64-ab03-38cefee60231" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:44:13 user nova-compute[74996]: DEBUG nova.network.neutron [req-0d085dbc-6a65-4e26-9c70-dbbda595398b req-b84c41b2-60dc-4c48-99b3-5b5e7da5e923 service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Refreshing network info cache for port cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:44:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "9d706c1a-883b-4b26-8972-4083df064e93" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "9d706c1a-883b-4b26-8972-4083df064e93" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "9d706c1a-883b-4b26-8972-4083df064e93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "9d706c1a-883b-4b26-8972-4083df064e93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "9d706c1a-883b-4b26-8972-4083df064e93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:13 user nova-compute[74996]: INFO nova.compute.manager [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Terminating instance
Nov 02 01:44:13 user nova-compute[74996]: DEBUG nova.compute.manager [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:44:13 user nova-compute[74996]: DEBUG nova.compute.manager [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Stashing vm_state: active {{(pid=74996) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Nov 02 01:44:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:13 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:44:13 user nova-compute[74996]: INFO nova.compute.claims [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Claim successful on node user
Nov 02 01:44:13 user nova-compute[74996]: INFO nova.compute.resource_tracker [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Updating resource usage from migration 404789e4-99ac-4290-8d63-1f7e34c99e57
Nov 02 01:44:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:14 user nova-compute[74996]: DEBUG nova.network.neutron [req-0d085dbc-6a65-4e26-9c70-dbbda595398b req-b84c41b2-60dc-4c48-99b3-5b5e7da5e923 service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Updated VIF entry in instance network info cache for port cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:44:14 user nova-compute[74996]: DEBUG nova.network.neutron [req-0d085dbc-6a65-4e26-9c70-dbbda595398b req-b84c41b2-60dc-4c48-99b3-5b5e7da5e923 service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Updating instance_info_cache with network_info: [{"id": "cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0", "address": "fa:16:3e:88:bc:1a", "network": {"id": "f4effa4b-9479-42c3-b5fe-2e997f187ec7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b7bb81c16b2f458a85ebcf2fb18f7709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc0b256e-e9", "ovs_interfaceid": "cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:44:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0d085dbc-6a65-4e26-9c70-dbbda595398b req-b84c41b2-60dc-4c48-99b3-5b5e7da5e923 service nova] Releasing lock "refresh_cache-f395088d-c7db-4a64-ab03-38cefee60231" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:44:14 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:44:14 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:44:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.707s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:14 user nova-compute[74996]: INFO nova.compute.manager [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Migrating
Nov 02 01:44:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "refresh_cache-d28b9820-c059-46cb-9bb0-132e447fca1b" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:44:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquired lock "refresh_cache-d28b9820-c059-46cb-9bb0-132e447fca1b" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:44:14 user nova-compute[74996]: DEBUG nova.network.neutron [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:44:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:14 user nova-compute[74996]: DEBUG nova.compute.manager [req-60be209e-c662-40c4-937d-6af64def6ca4 req-9a348108-9a86-4154-ba72-6187b356c363 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Received event network-vif-unplugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:44:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-60be209e-c662-40c4-937d-6af64def6ca4 req-9a348108-9a86-4154-ba72-6187b356c363 service nova] Acquiring lock "9d706c1a-883b-4b26-8972-4083df064e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-60be209e-c662-40c4-937d-6af64def6ca4 req-9a348108-9a86-4154-ba72-6187b356c363 service nova] Lock "9d706c1a-883b-4b26-8972-4083df064e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-60be209e-c662-40c4-937d-6af64def6ca4 req-9a348108-9a86-4154-ba72-6187b356c363 service nova] Lock "9d706c1a-883b-4b26-8972-4083df064e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:14 user nova-compute[74996]: DEBUG nova.compute.manager [req-60be209e-c662-40c4-937d-6af64def6ca4 req-9a348108-9a86-4154-ba72-6187b356c363 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] No waiting events found dispatching network-vif-unplugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:44:14 user nova-compute[74996]: DEBUG nova.compute.manager [req-60be209e-c662-40c4-937d-6af64def6ca4 req-9a348108-9a86-4154-ba72-6187b356c363 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Received event network-vif-unplugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:44:14 user nova-compute[74996]: DEBUG nova.compute.manager [req-60be209e-c662-40c4-937d-6af64def6ca4 req-9a348108-9a86-4154-ba72-6187b356c363 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Received event network-vif-plugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:44:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-60be209e-c662-40c4-937d-6af64def6ca4 req-9a348108-9a86-4154-ba72-6187b356c363 service nova] Acquiring lock "9d706c1a-883b-4b26-8972-4083df064e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-60be209e-c662-40c4-937d-6af64def6ca4 req-9a348108-9a86-4154-ba72-6187b356c363 service nova] Lock "9d706c1a-883b-4b26-8972-4083df064e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-60be209e-c662-40c4-937d-6af64def6ca4 req-9a348108-9a86-4154-ba72-6187b356c363 service nova] Lock "9d706c1a-883b-4b26-8972-4083df064e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:14 user nova-compute[74996]: DEBUG nova.compute.manager [req-60be209e-c662-40c4-937d-6af64def6ca4 req-9a348108-9a86-4154-ba72-6187b356c363 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] No waiting events found dispatching network-vif-plugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:44:14 user nova-compute[74996]: WARNING nova.compute.manager [req-60be209e-c662-40c4-937d-6af64def6ca4 req-9a348108-9a86-4154-ba72-6187b356c363 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Received unexpected event network-vif-plugged-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c for instance with vm_state active and task_state deleting.
Nov 02 01:44:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:14 user nova-compute[74996]: DEBUG nova.network.neutron [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Updating instance_info_cache with network_info: [{"id": "498304ed-92a0-4c70-88e1-d668894f583a", "address": "fa:16:3e:7e:df:ab", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap498304ed-92", "ovs_interfaceid": "498304ed-92a0-4c70-88e1-d668894f583a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:44:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Releasing lock "refresh_cache-d28b9820-c059-46cb-9bb0-132e447fca1b" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Starting migrate_disk_and_power_off {{(pid=74996) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 02 01:44:15 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Instance destroyed successfully.
Nov 02 01:44:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG nova.objects.instance [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lazy-loading 'resources' on Instance uuid 9d706c1a-883b-4b26-8972-4083df064e93 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:37:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-94790749',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-94790749',id=20,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:40:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='142161c2fae44bdea848619580195795',ramdisk_id='',reservation_id='r-cla6iv6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1294190560',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:42:29Z,user_data=None,user_id='15affb427e9b4fb8873accf286510e14',uuid=9d706c1a-883b-4b26-8972-4083df064e93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "address": "fa:16:3e:f0:bd:77", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9071ad51-8c", "ovs_interfaceid": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Converting VIF {"id": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "address": "fa:16:3e:f0:bd:77", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9071ad51-8c", "ovs_interfaceid": "9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:bd:77,bridge_name='br-int',has_traffic_filtering=True,id=9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c,network=Network(b5218514-0348-4dcc-8ecf-4595a87e204a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9071ad51-8c') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG os_vif [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:bd:77,bridge_name='br-int',has_traffic_filtering=True,id=9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c,network=Network(b5218514-0348-4dcc-8ecf-4595a87e204a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9071ad51-8c') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9071ad51-8c, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a023faff-e34a-47e0-a5d4-fac5b8e22848) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:15 user nova-compute[74996]: INFO os_vif [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:bd:77,bridge_name='br-int',has_traffic_filtering=True,id=9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c,network=Network(b5218514-0348-4dcc-8ecf-4595a87e204a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9071ad51-8c')
Nov 02 01:44:15 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEHAcMyI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:44:15 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:44:15 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG nova.compute.manager [req-51388882-6ff5-42ea-a24a-89314346d431 req-13cb299e-8971-4692-870e-f457a3b3b917 service nova] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Received event network-vif-unplugged-498304ed-92a0-4c70-88e1-d668894f583a {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-51388882-6ff5-42ea-a24a-89314346d431 req-13cb299e-8971-4692-870e-f457a3b3b917 service nova] Acquiring lock "d28b9820-c059-46cb-9bb0-132e447fca1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-51388882-6ff5-42ea-a24a-89314346d431 req-13cb299e-8971-4692-870e-f457a3b3b917 service nova] Lock "d28b9820-c059-46cb-9bb0-132e447fca1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-51388882-6ff5-42ea-a24a-89314346d431 req-13cb299e-8971-4692-870e-f457a3b3b917 service nova] Lock "d28b9820-c059-46cb-9bb0-132e447fca1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG nova.compute.manager [req-51388882-6ff5-42ea-a24a-89314346d431 req-13cb299e-8971-4692-870e-f457a3b3b917 service nova] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] No waiting events found dispatching network-vif-unplugged-498304ed-92a0-4c70-88e1-d668894f583a {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:44:15 user nova-compute[74996]: WARNING nova.compute.manager [req-51388882-6ff5-42ea-a24a-89314346d431 req-13cb299e-8971-4692-870e-f457a3b3b917 service nova] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Received unexpected event network-vif-unplugged-498304ed-92a0-4c70-88e1-d668894f583a for instance with vm_state active and task_state resize_migrating.
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.037s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d381e0-9ddd-4e99-beb1-d06dba13c8ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:44:15 user nova-compute[74996]: No targets found.
Nov 02 01:44:15 user nova-compute[74996]: iSNS:
Nov 02 01:44:15 user nova-compute[74996]: No targets found.
Nov 02 01:44:15 user nova-compute[74996]: STATIC:
Nov 02 01:44:15 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f
Nov 02 01:44:15 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:44:15 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:44:15 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b
Nov 02 01:44:15 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:44:15 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:44:15 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494
Nov 02 01:44:15 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:44:15 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:44:15 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7
Nov 02 01:44:15 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:44:15 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:44:15 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e
Nov 02 01:44:15 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:44:15 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:44:15 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8
Nov 02 01:44:15 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:44:15 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:44:15 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d
Nov 02 01:44:15 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:44:15 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:44:15 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4
Nov 02 01:44:15 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:44:15 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:44:15 user nova-compute[74996]: FIRMWARE:
Nov 02 01:44:15 user nova-compute[74996]: No targets found.
Nov 02 01:44:15 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:44:15 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:44:15 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d30760-61da-413a-9ef6-8fc2e9594e53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[268c96a2-b450-42b6-8f76-d6572ef4fba0]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:44:15 user nova-compute[74996]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:44:15 user nova-compute[74996]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)
Nov 02 01:44:15 user nova-compute[74996]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:44:15 user nova-compute[74996]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f (non-flash)
Nov 02 01:44:15 user nova-compute[74996]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e (non-flash)
Nov 02 01:44:15 user nova-compute[74996]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)
Nov 02 01:44:15 user nova-compute[74996]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)
Nov 02 01:44:15 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 (non-flash)
Nov 02 01:44:15 user nova-compute[74996]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:44:15 user nova-compute[74996]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)
Nov 02 01:44:15 user nova-compute[74996]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:44:15 user nova-compute[74996]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f (non-flash)
Nov 02 01:44:15 user nova-compute[74996]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e (non-flash)
Nov 02 01:44:15 user nova-compute[74996]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)
Nov 02 01:44:15 user nova-compute[74996]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)
Nov 02 01:44:15 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e85a7c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7'): ({'sdb'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Removing single pathed devices sdb {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[23febd09-bc71-47df-b6bd-46e88a04eb16]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f598f83-8855-4517-99d4-7136ea746944]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Flushing IO for device /dev/sdb {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc263f3-fca4-45b5-bd11-0591cb1cb9e0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b442a95-8c99-4376-8169-4e6ccfe08d71]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f605539a-348a-47cc-9ebe-a7bbfc180050]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79667b4-33f9-4205-abbb-195e82311926]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7, portal: 172.16.0.220,3260]
Nov 02 01:44:15 user nova-compute[74996]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7, portal: 172.16.0.220,3260] successful.
Nov 02 01:44:15 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:15 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Instance destroyed successfully.
Nov 02 01:44:15 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:41:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1119191985',display_name='tempest-ServerActionsTestOtherA-server-1119191985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1119191985',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuGPSdhZpoJV1Cta3eTfZjI1QRYRGe6Y8DzUdNt6ZIoysubzlLd36OVzphJd/MOKltwOpW5QoJYEARWlOQfh2pk3msvJuTgQKOLlFS0wLTIMWMdtr2LMQxjw6cacUWITQ==',key_name='tempest-keypair-1376755092',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:42:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f462793d4eb4433c9c27d92f80518db1',ramdisk_id='',reservation_id='r-ptctrwds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-852070362',owner_user_name='tempest-ServerActionsTestOtherA-852070362-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:44:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0ac87391a0140ba83743c0a2cd193fe',uuid=d28b9820-c059-46cb-9bb0-132e447fca1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "498304ed-92a0-4c70-88e1-d668894f583a", "address": "fa:16:3e:7e:df:ab", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1218986437-network", "vif_mac": "fa:16:3e:7e:df:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap498304ed-92", "ovs_interfaceid": "498304ed-92a0-4c70-88e1-d668894f583a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Converting VIF {"id": "498304ed-92a0-4c70-88e1-d668894f583a", "address": "fa:16:3e:7e:df:ab", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1218986437-network", "vif_mac": "fa:16:3e:7e:df:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap498304ed-92", "ovs_interfaceid": "498304ed-92a0-4c70-88e1-d668894f583a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:df:ab,bridge_name='br-int',has_traffic_filtering=True,id=498304ed-92a0-4c70-88e1-d668894f583a,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap498304ed-92') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG os_vif [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:df:ab,bridge_name='br-int',has_traffic_filtering=True,id=498304ed-92a0-4c70-88e1-d668894f583a,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap498304ed-92') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap498304ed-92, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e4708de0-f6ac-493b-bc76-7cceb6c2172b) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:056998b8-61e1-46e5-b497-c0ee61ae9ff7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.054s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b74cb22-2437-4a90-8b2e-d0ac4fcd60a4]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.496s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] <== disconnect_volume: return (498ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:44:15 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Deleting instance files /opt/stack/data/nova/instances/9d706c1a-883b-4b26-8972-4083df064e93_del
Nov 02 01:44:15 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Deletion of /opt/stack/data/nova/instances/9d706c1a-883b-4b26-8972-4083df064e93_del complete
Nov 02 01:44:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:15 user nova-compute[74996]: INFO os_vif [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:df:ab,bridge_name='br-int',has_traffic_filtering=True,id=498304ed-92a0-4c70-88e1-d668894f583a,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap498304ed-92')
Nov 02 01:44:15 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCNKbdPs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:44:15 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:44:15 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:44:15 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.041s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f89f8e-305d-4674-b9b2-5f8a7b636edb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:44:16 user nova-compute[74996]: No targets found.
Nov 02 01:44:16 user nova-compute[74996]: iSNS:
Nov 02 01:44:16 user nova-compute[74996]: No targets found.
Nov 02 01:44:16 user nova-compute[74996]: STATIC:
Nov 02 01:44:16 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f
Nov 02 01:44:16 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:44:16 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:44:16 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b
Nov 02 01:44:16 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:44:16 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:44:16 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494
Nov 02 01:44:16 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:44:16 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:44:16 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e
Nov 02 01:44:16 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:44:16 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:44:16 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8
Nov 02 01:44:16 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:44:16 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:44:16 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d
Nov 02 01:44:16 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:44:16 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:44:16 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4
Nov 02 01:44:16 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:44:16 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:44:16 user nova-compute[74996]: FIRMWARE:
Nov 02 01:44:16 user nova-compute[74996]: No targets found.
Nov 02 01:44:16 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:44:16 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:44:16 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d9a332-ebf2-4c28-87ff-f0659d5a80bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:16 user nova-compute[74996]: INFO nova.compute.manager [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Took 2.61 seconds to destroy the instance on the hypervisor.
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9358ddab-8d88-4f62-8db2-7db0e2c2e807]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:44:16 user nova-compute[74996]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)
Nov 02 01:44:16 user nova-compute[74996]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:44:16 user nova-compute[74996]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f (non-flash)
Nov 02 01:44:16 user nova-compute[74996]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e (non-flash)
Nov 02 01:44:16 user nova-compute[74996]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)
Nov 02 01:44:16 user nova-compute[74996]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)
Nov 02 01:44:16 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:44:16 user nova-compute[74996]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 (non-flash)
Nov 02 01:44:16 user nova-compute[74996]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:44:16 user nova-compute[74996]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f (non-flash)
Nov 02 01:44:16 user nova-compute[74996]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e (non-flash)
Nov 02 01:44:16 user nova-compute[74996]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)
Nov 02 01:44:16 user nova-compute[74996]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)
Nov 02 01:44:16 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830c7c3c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8'): ({'sdd'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Removing single pathed devices sdd {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c870f4-c632-4a6d-bf7d-dd98b9182911]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[070e7f61-165f-458c-a7e7-394c8d0210dd]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Flushing IO for device /dev/sdd {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef60f53-bb92-46b4-ae9d-ce49fa90f592]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3507283-d0d5-4648-933c-d1920c449bdb]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] SCSI volumes sdd have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.044s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b864ec11-93b5-4529-acb3-45bb56ce1641]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.191s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fc256e-e88b-47cd-9eb6-3ddee73a9fd4]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8, portal: 172.16.0.220,3260]
Nov 02 01:44:16 user nova-compute[74996]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8, portal: 172.16.0.220,3260] successful.
Nov 02 01:44:16 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc0174c-7625-4264-ad57-a972e6531565]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.584s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] <== disconnect_volume: return (585ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:44:16 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Took 0.61 seconds to deallocate network for instance.
Nov 02 01:44:16 user nova-compute[74996]: DEBUG nova.compute.manager [req-3b4430fc-e048-4e16-858b-cfb2d69d4626 req-8450bae3-47a9-4a3a-820b-f2c7a1656e25 service nova] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Received event network-vif-deleted-9071ad51-8c23-4df4-a4a7-ffe6f0f0e50c {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG nova.compute.manager [req-5d296b7f-2e82-48fb-87d3-4c35ea31a2d9 req-90460230-807c-414a-bc79-ee1549e04ecb service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Received event network-vif-plugged-cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5d296b7f-2e82-48fb-87d3-4c35ea31a2d9 req-90460230-807c-414a-bc79-ee1549e04ecb service nova] Acquiring lock "f395088d-c7db-4a64-ab03-38cefee60231-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5d296b7f-2e82-48fb-87d3-4c35ea31a2d9 req-90460230-807c-414a-bc79-ee1549e04ecb service nova] Lock "f395088d-c7db-4a64-ab03-38cefee60231-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5d296b7f-2e82-48fb-87d3-4c35ea31a2d9 req-90460230-807c-414a-bc79-ee1549e04ecb service nova] Lock "f395088d-c7db-4a64-ab03-38cefee60231-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG nova.compute.manager [req-5d296b7f-2e82-48fb-87d3-4c35ea31a2d9 req-90460230-807c-414a-bc79-ee1549e04ecb service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] No waiting events found dispatching network-vif-plugged-cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:44:16 user nova-compute[74996]: WARNING nova.compute.manager [req-5d296b7f-2e82-48fb-87d3-4c35ea31a2d9 req-90460230-807c-414a-bc79-ee1549e04ecb service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Received unexpected event network-vif-plugged-cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0 for instance with vm_state building and task_state spawning.
Nov 02 01:44:16 user nova-compute[74996]: DEBUG nova.compute.manager [req-5d296b7f-2e82-48fb-87d3-4c35ea31a2d9 req-90460230-807c-414a-bc79-ee1549e04ecb service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Received event network-vif-plugged-cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5d296b7f-2e82-48fb-87d3-4c35ea31a2d9 req-90460230-807c-414a-bc79-ee1549e04ecb service nova] Acquiring lock "f395088d-c7db-4a64-ab03-38cefee60231-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5d296b7f-2e82-48fb-87d3-4c35ea31a2d9 req-90460230-807c-414a-bc79-ee1549e04ecb service nova] Lock "f395088d-c7db-4a64-ab03-38cefee60231-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5d296b7f-2e82-48fb-87d3-4c35ea31a2d9 req-90460230-807c-414a-bc79-ee1549e04ecb service nova] Lock "f395088d-c7db-4a64-ab03-38cefee60231-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:16 user nova-compute[74996]: DEBUG nova.compute.manager [req-5d296b7f-2e82-48fb-87d3-4c35ea31a2d9 req-90460230-807c-414a-bc79-ee1549e04ecb service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] No waiting events found dispatching network-vif-plugged-cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:44:16 user nova-compute[74996]: WARNING nova.compute.manager [req-5d296b7f-2e82-48fb-87d3-4c35ea31a2d9 req-90460230-807c-414a-bc79-ee1549e04ecb service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Received unexpected event network-vif-plugged-cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0 for instance with vm_state building and task_state spawning.
Nov 02 01:44:17 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:44:17 user nova-compute[74996]: DEBUG nova.compute.manager [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:44:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:44:17 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Instance spawned successfully.
Nov 02 01:44:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:44:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:44:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:44:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:44:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:44:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:44:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:44:17 user nova-compute[74996]: DEBUG nova.compute.manager [req-59753a80-4736-4f49-80bc-84f0e18fb254 req-b88fae3f-ea4a-4f68-a0f2-112697393256 service nova] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Received event network-vif-plugged-498304ed-92a0-4c70-88e1-d668894f583a {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:44:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-59753a80-4736-4f49-80bc-84f0e18fb254 req-b88fae3f-ea4a-4f68-a0f2-112697393256 service nova] Acquiring lock "d28b9820-c059-46cb-9bb0-132e447fca1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-59753a80-4736-4f49-80bc-84f0e18fb254 req-b88fae3f-ea4a-4f68-a0f2-112697393256 service nova] Lock "d28b9820-c059-46cb-9bb0-132e447fca1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-59753a80-4736-4f49-80bc-84f0e18fb254 req-b88fae3f-ea4a-4f68-a0f2-112697393256 service nova] Lock "d28b9820-c059-46cb-9bb0-132e447fca1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:17 user nova-compute[74996]: DEBUG nova.compute.manager [req-59753a80-4736-4f49-80bc-84f0e18fb254 req-b88fae3f-ea4a-4f68-a0f2-112697393256 service nova] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] No waiting events found dispatching network-vif-plugged-498304ed-92a0-4c70-88e1-d668894f583a {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:44:17 user nova-compute[74996]: WARNING nova.compute.manager [req-59753a80-4736-4f49-80bc-84f0e18fb254 req-b88fae3f-ea4a-4f68-a0f2-112697393256 service nova] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Received unexpected event network-vif-plugged-498304ed-92a0-4c70-88e1-d668894f583a for instance with vm_state active and task_state resize_migrating.
Nov 02 01:44:17 user nova-compute[74996]: INFO nova.compute.manager [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Took 7.82 seconds to spawn the instance on the hypervisor.
Nov 02 01:44:17 user nova-compute[74996]: DEBUG nova.compute.manager [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:44:17 user nova-compute[74996]: INFO nova.compute.manager [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Took 8.87 seconds to build instance.
Nov 02 01:44:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9dc7b62e-c4a5-4952-a871-fa9d0e3c20a2 tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Lock "f395088d-c7db-4a64-ab03-38cefee60231" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.967s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:17 user nova-compute[74996]: INFO nova.compute.manager [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: 9d706c1a-883b-4b26-8972-4083df064e93] Took 1.08 seconds to detach 1 volumes for instance.
Nov 02 01:44:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:18 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:44:18 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:44:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.621s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:18 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Deleted allocations for instance 9d706c1a-883b-4b26-8972-4083df064e93
Nov 02 01:44:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e4f1b24d-1753-4acc-a4d4-7601d2450087 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "9d706c1a-883b-4b26-8972-4083df064e93" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.440s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:20 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:44:20 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:44:20 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:44:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:20 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:44:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:21 user nova-compute[74996]: DEBUG nova.network.neutron [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Port 498304ed-92a0-4c70-88e1-d668894f583a binding to destination host user is already ACTIVE {{(pid=74996) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 02 01:44:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "d28b9820-c059-46cb-9bb0-132e447fca1b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "d28b9820-c059-46cb-9bb0-132e447fca1b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "d28b9820-c059-46cb-9bb0-132e447fca1b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:44:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:44:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f395088d-c7db-4a64-ab03-38cefee60231/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f395088d-c7db-4a64-ab03-38cefee60231/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f395088d-c7db-4a64-ab03-38cefee60231/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "refresh_cache-d28b9820-c059-46cb-9bb0-132e447fca1b" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:44:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquired lock "refresh_cache-d28b9820-c059-46cb-9bb0-132e447fca1b" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:44:21 user nova-compute[74996]: DEBUG nova.network.neutron [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:44:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f395088d-c7db-4a64-ab03-38cefee60231/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d834837-a1a1-436d-9015-b9b3bf048170/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d834837-a1a1-436d-9015-b9b3bf048170/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d834837-a1a1-436d-9015-b9b3bf048170/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG nova.network.neutron [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Updating instance_info_cache with network_info: [{"id": "498304ed-92a0-4c70-88e1-d668894f583a", "address": "fa:16:3e:7e:df:ab", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap498304ed-92", "ovs_interfaceid": "498304ed-92a0-4c70-88e1-d668894f583a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d834837-a1a1-436d-9015-b9b3bf048170/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Releasing lock "refresh_cache-d28b9820-c059-46cb-9bb0-132e447fca1b" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG os_brick.utils [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c8f21c-1cfd-4291-8e0e-9157bb56f925]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ab29e6-61f5-4ca4-bc99-501edb4bb132]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f910089-567f-4835-a4c5-9456ed339b5e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f2c8f5-6e99-471c-b65f-507ba5c4ca74]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:44:22 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:44:22 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d29381-4141-43bc-8198-4ef622a3d6da]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG os_brick.utils [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:44:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:23 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5d834837-a1a1-436d-9015-b9b3bf048170 is timed out.
Nov 02 01:44:23 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Successfully detached device vdb from instance 5d834837-a1a1-436d-9015-b9b3bf048170 from the live domain config.
Nov 02 01:44:23 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:44:23 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:44:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=7615MB free_disk=25.057723999023438GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IiwLGsyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:44:24 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:44:24 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2137ce14-7bd3-4732-968e-fa8a17e346ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1756b322-569d-446f-a8b1-4e6f3cf798ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:44:24 user nova-compute[74996]: No targets found.
Nov 02 01:44:24 user nova-compute[74996]: iSNS:
Nov 02 01:44:24 user nova-compute[74996]: No targets found.
Nov 02 01:44:24 user nova-compute[74996]: STATIC:
Nov 02 01:44:24 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f
Nov 02 01:44:24 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:44:24 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:44:24 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b
Nov 02 01:44:24 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:44:24 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:44:24 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494
Nov 02 01:44:24 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:44:24 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:44:24 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e
Nov 02 01:44:24 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:44:24 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:44:24 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d
Nov 02 01:44:24 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:44:24 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:44:24 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:1756b322-569d-446f-a8b1-4e6f3cf798ad
Nov 02 01:44:24 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:44:24 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:44:24 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4
Nov 02 01:44:24 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:44:24 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:44:24 user nova-compute[74996]: FIRMWARE:
Nov 02 01:44:24 user nova-compute[74996]: No targets found.
Nov 02 01:44:24 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:44:24 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:44:24 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7292bc3-536a-4dc3-b99b-26e9488a0294]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1756b322-569d-446f-a8b1-4e6f3cf798ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b336d0df-4a6b-4f2f-b2e5-c083b3259629]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1756b322-569d-446f-a8b1-4e6f3cf798ad (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:44:24 user nova-compute[74996]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:44:24 user nova-compute[74996]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f (non-flash)
Nov 02 01:44:24 user nova-compute[74996]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e (non-flash)
Nov 02 01:44:24 user nova-compute[74996]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)
Nov 02 01:44:24 user nova-compute[74996]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)
Nov 02 01:44:24 user nova-compute[74996]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1756b322-569d-446f-a8b1-4e6f3cf798ad (non-flash)
Nov 02 01:44:24 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:44:24 user nova-compute[74996]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:44:24 user nova-compute[74996]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f (non-flash)
Nov 02 01:44:24 user nova-compute[74996]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e (non-flash)
Nov 02 01:44:24 user nova-compute[74996]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)
Nov 02 01:44:24 user nova-compute[74996]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)
Nov 02 01:44:24 user nova-compute[74996]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1756b322-569d-446f-a8b1-4e6f3cf798ad (non-flash)
Nov 02 01:44:24 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830c594280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e'): ({'sdg'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Removing single pathed devices sdg {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da9033c-affa-4f19-a927-5770387ff929]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4fbd51-7ead-445d-b59a-a7f74d1c5d59]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Flushing IO for device /dev/sdg {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Applying migration context for instance d28b9820-c059-46cb-9bb0-132e447fca1b as it has an incoming, in-progress migration 404789e4-99ac-4290-8d63-1f7e34c99e57. Migration status is post-migrating {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 02 01:44:24 user nova-compute[74996]: INFO nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Updating resource usage from migration 404789e4-99ac-4290-8d63-1f7e34c99e57
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bebb2a1-d21c-4c01-aa1a-341827f4a143]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance fea802b7-64d9-4c77-87a7-eaba1dce5c22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7307f3a3-1ad1-43f7-be49-9cd03a626cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance d8f51f7d-c9de-4914-883e-7a875d3d73ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 3b5719c9-08ad-4a01-b960-23328b537283 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance f0de5980-334b-4654-8b1a-88c4c861aa49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 5d834837-a1a1-436d-9015-b9b3bf048170 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 382dce4d-dd73-4929-81dc-bcc3bb987045 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance effec7f0-1006-4081-91f4-e2d96fd0a87a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance f395088d-c7db-4a64-ab03-38cefee60231 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Migration 404789e4-99ac-4290-8d63-1f7e34c99e57 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance d28b9820-c059-46cb-9bb0-132e447fca1b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.057s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[96863034-6096-4f21-a650-f249236460d8]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] SCSI volumes sdg have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf772ccf-b306-45de-a9e9-c32b6c677c49]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35e8f6c-efa7-4bac-bd24-01c295fe6ce9]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e, portal: 172.16.0.220,3260]
Nov 02 01:44:24 user nova-compute[74996]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e, portal: 172.16.0.220,3260] successful.
Nov 02 01:44:24 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deb4bea3-2efc-4eae-a22d-174ac978701e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a9b620-b2d9-4c2e-b58d-881b4dc07052]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.452s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] <== disconnect_volume: return (454ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:44:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.761s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:25 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:44:25 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:44:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-d8f51f7d-c9de-4914-883e-7a875d3d73ad" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:44:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-d8f51f7d-c9de-4914-883e-7a875d3d73ad" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:44:25 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 01:44:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:44:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 01:44:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:44:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:44:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:26 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Updating instance_info_cache with network_info: [{"id": "d0ea7655-29c6-450a-b2df-f2554925c3a5", "address": "fa:16:3e:0d:f1:d9", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7655-29", "ovs_interfaceid": "d0ea7655-29c6-450a-b2df-f2554925c3a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:44:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-d8f51f7d-c9de-4914-883e-7a875d3d73ad" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:44:26 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 01:44:26 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:44:26 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:44:26 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:44:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPqMJDGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:44:32 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:44:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:44:32 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:44:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:44:32 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:44:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[65231d59-ac51-4b21-ac07-ac26b2cd3117]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:44:32 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9e0062-9f8e-44ee-80d9-eede24e81880]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67] added
Nov 02 01:44:32 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2146550-d9ec-4cfd-ab88-7ab279b5a7e9]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd52b25-dcd7-4ac9-96ed-1768d23e073c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kPqMJDGB {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kPqMJDGB" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a3ace8-2228-4b26-95eb-a1c48646f81f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kPqMJDGB'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88c0a76-18a7-497b-9ca3-3488b6f4639b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d5bcd4-754d-4e95-a7d2-e14991d043b6]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1756b322-569d-446f-a8b1-4e6f3cf798ad (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:44:32 user nova-compute[74996]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:44:32 user nova-compute[74996]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f (non-flash)
Nov 02 01:44:32 user nova-compute[74996]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)
Nov 02 01:44:32 user nova-compute[74996]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1756b322-569d-446f-a8b1-4e6f3cf798ad (non-flash)
Nov 02 01:44:32 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:44:32 user nova-compute[74996]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:44:32 user nova-compute[74996]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f (non-flash)
Nov 02 01:44:32 user nova-compute[74996]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)
Nov 02 01:44:32 user nova-compute[74996]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1756b322-569d-446f-a8b1-4e6f3cf798ad (non-flash)
Nov 02 01:44:32 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:44:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b01c6d-f94f-4551-be3a-d69671bbc589]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67, portal: 172.16.0.220,3260]
Nov 02 01:44:33 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67, portal: 172.16.0.220,3260] successful.
Nov 02 01:44:33 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[038b2162-cac2-47ad-b6e6-caa65d34131f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6444a391-9599-4da5-91a1-b98f0ba3347b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1756b322-569d-446f-a8b1-4e6f3cf798ad (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:44:33 user nova-compute[74996]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:44:33 user nova-compute[74996]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f (non-flash)
Nov 02 01:44:33 user nova-compute[74996]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)
Nov 02 01:44:33 user nova-compute[74996]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1756b322-569d-446f-a8b1-4e6f3cf798ad (non-flash)
Nov 02 01:44:33 user nova-compute[74996]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)
Nov 02 01:44:33 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:44:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:44:33 user nova-compute[74996]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:44:33 user nova-compute[74996]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c85370d-524b-4d99-a7ad-5b3f9de73e0f (non-flash)
Nov 02 01:44:33 user nova-compute[74996]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)
Nov 02 01:44:33 user nova-compute[74996]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1756b322-569d-446f-a8b1-4e6f3cf798ad (non-flash)
Nov 02 01:44:33 user nova-compute[74996]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)
Nov 02 01:44:33 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:44:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:44:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:44:33 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:44:33 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:44:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5d7c8e-35e7-4abe-a783-383cdc8757aa]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:33 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:44:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPqMJDGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:44:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:34 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:44:34 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23934653236346365', 'path': '/dev/sdd'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:44:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934653236346365', 'path': '/dev/sdd'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:44:34 user nova-compute[74996]: DEBUG nova.objects.instance [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lazy-loading 'flavor' on Instance uuid f0de5980-334b-4654-8b1a-88c4c861aa49 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:44:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 01:44:34 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:44:34 user nova-compute[74996]:   <source dev="/dev/sdd"/>
Nov 02 01:44:34 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:44:34 user nova-compute[74996]:   <serial>6d78e413-aba3-423c-a337-cede9e863e67</serial>
Nov 02 01:44:34 user nova-compute[74996]: </disk>
Nov 02 01:44:34 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 01:44:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:44:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:44:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] No VIF found with MAC fa:16:3e:02:4b:04, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:44:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e78b4643-3a22-40bc-9d41-0e46f36da775 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.999s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:35 user nova-compute[74996]: INFO nova.compute.manager [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Rescuing
Nov 02 01:44:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Acquiring lock "refresh_cache-f0de5980-334b-4654-8b1a-88c4c861aa49" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:44:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Acquired lock "refresh_cache-f0de5980-334b-4654-8b1a-88c4c861aa49" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:44:35 user nova-compute[74996]: DEBUG nova.network.neutron [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:44:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:36 user nova-compute[74996]: DEBUG nova.network.neutron [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Updating instance_info_cache with network_info: [{"id": "a8fe6401-b45e-4c64-b975-963eeecc7516", "address": "fa:16:3e:02:4b:04", "network": {"id": "7de1ec81-4bf0-4099-a317-52e3c4b64f4e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-840004831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cafad1855f4b3b98cba6bb24f7562b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8fe6401-b4", "ovs_interfaceid": "a8fe6401-b45e-4c64-b975-963eeecc7516", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:44:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Releasing lock "refresh_cache-f0de5980-334b-4654-8b1a-88c4c861aa49" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:44:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-961e526e-4ad7-4d8c-b000-37cf6b1b04c0 req-97418755-c955-4d34-a24a-0b57537edd57 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Received event network-vif-unplugged-a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:44:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-961e526e-4ad7-4d8c-b000-37cf6b1b04c0 req-97418755-c955-4d34-a24a-0b57537edd57 service nova] Acquiring lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-961e526e-4ad7-4d8c-b000-37cf6b1b04c0 req-97418755-c955-4d34-a24a-0b57537edd57 service nova] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-961e526e-4ad7-4d8c-b000-37cf6b1b04c0 req-97418755-c955-4d34-a24a-0b57537edd57 service nova] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-961e526e-4ad7-4d8c-b000-37cf6b1b04c0 req-97418755-c955-4d34-a24a-0b57537edd57 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] No waiting events found dispatching network-vif-unplugged-a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:44:36 user nova-compute[74996]: WARNING nova.compute.manager [req-961e526e-4ad7-4d8c-b000-37cf6b1b04c0 req-97418755-c955-4d34-a24a-0b57537edd57 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Received unexpected event network-vif-unplugged-a8fe6401-b45e-4c64-b975-963eeecc7516 for instance with vm_state active and task_state rescuing.
Nov 02 01:44:37 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Instance destroyed successfully.
Nov 02 01:44:37 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Attempting a stable device rescue
Nov 02 01:44:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74996) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 02 01:44:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Instance directory exists: not creating {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 01:44:37 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Creating image(s)
Nov 02 01:44:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "/opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "/opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:37 user nova-compute[74996]: DEBUG nova.objects.instance [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lazy-loading 'trusted_certs' on Instance uuid f0de5980-334b-4654-8b1a-88c4c861aa49 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:44:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Acquiring lock "5b278b65f8330a198d52bbd1f0602d7780f0e90d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "5b278b65f8330a198d52bbd1f0602d7780f0e90d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b278b65f8330a198d52bbd1f0602d7780f0e90d.part --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b278b65f8330a198d52bbd1f0602d7780f0e90d.part --force-share --output=json" returned: 0 in 0.192s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:38 user nova-compute[74996]: DEBUG nova.virt.images [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] 656e5583-c697-46ee-9d3f-e38b1547fba4 was qcow2, converting to raw {{(pid=74996) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 01:44:38 user nova-compute[74996]: DEBUG nova.privsep.utils [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74996) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 01:44:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5b278b65f8330a198d52bbd1f0602d7780f0e90d.part /opt/stack/data/nova/instances/_base/5b278b65f8330a198d52bbd1f0602d7780f0e90d.converted {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:38 user nova-compute[74996]: DEBUG nova.compute.manager [req-620a2e3e-f7bc-42c8-bef5-cdd4dfbee839 req-5fc6064e-d660-4451-a4da-4f6fbcafb69e service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Received event network-vif-plugged-a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:44:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-620a2e3e-f7bc-42c8-bef5-cdd4dfbee839 req-5fc6064e-d660-4451-a4da-4f6fbcafb69e service nova] Acquiring lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-620a2e3e-f7bc-42c8-bef5-cdd4dfbee839 req-5fc6064e-d660-4451-a4da-4f6fbcafb69e service nova] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-620a2e3e-f7bc-42c8-bef5-cdd4dfbee839 req-5fc6064e-d660-4451-a4da-4f6fbcafb69e service nova] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:38 user nova-compute[74996]: DEBUG nova.compute.manager [req-620a2e3e-f7bc-42c8-bef5-cdd4dfbee839 req-5fc6064e-d660-4451-a4da-4f6fbcafb69e service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] No waiting events found dispatching network-vif-plugged-a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:44:38 user nova-compute[74996]: WARNING nova.compute.manager [req-620a2e3e-f7bc-42c8-bef5-cdd4dfbee839 req-5fc6064e-d660-4451-a4da-4f6fbcafb69e service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Received unexpected event network-vif-plugged-a8fe6401-b45e-4c64-b975-963eeecc7516 for instance with vm_state active and task_state rescuing.
Nov 02 01:44:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5b278b65f8330a198d52bbd1f0602d7780f0e90d.part /opt/stack/data/nova/instances/_base/5b278b65f8330a198d52bbd1f0602d7780f0e90d.converted" returned: 0 in 0.285s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b278b65f8330a198d52bbd1f0602d7780f0e90d.converted --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b278b65f8330a198d52bbd1f0602d7780f0e90d.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "5b278b65f8330a198d52bbd1f0602d7780f0e90d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.738s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Acquiring lock "5b278b65f8330a198d52bbd1f0602d7780f0e90d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "5b278b65f8330a198d52bbd1f0602d7780f0e90d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b278b65f8330a198d52bbd1f0602d7780f0e90d --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b278b65f8330a198d52bbd1f0602d7780f0e90d --force-share --output=json" returned: 0 in 0.184s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b278b65f8330a198d52bbd1f0602d7780f0e90d,backing_fmt=raw /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk.rescue {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b278b65f8330a198d52bbd1f0602d7780f0e90d,backing_fmt=raw /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk.rescue" returned: 0 in 0.048s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "5b278b65f8330a198d52bbd1f0602d7780f0e90d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.objects.instance [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lazy-loading 'migration_context' on Instance uuid f0de5980-334b-4654-8b1a-88c4c861aa49 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.objects.base [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Object Instance<f0de5980-334b-4654-8b1a-88c4c861aa49> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Start _get_guest_xml network_info=[{"id": "a8fe6401-b45e-4c64-b975-963eeecc7516", "address": "fa:16:3e:02:4b:04", "network": {"id": "7de1ec81-4bf0-4099-a317-52e3c4b64f4e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-840004831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-840004831-network", "vif_mac": "fa:16:3e:02:4b:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cafad1855f4b3b98cba6bb24f7562b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8fe6401-b4", "ovs_interfaceid": "a8fe6401-b45e-4c64-b975-963eeecc7516", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '656e5583-c697-46ee-9d3f-e38b1547fba4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9048526a-b54a-41e6-90fd-1c4505fac409', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPqMJDGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'f0de5980-334b-4654-8b1a-88c4c861aa49', 'attached_at': '', 'detached_at': '', 'volume_id': '6d78e413-aba3-423c-a337-cede9e863e67', 'serial': '6d78e413-aba3-423c-a337-cede9e863e67'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.objects.instance [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lazy-loading 'resources' on Instance uuid f0de5980-334b-4654-8b1a-88c4c861aa49 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.objects.base [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Object Instance<f0de5980-334b-4654-8b1a-88c4c861aa49> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.objects.instance [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lazy-loading 'numa_topology' on Instance uuid f0de5980-334b-4654-8b1a-88c4c861aa49 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.objects.base [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Object Instance<f0de5980-334b-4654-8b1a-88c4c861aa49> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:44:39 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:44:39 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.objects.instance [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lazy-loading 'vcpu_model' on Instance uuid f0de5980-334b-4654-8b1a-88c4c861aa49 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.objects.base [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Object Instance<f0de5980-334b-4654-8b1a-88c4c861aa49> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPqMJDGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:44:39 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:44:39 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:44:39 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:44:39 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:44:39 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:44:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa734cb-a659-4a08-8adf-2951be30ffe9]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = kPqMJDGB\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 02 01:44:39 user nova-compute[74996]: node.name = iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67
Nov 02 01:44:39 user nova-compute[74996]: node.tpgt = -1
Nov 02 01:44:39 user nova-compute[74996]: node.startup = automatic
Nov 02 01:44:39 user nova-compute[74996]: node.leading_login = No
Nov 02 01:44:39 user nova-compute[74996]: iface.iscsi_ifacename = default
Nov 02 01:44:39 user nova-compute[74996]: iface.net_ifacename = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.ipaddress = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.prefix_len = 0
Nov 02 01:44:39 user nova-compute[74996]: iface.hwaddress = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.transport_name = tcp
Nov 02 01:44:39 user nova-compute[74996]: iface.initiatorname = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.state = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.vlan_id = 0
Nov 02 01:44:39 user nova-compute[74996]: iface.vlan_priority = 0
Nov 02 01:44:39 user nova-compute[74996]: iface.vlan_state = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.iface_num = 0
Nov 02 01:44:39 user nova-compute[74996]: iface.mtu = 0
Nov 02 01:44:39 user nova-compute[74996]: iface.port = 0
Nov 02 01:44:39 user nova-compute[74996]: iface.bootproto = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.subnet_mask = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.gateway = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.dhcp_alt_client_id_state = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.dhcp_alt_client_id = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.dhcp_dns = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.dhcp_learn_iqn = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.dhcp_req_vendor_id_state = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.dhcp_vendor_id_state = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.dhcp_vendor_id = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.dhcp_slp_da = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.fragmentation = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.gratuitous_arp = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.incoming_forwarding = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.tos_state = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.tos = 0
Nov 02 01:44:39 user nova-compute[74996]: iface.ttl = 0
Nov 02 01:44:39 user nova-compute[74996]: iface.delayed_ack = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.tcp_nagle = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.tcp_wsf_state = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.tcp_wsf = 0
Nov 02 01:44:39 user nova-compute[74996]: iface.tcp_timer_scale = 0
Nov 02 01:44:39 user nova-compute[74996]: iface.tcp_timestamp = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.redirect = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.def_task_mgmt_timeout = 0
Nov 02 01:44:39 user nova-compute[74996]: iface.header_digest = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.data_digest = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.immediate_data = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.initial_r2t = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.data_seq_inorder = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.data_pdu_inorder = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.erl = 0
Nov 02 01:44:39 user nova-compute[74996]: iface.max_receive_data_len = 0
Nov 02 01:44:39 user nova-compute[74996]: iface.first_burst_len = 0
Nov 02 01:44:39 user nova-compute[74996]: iface.max_outstanding_r2t = 0
Nov 02 01:44:39 user nova-compute[74996]: iface.max_burst_len = 0
Nov 02 01:44:39 user nova-compute[74996]: iface.chap_auth = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.bidi_chap = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.strict_login_compliance = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.discovery_auth = <empty>
Nov 02 01:44:39 user nova-compute[74996]: iface.discovery_logout = <empty>
Nov 02 01:44:39 user nova-compute[74996]: node.discovery_address = <empty>
Nov 02 01:44:39 user nova-compute[74996]: node.discovery_port = 0
Nov 02 01:44:39 user nova-compute[74996]: node.discovery_type = static
Nov 02 01:44:39 user nova-compute[74996]: node.session.initial_cmdsn = 0
Nov 02 01:44:39 user nova-compute[74996]: node.session.initial_login_retry_max = 8
Nov 02 01:44:39 user nova-compute[74996]: node.session.xmit_thread_priority = -20
Nov 02 01:44:39 user nova-compute[74996]: node.session.cmds_max = 128
Nov 02 01:44:39 user nova-compute[74996]: node.session.queue_depth = 32
Nov 02 01:44:39 user nova-compute[74996]: node.session.nr_sessions = 1
Nov 02 01:44:39 user nova-compute[74996]: node.session.auth.authmethod = CHAP
Nov 02 01:44:39 user nova-compute[74996]: node.session.auth.username = kPqMJDGB
Nov 02 01:44:39 user nova-compute[74996]: node.session.auth.password = ***
Nov 02 01:44:39 user nova-compute[74996]: node.session.auth.username_in = <empty>
Nov 02 01:44:39 user nova-compute[74996]: node.session.auth.password_in = <empty>
Nov 02 01:44:39 user nova-compute[74996]: node.session.auth.chap_algs = MD5
Nov 02 01:44:39 user nova-compute[74996]: node.session.timeo.replacement_timeout = 120
Nov 02 01:44:39 user nova-compute[74996]: node.session.err_timeo.abort_timeout = 15
Nov 02 01:44:39 user nova-compute[74996]: node.session.err_timeo.lu_reset_timeout = 30
Nov 02 01:44:39 user nova-compute[74996]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 02 01:44:39 user nova-compute[74996]: node.session.err_timeo.host_reset_timeout = 60
Nov 02 01:44:39 user nova-compute[74996]: node.session.iscsi.FastAbort = Yes
Nov 02 01:44:39 user nova-compute[74996]: node.session.iscsi.InitialR2T = No
Nov 02 01:44:39 user nova-compute[74996]: node.session.iscsi.ImmediateData = Yes
Nov 02 01:44:39 user nova-compute[74996]: node.session.iscsi.FirstBurstLength = 262144
Nov 02 01:44:39 user nova-compute[74996]: node.session.iscsi.MaxBurstLength = 16776192
Nov 02 01:44:39 user nova-compute[74996]: node.session.iscsi.DefaultTime2Retain = 0
Nov 02 01:44:39 user nova-compute[74996]: node.session.iscsi.DefaultTime2Wait = 2
Nov 02 01:44:39 user nova-compute[74996]: node.session.iscsi.MaxConnections = 1
Nov 02 01:44:39 user nova-compute[74996]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 02 01:44:39 user nova-compute[74996]: node.session.iscsi.ERL = 0
Nov 02 01:44:39 user nova-compute[74996]: node.session.scan = manual
Nov 02 01:44:39 user nova-compute[74996]: node.session.reopen_max = 0
Nov 02 01:44:39 user nova-compute[74996]: node.conn[0].address = 172.16.0.220
Nov 02 01:44:39 user nova-compute[74996]: node.conn[0].port = 3260
Nov 02 01:44:39 user nova-compute[74996]: node.conn[0].startup = manual
Nov 02 01:44:39 user nova-compute[74996]: node.conn[0].tcp.window_size = 524288
Nov 02 01:44:39 user nova-compute[74996]: node.conn[0].tcp.type_of_service = 0
Nov 02 01:44:39 user nova-compute[74996]: node.conn[0].timeo.logout_timeout = 15
Nov 02 01:44:39 user nova-compute[74996]: node.conn[0].timeo.login_timeout = 15
Nov 02 01:44:39 user nova-compute[74996]: node.conn[0].timeo.auth_timeout = 45
Nov 02 01:44:39 user nova-compute[74996]: node.conn[0].timeo.noop_out_interval = 5
Nov 02 01:44:39 user nova-compute[74996]: node.conn[0].timeo.noop_out_timeout = 5
Nov 02 01:44:39 user nova-compute[74996]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 02 01:44:39 user nova-compute[74996]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 02 01:44:39 user nova-compute[74996]: node.conn[0].iscsi.HeaderDigest = None
Nov 02 01:44:39 user nova-compute[74996]: node.conn[0].iscsi.DataDigest = None
Nov 02 01:44:39 user nova-compute[74996]: node.conn[0].iscsi.IFMarker = No
Nov 02 01:44:39 user nova-compute[74996]: node.conn[0].iscsi.OFMarker = No
Nov 02 01:44:39 user nova-compute[74996]: # END RECORD
Nov 02 01:44:39 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3015970-0b4c-4a98-b63a-aa56a3bad1bf]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb11b76b-6897-4151-946b-3f69e8ab5d31]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kPqMJDGB {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kPqMJDGB" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[69946b0e-973e-4407-9826-478616fd1c04]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kPqMJDGB'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42dfef7-d7fc-4b13-bf4e-e97ee2a7658a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3627abfa-a97f-4836-81ab-eb900fdee431]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:44:39 user nova-compute[74996]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:44:39 user nova-compute[74996]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)
Nov 02 01:44:39 user nova-compute[74996]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)
Nov 02 01:44:39 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:44:39 user nova-compute[74996]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:44:39 user nova-compute[74996]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)
Nov 02 01:44:39 user nova-compute[74996]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)
Nov 02 01:44:39 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.171s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] HCTL ('35', '0', '0', 0) found on session 32 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc21be5-72e8-498f-9261-6588c27b65ab]: (4, ('0 0 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Searching for a device in session 32 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPqMJDGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.198s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] <== connect_volume: return (199ms) {'type': 'block', 'scsi_wwn': '23934653236346365', 'path': '/dev/sdd'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934653236346365', 'path': '/dev/sdd'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1625581851',display_name='tempest-ServerStableDeviceRescueTest-server-1625581851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1625581851',id=23,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEK8Sx58tlmlBIUf+BUgUFMWnLbDRHHFCCjwrW+5A7V6+CJXFa4iqA+tn8c5R1h1LqApc/K3DXH7VI97JPeKjgNFqdRaZxPpdxRt/kUhiGhAn5AGwQVIOmuoVwNFfaET8w==',key_name='tempest-keypair-2039863911',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:40:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9cafad1855f4b3b98cba6bb24f7562b',ramdisk_id='',reservation_id='r-s6tn81gr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1201179668',owner_user_name='tempest-ServerStableDeviceRescueTest-1201179668-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:42:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b023d5c4fe1e45a6a4594cdd303a352f',uuid=f0de5980-334b-4654-8b1a-88c4c861aa49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8fe6401-b45e-4c64-b975-963eeecc7516", "address": "fa:16:3e:02:4b:04", "network": {"id": "7de1ec81-4bf0-4099-a317-52e3c4b64f4e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-840004831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-840004831-network", "vif_mac": "fa:16:3e:02:4b:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cafad1855f4b3b98cba6bb24f7562b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8fe6401-b4", "ovs_interfaceid": "a8fe6401-b45e-4c64-b975-963eeecc7516", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Converting VIF {"id": "a8fe6401-b45e-4c64-b975-963eeecc7516", "address": "fa:16:3e:02:4b:04", "network": {"id": "7de1ec81-4bf0-4099-a317-52e3c4b64f4e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-840004831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-840004831-network", "vif_mac": "fa:16:3e:02:4b:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cafad1855f4b3b98cba6bb24f7562b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8fe6401-b4", "ovs_interfaceid": "a8fe6401-b45e-4c64-b975-963eeecc7516", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:4b:04,bridge_name='br-int',has_traffic_filtering=True,id=a8fe6401-b45e-4c64-b975-963eeecc7516,network=Network(7de1ec81-4bf0-4099-a317-52e3c4b64f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8fe6401-b4') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.objects.instance [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lazy-loading 'pci_devices' on Instance uuid f0de5980-334b-4654-8b1a-88c4c861aa49 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.objects.base [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Object Instance<f0de5980-334b-4654-8b1a-88c4c861aa49> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:44:39 user nova-compute[74996]:   <uuid>f0de5980-334b-4654-8b1a-88c4c861aa49</uuid>
Nov 02 01:44:39 user nova-compute[74996]:   <name>instance-00000017</name>
Nov 02 01:44:39 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:44:39 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:44:39 user nova-compute[74996]:   <metadata>
Nov 02 01:44:39 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:44:39 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:44:39 user nova-compute[74996]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1625581851</nova:name>
Nov 02 01:44:39 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:44:39</nova:creationTime>
Nov 02 01:44:39 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:44:39 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:44:39 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:44:39 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:44:39 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:44:39 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:44:39 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:44:39 user nova-compute[74996]:       <nova:owner>
Nov 02 01:44:39 user nova-compute[74996]:         <nova:user uuid="b023d5c4fe1e45a6a4594cdd303a352f">tempest-ServerStableDeviceRescueTest-1201179668-project-member</nova:user>
Nov 02 01:44:39 user nova-compute[74996]:         <nova:project uuid="d9cafad1855f4b3b98cba6bb24f7562b">tempest-ServerStableDeviceRescueTest-1201179668</nova:project>
Nov 02 01:44:39 user nova-compute[74996]:       </nova:owner>
Nov 02 01:44:39 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:44:39 user nova-compute[74996]:       <nova:ports>
Nov 02 01:44:39 user nova-compute[74996]:         <nova:port uuid="a8fe6401-b45e-4c64-b975-963eeecc7516">
Nov 02 01:44:39 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 02 01:44:39 user nova-compute[74996]:         </nova:port>
Nov 02 01:44:39 user nova-compute[74996]:       </nova:ports>
Nov 02 01:44:39 user nova-compute[74996]:     </nova:instance>
Nov 02 01:44:39 user nova-compute[74996]:   </metadata>
Nov 02 01:44:39 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:44:39 user nova-compute[74996]:     <system>
Nov 02 01:44:39 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:44:39 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:44:39 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:44:39 user nova-compute[74996]:       <entry name="serial">f0de5980-334b-4654-8b1a-88c4c861aa49</entry>
Nov 02 01:44:39 user nova-compute[74996]:       <entry name="uuid">f0de5980-334b-4654-8b1a-88c4c861aa49</entry>
Nov 02 01:44:39 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:44:39 user nova-compute[74996]:     </system>
Nov 02 01:44:39 user nova-compute[74996]:   </sysinfo>
Nov 02 01:44:39 user nova-compute[74996]:   <os>
Nov 02 01:44:39 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:44:39 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:44:39 user nova-compute[74996]:   </os>
Nov 02 01:44:39 user nova-compute[74996]:   <features>
Nov 02 01:44:39 user nova-compute[74996]:     <acpi/>
Nov 02 01:44:39 user nova-compute[74996]:     <apic/>
Nov 02 01:44:39 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:44:39 user nova-compute[74996]:   </features>
Nov 02 01:44:39 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:44:39 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:44:39 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:44:39 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:44:39 user nova-compute[74996]:   </clock>
Nov 02 01:44:39 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:44:39 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:44:39 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:44:39 user nova-compute[74996]:   </cpu>
Nov 02 01:44:39 user nova-compute[74996]:   <devices>
Nov 02 01:44:39 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:44:39 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:44:39 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk"/>
Nov 02 01:44:39 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:44:39 user nova-compute[74996]:     </disk>
Nov 02 01:44:39 user nova-compute[74996]:     <disk type="block" device="disk">
Nov 02 01:44:39 user nova-compute[74996]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:44:39 user nova-compute[74996]:       <source dev="/dev/sdd"/>
Nov 02 01:44:39 user nova-compute[74996]:       <target dev="vdb" bus="virtio"/>
Nov 02 01:44:39 user nova-compute[74996]:       <serial>6d78e413-aba3-423c-a337-cede9e863e67</serial>
Nov 02 01:44:39 user nova-compute[74996]:     </disk>
Nov 02 01:44:39 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:44:39 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:44:39 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk.rescue"/>
Nov 02 01:44:39 user nova-compute[74996]:       <target dev="vdc" bus="virtio"/>
Nov 02 01:44:39 user nova-compute[74996]:       <boot order="1"/>
Nov 02 01:44:39 user nova-compute[74996]:     </disk>
Nov 02 01:44:39 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:44:39 user nova-compute[74996]:       <mac address="fa:16:3e:02:4b:04"/>
Nov 02 01:44:39 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:44:39 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:44:39 user nova-compute[74996]:       <target dev="tapa8fe6401-b4"/>
Nov 02 01:44:39 user nova-compute[74996]:     </interface>
Nov 02 01:44:39 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:44:39 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/console.log" append="off"/>
Nov 02 01:44:39 user nova-compute[74996]:     </serial>
Nov 02 01:44:39 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:44:39 user nova-compute[74996]:     <video>
Nov 02 01:44:39 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:44:39 user nova-compute[74996]:     </video>
Nov 02 01:44:39 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:44:39 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:44:39 user nova-compute[74996]:     </rng>
Nov 02 01:44:39 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:44:39 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:44:39 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:44:39 user nova-compute[74996]:     </memballoon>
Nov 02 01:44:39 user nova-compute[74996]:   </devices>
Nov 02 01:44:39 user nova-compute[74996]: </domain>
Nov 02 01:44:39 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:44:39 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Instance destroyed successfully.
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:44:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] No VIF found with MAC fa:16:3e:02:4b:04, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:44:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:41 user nova-compute[74996]: DEBUG nova.compute.manager [req-a8dbaa00-e8af-49d3-a0bd-c6cc6d19dba5 req-ba76ebf2-5546-49c6-96fa-dcad4aac0dbf service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Received event network-vif-plugged-a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:44:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a8dbaa00-e8af-49d3-a0bd-c6cc6d19dba5 req-ba76ebf2-5546-49c6-96fa-dcad4aac0dbf service nova] Acquiring lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a8dbaa00-e8af-49d3-a0bd-c6cc6d19dba5 req-ba76ebf2-5546-49c6-96fa-dcad4aac0dbf service nova] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a8dbaa00-e8af-49d3-a0bd-c6cc6d19dba5 req-ba76ebf2-5546-49c6-96fa-dcad4aac0dbf service nova] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:41 user nova-compute[74996]: DEBUG nova.compute.manager [req-a8dbaa00-e8af-49d3-a0bd-c6cc6d19dba5 req-ba76ebf2-5546-49c6-96fa-dcad4aac0dbf service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] No waiting events found dispatching network-vif-plugged-a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:44:41 user nova-compute[74996]: WARNING nova.compute.manager [req-a8dbaa00-e8af-49d3-a0bd-c6cc6d19dba5 req-ba76ebf2-5546-49c6-96fa-dcad4aac0dbf service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Received unexpected event network-vif-plugged-a8fe6401-b45e-4c64-b975-963eeecc7516 for instance with vm_state active and task_state rescuing.
Nov 02 01:44:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-c77e3bb7-d1e7-4331-a791-ab820dc9e49d req-e3cde5b2-29b3-4c77-be35-023867af8d9d service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Received event network-vif-plugged-a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:44:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c77e3bb7-d1e7-4331-a791-ab820dc9e49d req-e3cde5b2-29b3-4c77-be35-023867af8d9d service nova] Acquiring lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c77e3bb7-d1e7-4331-a791-ab820dc9e49d req-e3cde5b2-29b3-4c77-be35-023867af8d9d service nova] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c77e3bb7-d1e7-4331-a791-ab820dc9e49d req-e3cde5b2-29b3-4c77-be35-023867af8d9d service nova] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-c77e3bb7-d1e7-4331-a791-ab820dc9e49d req-e3cde5b2-29b3-4c77-be35-023867af8d9d service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] No waiting events found dispatching network-vif-plugged-a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:44:43 user nova-compute[74996]: WARNING nova.compute.manager [req-c77e3bb7-d1e7-4331-a791-ab820dc9e49d req-e3cde5b2-29b3-4c77-be35-023867af8d9d service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Received unexpected event network-vif-plugged-a8fe6401-b45e-4c64-b975-963eeecc7516 for instance with vm_state active and task_state rescuing.
Nov 02 01:44:43 user nova-compute[74996]: DEBUG nova.compute.manager [None req-3f5fb7c1-03d5-41ae-b4f3-e00381cf51a2 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:44:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:47 user nova-compute[74996]: DEBUG nova.objects.instance [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lazy-loading 'flavor' on Instance uuid 5d834837-a1a1-436d-9015-b9b3bf048170 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:44:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a9dfaa9e-50b2-44cc-a26d-f7fcc8bc150f tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "5d834837-a1a1-436d-9015-b9b3bf048170" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 44.825s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:48 user nova-compute[74996]: DEBUG nova.compute.manager [req-01a0abd7-93c7-46d7-964c-27cacdf61ecc req-f1dd01ff-0f95-45a2-bd71-eeacf28e18f4 service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Received event volume-reimaged-5f7cff97-bd0e-4b25-a3da-398d425d9ed4 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:44:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-01a0abd7-93c7-46d7-964c-27cacdf61ecc req-f1dd01ff-0f95-45a2-bd71-eeacf28e18f4 service nova] Acquiring lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-01a0abd7-93c7-46d7-964c-27cacdf61ecc req-f1dd01ff-0f95-45a2-bd71-eeacf28e18f4 service nova] Lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-01a0abd7-93c7-46d7-964c-27cacdf61ecc req-f1dd01ff-0f95-45a2-bd71-eeacf28e18f4 service nova] Lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:48 user nova-compute[74996]: DEBUG nova.compute.manager [req-01a0abd7-93c7-46d7-964c-27cacdf61ecc req-f1dd01ff-0f95-45a2-bd71-eeacf28e18f4 service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Processing event volume-reimaged-5f7cff97-bd0e-4b25-a3da-398d425d9ed4 {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Nov 02 01:44:48 user nova-compute[74996]: DEBUG nova.compute.manager [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Instance event wait completed in 58 seconds for volume-reimaged {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:44:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:48 user nova-compute[74996]: INFO nova.virt.block_device [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Booting with volume 5f7cff97-bd0e-4b25-a3da-398d425d9ed4 at /dev/vda
Nov 02 01:44:48 user nova-compute[74996]: DEBUG os_brick.utils [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:44:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:48 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db0e1f4-32a6-4c85-a7b1-b27af3a332c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:48 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[979b4995-a9fa-423e-95a1-f66ca2616ff9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.volume.cinder [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Update attachment failed for attachment e49233ab-d14a-47d2-8791-0ac584a11006. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f2b5b0e6-1566-4301-9035-b8951337b6a7) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f2b5b0e6-1566-4301-9035-b8951337b6a7)
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Setting instance vm_state to ERROR: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f2b5b0e6-1566-4301-9035-b8951337b6a7)
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Traceback (most recent call last):
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]   File "/opt/stack/nova/nova/compute/manager.py", line 10845, in _error_out_instance_on_exception
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]     yield
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]   File "/opt/stack/nova/nova/compute/manager.py", line 6377, in _finish_resize_helper
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]     network_info = self._finish_resize(context, instance, migration,
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]   File "/opt/stack/nova/nova/compute/manager.py", line 6281, in _finish_resize
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]     self._update_volume_attachments(context, instance, bdms)
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]   File "/opt/stack/nova/nova/compute/manager.py", line 6211, in _update_volume_attachments
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]     self.volume_api.attachment_update(
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]     res = method(self, ctx, *args, **kwargs)
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]     with excutils.save_and_reraise_exception():
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]     self.force_reraise()
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]     raise self.value
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]     context, '3.44', skip_version_check=True).attachments.update(
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]     return method.func(obj, *args, **kwargs)
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]     resp = self._update('/attachments/%s' % id, body)
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]     return self._cs_request(url, 'PUT', **kwargs)
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]     return self.request(url, method, **kwargs)
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b]     raise exceptions.from_response(resp, body)
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f2b5b0e6-1566-4301-9035-b8951337b6a7)
Nov 02 01:44:48 user nova-compute[74996]: ERROR nova.compute.manager [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] 
Nov 02 01:44:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:44:48 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3306d553-5c88-44ac-b4d4-4e1a97fdea41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:48 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc8e9c2-3144-4b4d-891e-44f4de88fb9c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:44:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:44:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:44:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:44:48 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:44:48 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5407fc49-a0d2-4848-9544-b37d34f156b0]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:44:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:44:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:44:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:44:48 user nova-compute[74996]: DEBUG os_brick.utils [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:44:48 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Updating existing volume attachment record: 602d2319-483c-49f7-a62d-5b931d79f80f {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:44:48 user nova-compute[74996]: INFO nova.compute.manager [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Deleting allocations for old flavor on source node user after finish_resize failure. You may be able to recover the instance by hard rebooting it.
Nov 02 01:44:48 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Deleted allocation for migration 404789e4-99ac-4290-8d63-1f7e34c99e57
Nov 02 01:44:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:49 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:44:49 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:44:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:49 user nova-compute[74996]: INFO nova.compute.manager [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Successfully reverted task state from resize_finish on failure for instance.
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server [None req-b1a870b2-0dc3-4fea-b432-1caf453ea58f tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f2b5b0e6-1566-4301-9035-b8951337b6a7)
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 145, in decorated_function
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6347, in finish_resize
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6344, in finish_resize
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     self._finish_resize_helper(context, disk_info, image, instance,
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6377, in _finish_resize_helper
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     network_info = self._finish_resize(context, instance, migration,
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6281, in _finish_resize
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     self._update_volume_attachments(context, instance, bdms)
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6211, in _update_volume_attachments
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     self.volume_api.attachment_update(
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-f2b5b0e6-1566-4301-9035-b8951337b6a7)
Nov 02 01:44:49 user nova-compute[74996]: ERROR oslo_messaging.rpc.server 
Nov 02 01:44:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-aa4bab95-d70e-4161-8e20-1998f2b88a81 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "5d834837-a1a1-436d-9015-b9b3bf048170" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-aa4bab95-d70e-4161-8e20-1998f2b88a81 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "5d834837-a1a1-436d-9015-b9b3bf048170" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-aa4bab95-d70e-4161-8e20-1998f2b88a81 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "5d834837-a1a1-436d-9015-b9b3bf048170-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-aa4bab95-d70e-4161-8e20-1998f2b88a81 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "5d834837-a1a1-436d-9015-b9b3bf048170-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-aa4bab95-d70e-4161-8e20-1998f2b88a81 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "5d834837-a1a1-436d-9015-b9b3bf048170-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:53 user nova-compute[74996]: INFO nova.compute.manager [None req-aa4bab95-d70e-4161-8e20-1998f2b88a81 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Terminating instance
Nov 02 01:44:53 user nova-compute[74996]: DEBUG nova.compute.manager [None req-aa4bab95-d70e-4161-8e20-1998f2b88a81 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:44:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:53 user nova-compute[74996]: DEBUG nova.compute.manager [req-0ff07374-4b09-4e2d-b01e-e350812a643c req-540e6cc4-bfcb-4020-8eca-ee24c2ce448f service nova] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Received event network-vif-unplugged-eda8feac-2d2d-4be0-aa50-ef4d7b2448d8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:44:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0ff07374-4b09-4e2d-b01e-e350812a643c req-540e6cc4-bfcb-4020-8eca-ee24c2ce448f service nova] Acquiring lock "5d834837-a1a1-436d-9015-b9b3bf048170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0ff07374-4b09-4e2d-b01e-e350812a643c req-540e6cc4-bfcb-4020-8eca-ee24c2ce448f service nova] Lock "5d834837-a1a1-436d-9015-b9b3bf048170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0ff07374-4b09-4e2d-b01e-e350812a643c req-540e6cc4-bfcb-4020-8eca-ee24c2ce448f service nova] Lock "5d834837-a1a1-436d-9015-b9b3bf048170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:53 user nova-compute[74996]: DEBUG nova.compute.manager [req-0ff07374-4b09-4e2d-b01e-e350812a643c req-540e6cc4-bfcb-4020-8eca-ee24c2ce448f service nova] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] No waiting events found dispatching network-vif-unplugged-eda8feac-2d2d-4be0-aa50-ef4d7b2448d8 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:44:53 user nova-compute[74996]: DEBUG nova.compute.manager [req-0ff07374-4b09-4e2d-b01e-e350812a643c req-540e6cc4-bfcb-4020-8eca-ee24c2ce448f service nova] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Received event network-vif-unplugged-eda8feac-2d2d-4be0-aa50-ef4d7b2448d8 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:44:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:54 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Instance destroyed successfully.
Nov 02 01:44:54 user nova-compute[74996]: DEBUG nova.objects.instance [None req-aa4bab95-d70e-4161-8e20-1998f2b88a81 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lazy-loading 'resources' on Instance uuid 5d834837-a1a1-436d-9015-b9b3bf048170 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:44:54 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-aa4bab95-d70e-4161-8e20-1998f2b88a81 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-30452314',display_name='tempest-AttachVolumeNegativeTest-server-30452314',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-30452314',id=24,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZU4CH7h09l1iR9y8X6W4zTHKYzeHDr/5xbTsfXnh8w5xjlewCnrFHMP/PopFBThF0MDUClNR3QeifUvv38QC3XAFT9BZToQ/joxGyeFUDqX/CGtd5OawKJl0b+UThU/Q==',key_name='tempest-keypair-126278438',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:41:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b6b2c4a38374459b73fa76b8dde9db4',ramdisk_id='',reservation_id='r-mty1zcz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1395123327',owner_user_name='tempest-AttachVolumeNegativeTest-1395123327-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:41:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='700d6c84a40547e99f3e364d6447ad4e',uuid=5d834837-a1a1-436d-9015-b9b3bf048170,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eda8feac-2d2d-4be0-aa50-ef4d7b2448d8", "address": "fa:16:3e:8e:ff:6b", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeda8feac-2d", "ovs_interfaceid": "eda8feac-2d2d-4be0-aa50-ef4d7b2448d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:44:54 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-aa4bab95-d70e-4161-8e20-1998f2b88a81 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Converting VIF {"id": "eda8feac-2d2d-4be0-aa50-ef4d7b2448d8", "address": "fa:16:3e:8e:ff:6b", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeda8feac-2d", "ovs_interfaceid": "eda8feac-2d2d-4be0-aa50-ef4d7b2448d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:44:54 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-aa4bab95-d70e-4161-8e20-1998f2b88a81 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:ff:6b,bridge_name='br-int',has_traffic_filtering=True,id=eda8feac-2d2d-4be0-aa50-ef4d7b2448d8,network=Network(d18bfd38-1454-4665-a175-2c7d0e2002ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeda8feac-2d') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:44:54 user nova-compute[74996]: DEBUG os_vif [None req-aa4bab95-d70e-4161-8e20-1998f2b88a81 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:ff:6b,bridge_name='br-int',has_traffic_filtering=True,id=eda8feac-2d2d-4be0-aa50-ef4d7b2448d8,network=Network(d18bfd38-1454-4665-a175-2c7d0e2002ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeda8feac-2d') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:44:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeda8feac-2d, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:44:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:44:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1bbf901-c99a-4cc9-bfa9-c2fbe5f213e7) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:44:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:54 user nova-compute[74996]: INFO os_vif [None req-aa4bab95-d70e-4161-8e20-1998f2b88a81 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:ff:6b,bridge_name='br-int',has_traffic_filtering=True,id=eda8feac-2d2d-4be0-aa50-ef4d7b2448d8,network=Network(d18bfd38-1454-4665-a175-2c7d0e2002ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeda8feac-2d')
Nov 02 01:44:54 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-aa4bab95-d70e-4161-8e20-1998f2b88a81 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Deleting instance files /opt/stack/data/nova/instances/5d834837-a1a1-436d-9015-b9b3bf048170_del
Nov 02 01:44:54 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-aa4bab95-d70e-4161-8e20-1998f2b88a81 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Deletion of /opt/stack/data/nova/instances/5d834837-a1a1-436d-9015-b9b3bf048170_del complete
Nov 02 01:44:54 user nova-compute[74996]: INFO nova.compute.manager [None req-aa4bab95-d70e-4161-8e20-1998f2b88a81 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 02 01:44:54 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-aa4bab95-d70e-4161-8e20-1998f2b88a81 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:44:54 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:44:54 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:44:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:55 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:55 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:44:55 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:44:55 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Took 0.86 seconds to deallocate network for instance.
Nov 02 01:44:55 user nova-compute[74996]: DEBUG nova.compute.manager [req-d7faac84-efd5-49ed-8760-65f7a0c7d338 req-07b8d5fe-a764-44a6-8a8d-ffde9c9f7068 service nova] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Received event network-vif-deleted-eda8feac-2d2d-4be0-aa50-ef4d7b2448d8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:44:55 user nova-compute[74996]: INFO nova.compute.manager [req-d7faac84-efd5-49ed-8760-65f7a0c7d338 req-07b8d5fe-a764-44a6-8a8d-ffde9c9f7068 service nova] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Neutron deleted interface eda8feac-2d2d-4be0-aa50-ef4d7b2448d8; detaching it from the instance and deleting it from the info cache
Nov 02 01:44:55 user nova-compute[74996]: DEBUG nova.network.neutron [req-d7faac84-efd5-49ed-8760-65f7a0c7d338 req-07b8d5fe-a764-44a6-8a8d-ffde9c9f7068 service nova] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:44:55 user nova-compute[74996]: DEBUG nova.compute.manager [req-d7faac84-efd5-49ed-8760-65f7a0c7d338 req-07b8d5fe-a764-44a6-8a8d-ffde9c9f7068 service nova] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Detach interface failed, port_id=eda8feac-2d2d-4be0-aa50-ef4d7b2448d8, reason: Instance 5d834837-a1a1-436d-9015-b9b3bf048170 could not be found. {{(pid=74996) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 01:44:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-aa4bab95-d70e-4161-8e20-1998f2b88a81 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-aa4bab95-d70e-4161-8e20-1998f2b88a81 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:55 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-aa4bab95-d70e-4161-8e20-1998f2b88a81 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:44:55 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-aa4bab95-d70e-4161-8e20-1998f2b88a81 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:44:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-aa4bab95-d70e-4161-8e20-1998f2b88a81 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:55 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-aa4bab95-d70e-4161-8e20-1998f2b88a81 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Deleted allocations for instance 5d834837-a1a1-436d-9015-b9b3bf048170
Nov 02 01:44:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-aa4bab95-d70e-4161-8e20-1998f2b88a81 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "5d834837-a1a1-436d-9015-b9b3bf048170" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.398s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:55 user nova-compute[74996]: DEBUG nova.compute.manager [req-b730f5bf-06d6-4964-afd3-f581cf56f291 req-191bf326-3288-493f-ac87-60b0610c2e42 service nova] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Received event network-vif-plugged-eda8feac-2d2d-4be0-aa50-ef4d7b2448d8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:44:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b730f5bf-06d6-4964-afd3-f581cf56f291 req-191bf326-3288-493f-ac87-60b0610c2e42 service nova] Acquiring lock "5d834837-a1a1-436d-9015-b9b3bf048170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:44:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b730f5bf-06d6-4964-afd3-f581cf56f291 req-191bf326-3288-493f-ac87-60b0610c2e42 service nova] Lock "5d834837-a1a1-436d-9015-b9b3bf048170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:44:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b730f5bf-06d6-4964-afd3-f581cf56f291 req-191bf326-3288-493f-ac87-60b0610c2e42 service nova] Lock "5d834837-a1a1-436d-9015-b9b3bf048170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:44:55 user nova-compute[74996]: DEBUG nova.compute.manager [req-b730f5bf-06d6-4964-afd3-f581cf56f291 req-191bf326-3288-493f-ac87-60b0610c2e42 service nova] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] No waiting events found dispatching network-vif-plugged-eda8feac-2d2d-4be0-aa50-ef4d7b2448d8 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:44:55 user nova-compute[74996]: WARNING nova.compute.manager [req-b730f5bf-06d6-4964-afd3-f581cf56f291 req-191bf326-3288-493f-ac87-60b0610c2e42 service nova] [instance: 5d834837-a1a1-436d-9015-b9b3bf048170] Received unexpected event network-vif-plugged-eda8feac-2d2d-4be0-aa50-ef4d7b2448d8 for instance with vm_state deleted and task_state None.
Nov 02 01:44:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-2fa72c62-436c-4a57-a55b-7b9bdb060c00 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "d8f51f7d-c9de-4914-883e-7a875d3d73ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-2fa72c62-436c-4a57-a55b-7b9bdb060c00 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "d8f51f7d-c9de-4914-883e-7a875d3d73ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-2fa72c62-436c-4a57-a55b-7b9bdb060c00 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "d8f51f7d-c9de-4914-883e-7a875d3d73ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-2fa72c62-436c-4a57-a55b-7b9bdb060c00 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "d8f51f7d-c9de-4914-883e-7a875d3d73ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-2fa72c62-436c-4a57-a55b-7b9bdb060c00 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "d8f51f7d-c9de-4914-883e-7a875d3d73ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:04 user nova-compute[74996]: INFO nova.compute.manager [None req-2fa72c62-436c-4a57-a55b-7b9bdb060c00 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Terminating instance
Nov 02 01:45:04 user nova-compute[74996]: DEBUG nova.compute.manager [None req-2fa72c62-436c-4a57-a55b-7b9bdb060c00 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:45:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:04 user nova-compute[74996]: DEBUG nova.compute.manager [req-ceb7a84b-f930-494f-922b-6c076d60eeea req-ed0e453d-57e4-4307-a962-76d1b60788ff service nova] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Received event network-vif-unplugged-d0ea7655-29c6-450a-b2df-f2554925c3a5 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:45:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ceb7a84b-f930-494f-922b-6c076d60eeea req-ed0e453d-57e4-4307-a962-76d1b60788ff service nova] Acquiring lock "d8f51f7d-c9de-4914-883e-7a875d3d73ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ceb7a84b-f930-494f-922b-6c076d60eeea req-ed0e453d-57e4-4307-a962-76d1b60788ff service nova] Lock "d8f51f7d-c9de-4914-883e-7a875d3d73ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ceb7a84b-f930-494f-922b-6c076d60eeea req-ed0e453d-57e4-4307-a962-76d1b60788ff service nova] Lock "d8f51f7d-c9de-4914-883e-7a875d3d73ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:04 user nova-compute[74996]: DEBUG nova.compute.manager [req-ceb7a84b-f930-494f-922b-6c076d60eeea req-ed0e453d-57e4-4307-a962-76d1b60788ff service nova] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] No waiting events found dispatching network-vif-unplugged-d0ea7655-29c6-450a-b2df-f2554925c3a5 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:45:04 user nova-compute[74996]: DEBUG nova.compute.manager [req-ceb7a84b-f930-494f-922b-6c076d60eeea req-ed0e453d-57e4-4307-a962-76d1b60788ff service nova] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Received event network-vif-unplugged-d0ea7655-29c6-450a-b2df-f2554925c3a5 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:45:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:05 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Instance destroyed successfully.
Nov 02 01:45:05 user nova-compute[74996]: DEBUG nova.objects.instance [None req-2fa72c62-436c-4a57-a55b-7b9bdb060c00 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lazy-loading 'resources' on Instance uuid d8f51f7d-c9de-4914-883e-7a875d3d73ad {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:45:05 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-2fa72c62-436c-4a57-a55b-7b9bdb060c00 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:34:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-748637036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-748637036',id=15,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:34:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='142161c2fae44bdea848619580195795',ramdisk_id='',reservation_id='r-p2zeajdk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1294190560',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:36:46Z,user_data=None,user_id='15affb427e9b4fb8873accf286510e14',uuid=d8f51f7d-c9de-4914-883e-7a875d3d73ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0ea7655-29c6-450a-b2df-f2554925c3a5", "address": "fa:16:3e:0d:f1:d9", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7655-29", "ovs_interfaceid": "d0ea7655-29c6-450a-b2df-f2554925c3a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:45:05 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-2fa72c62-436c-4a57-a55b-7b9bdb060c00 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Converting VIF {"id": "d0ea7655-29c6-450a-b2df-f2554925c3a5", "address": "fa:16:3e:0d:f1:d9", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ea7655-29", "ovs_interfaceid": "d0ea7655-29c6-450a-b2df-f2554925c3a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:45:05 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-2fa72c62-436c-4a57-a55b-7b9bdb060c00 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:f1:d9,bridge_name='br-int',has_traffic_filtering=True,id=d0ea7655-29c6-450a-b2df-f2554925c3a5,network=Network(b5218514-0348-4dcc-8ecf-4595a87e204a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ea7655-29') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:45:05 user nova-compute[74996]: DEBUG os_vif [None req-2fa72c62-436c-4a57-a55b-7b9bdb060c00 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:f1:d9,bridge_name='br-int',has_traffic_filtering=True,id=d0ea7655-29c6-450a-b2df-f2554925c3a5,network=Network(b5218514-0348-4dcc-8ecf-4595a87e204a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ea7655-29') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:45:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0ea7655-29, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:45:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:45:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ea5e245-8d21-413f-8bb4-e542c5c94b9d) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:45:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:45:05 user nova-compute[74996]: INFO os_vif [None req-2fa72c62-436c-4a57-a55b-7b9bdb060c00 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:f1:d9,bridge_name='br-int',has_traffic_filtering=True,id=d0ea7655-29c6-450a-b2df-f2554925c3a5,network=Network(b5218514-0348-4dcc-8ecf-4595a87e204a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ea7655-29')
Nov 02 01:45:05 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-2fa72c62-436c-4a57-a55b-7b9bdb060c00 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Deleting instance files /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad_del
Nov 02 01:45:05 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-2fa72c62-436c-4a57-a55b-7b9bdb060c00 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Deletion of /opt/stack/data/nova/instances/d8f51f7d-c9de-4914-883e-7a875d3d73ad_del complete
Nov 02 01:45:05 user nova-compute[74996]: INFO nova.compute.manager [None req-2fa72c62-436c-4a57-a55b-7b9bdb060c00 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 02 01:45:05 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-2fa72c62-436c-4a57-a55b-7b9bdb060c00 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:45:05 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:45:05 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:45:05 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:45:05 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Took 0.69 seconds to deallocate network for instance.
Nov 02 01:45:05 user nova-compute[74996]: DEBUG nova.compute.manager [req-d01369a1-1096-4543-b997-e362c554d069 req-019d5503-f1d3-4f1b-ade5-d966c4bd23d6 service nova] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Received event network-vif-deleted-d0ea7655-29c6-450a-b2df-f2554925c3a5 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:45:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-2fa72c62-436c-4a57-a55b-7b9bdb060c00 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-2fa72c62-436c-4a57-a55b-7b9bdb060c00 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:06 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-2fa72c62-436c-4a57-a55b-7b9bdb060c00 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:45:06 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-2fa72c62-436c-4a57-a55b-7b9bdb060c00 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:45:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-2fa72c62-436c-4a57-a55b-7b9bdb060c00 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.293s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:06 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-2fa72c62-436c-4a57-a55b-7b9bdb060c00 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Deleted allocations for instance d8f51f7d-c9de-4914-883e-7a875d3d73ad
Nov 02 01:45:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-2fa72c62-436c-4a57-a55b-7b9bdb060c00 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "d8f51f7d-c9de-4914-883e-7a875d3d73ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.011s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:06 user nova-compute[74996]: DEBUG nova.compute.manager [req-f6e17ca4-ca35-41d8-abc5-0b1946adc7a5 req-233d5d40-449f-4cc4-a40b-0f6320b352bf service nova] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Received event network-vif-plugged-d0ea7655-29c6-450a-b2df-f2554925c3a5 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:45:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f6e17ca4-ca35-41d8-abc5-0b1946adc7a5 req-233d5d40-449f-4cc4-a40b-0f6320b352bf service nova] Acquiring lock "d8f51f7d-c9de-4914-883e-7a875d3d73ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f6e17ca4-ca35-41d8-abc5-0b1946adc7a5 req-233d5d40-449f-4cc4-a40b-0f6320b352bf service nova] Lock "d8f51f7d-c9de-4914-883e-7a875d3d73ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f6e17ca4-ca35-41d8-abc5-0b1946adc7a5 req-233d5d40-449f-4cc4-a40b-0f6320b352bf service nova] Lock "d8f51f7d-c9de-4914-883e-7a875d3d73ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:06 user nova-compute[74996]: DEBUG nova.compute.manager [req-f6e17ca4-ca35-41d8-abc5-0b1946adc7a5 req-233d5d40-449f-4cc4-a40b-0f6320b352bf service nova] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] No waiting events found dispatching network-vif-plugged-d0ea7655-29c6-450a-b2df-f2554925c3a5 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:45:06 user nova-compute[74996]: WARNING nova.compute.manager [req-f6e17ca4-ca35-41d8-abc5-0b1946adc7a5 req-233d5d40-449f-4cc4-a40b-0f6320b352bf service nova] [instance: d8f51f7d-c9de-4914-883e-7a875d3d73ad] Received unexpected event network-vif-plugged-d0ea7655-29c6-450a-b2df-f2554925c3a5 for instance with vm_state deleted and task_state None.
Nov 02 01:45:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:09 user nova-compute[74996]: DEBUG nova.compute.manager [req-2f032772-c856-4085-a00e-3b7434698077 req-f49a7fc1-24d6-4fae-886f-082e66e4515e service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Received event network-changed-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:45:09 user nova-compute[74996]: DEBUG nova.compute.manager [req-2f032772-c856-4085-a00e-3b7434698077 req-f49a7fc1-24d6-4fae-886f-082e66e4515e service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Refreshing instance network info cache due to event network-changed-8cf50e3d-3da4-48fc-9cc9-bfe88441b531. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:45:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2f032772-c856-4085-a00e-3b7434698077 req-f49a7fc1-24d6-4fae-886f-082e66e4515e service nova] Acquiring lock "refresh_cache-effec7f0-1006-4081-91f4-e2d96fd0a87a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:45:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2f032772-c856-4085-a00e-3b7434698077 req-f49a7fc1-24d6-4fae-886f-082e66e4515e service nova] Acquired lock "refresh_cache-effec7f0-1006-4081-91f4-e2d96fd0a87a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:45:09 user nova-compute[74996]: DEBUG nova.network.neutron [req-2f032772-c856-4085-a00e-3b7434698077 req-f49a7fc1-24d6-4fae-886f-082e66e4515e service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Refreshing network info cache for port 8cf50e3d-3da4-48fc-9cc9-bfe88441b531 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:45:09 user nova-compute[74996]: DEBUG nova.network.neutron [req-2f032772-c856-4085-a00e-3b7434698077 req-f49a7fc1-24d6-4fae-886f-082e66e4515e service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Updated VIF entry in instance network info cache for port 8cf50e3d-3da4-48fc-9cc9-bfe88441b531. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:45:09 user nova-compute[74996]: DEBUG nova.network.neutron [req-2f032772-c856-4085-a00e-3b7434698077 req-f49a7fc1-24d6-4fae-886f-082e66e4515e service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Updating instance_info_cache with network_info: [{"id": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "address": "fa:16:3e:56:0b:6b", "network": {"id": "b3014958-040c-44b4-94cc-1099e8fe3750", "bridge": "br-int", "label": "tempest-TestShelveInstance-1407890304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca87a25a8b244b7989ea459300036d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf50e3d-3d", "ovs_interfaceid": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:45:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2f032772-c856-4085-a00e-3b7434698077 req-f49a7fc1-24d6-4fae-886f-082e66e4515e service nova] Releasing lock "refresh_cache-effec7f0-1006-4081-91f4-e2d96fd0a87a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:45:10 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Acquiring lock "effec7f0-1006-4081-91f4-e2d96fd0a87a" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "effec7f0-1006-4081-91f4-e2d96fd0a87a" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:11 user nova-compute[74996]: INFO nova.compute.manager [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Shelve offloading
Nov 02 01:45:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:11 user nova-compute[74996]: DEBUG nova.compute.manager [req-444afa86-bf87-47f7-8390-2c615d15b000 req-4f432cc1-1950-4520-bfb9-5ef038e0b766 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Received event network-vif-unplugged-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:45:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-444afa86-bf87-47f7-8390-2c615d15b000 req-4f432cc1-1950-4520-bfb9-5ef038e0b766 service nova] Acquiring lock "effec7f0-1006-4081-91f4-e2d96fd0a87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-444afa86-bf87-47f7-8390-2c615d15b000 req-4f432cc1-1950-4520-bfb9-5ef038e0b766 service nova] Lock "effec7f0-1006-4081-91f4-e2d96fd0a87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-444afa86-bf87-47f7-8390-2c615d15b000 req-4f432cc1-1950-4520-bfb9-5ef038e0b766 service nova] Lock "effec7f0-1006-4081-91f4-e2d96fd0a87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:11 user nova-compute[74996]: DEBUG nova.compute.manager [req-444afa86-bf87-47f7-8390-2c615d15b000 req-4f432cc1-1950-4520-bfb9-5ef038e0b766 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] No waiting events found dispatching network-vif-unplugged-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:45:11 user nova-compute[74996]: WARNING nova.compute.manager [req-444afa86-bf87-47f7-8390-2c615d15b000 req-4f432cc1-1950-4520-bfb9-5ef038e0b766 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Received unexpected event network-vif-unplugged-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 for instance with vm_state active and task_state shelving.
Nov 02 01:45:11 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Instance destroyed successfully.
Nov 02 01:45:11 user nova-compute[74996]: DEBUG nova.compute.manager [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:45:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Acquiring lock "refresh_cache-effec7f0-1006-4081-91f4-e2d96fd0a87a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:45:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Acquired lock "refresh_cache-effec7f0-1006-4081-91f4-e2d96fd0a87a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:45:11 user nova-compute[74996]: DEBUG nova.network.neutron [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG nova.network.neutron [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Updating instance_info_cache with network_info: [{"id": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "address": "fa:16:3e:56:0b:6b", "network": {"id": "b3014958-040c-44b4-94cc-1099e8fe3750", "bridge": "br-int", "label": "tempest-TestShelveInstance-1407890304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca87a25a8b244b7989ea459300036d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf50e3d-3d", "ovs_interfaceid": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Releasing lock "refresh_cache-effec7f0-1006-4081-91f4-e2d96fd0a87a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:45:12 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Instance destroyed successfully.
Nov 02 01:45:12 user nova-compute[74996]: DEBUG nova.objects.instance [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lazy-loading 'resources' on Instance uuid effec7f0-1006-4081-91f4-e2d96fd0a87a {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1689709328',display_name='tempest-TestShelveInstance-server-1689709328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1689709328',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaTyRcwo/6qh2VUUUZQ7imznM0w+FhHVOMS4herOMA8kinuWHPKCco0BceOOJ4BPGCiEDQ5X04+2lK+/NaW63fmgUUQ8Q7OZ2TCFIlqp/8mjZzYpCt3Sstoj3ztaAlirQ==',key_name='tempest-TestShelveInstance-1132842490',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:43:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca87a25a8b244b7989ea459300036d8d',ramdisk_id='',reservation_id='r-tfi2zjgk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-457210861',owner_user_name='tempest-TestShelveInstance-457210861-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:43:36Z,user_data=None,user_id='670f527ebd064a39a3d19edffd8393f3',uuid=effec7f0-1006-4081-91f4-e2d96fd0a87a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "address": "fa:16:3e:56:0b:6b", "network": {"id": "b3014958-040c-44b4-94cc-1099e8fe3750", "bridge": "br-int", "label": "tempest-TestShelveInstance-1407890304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca87a25a8b244b7989ea459300036d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf50e3d-3d", "ovs_interfaceid": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Converting VIF {"id": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "address": "fa:16:3e:56:0b:6b", "network": {"id": "b3014958-040c-44b4-94cc-1099e8fe3750", "bridge": "br-int", "label": "tempest-TestShelveInstance-1407890304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca87a25a8b244b7989ea459300036d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf50e3d-3d", "ovs_interfaceid": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=8cf50e3d-3da4-48fc-9cc9-bfe88441b531,network=Network(b3014958-040c-44b4-94cc-1099e8fe3750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cf50e3d-3d') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG os_vif [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=8cf50e3d-3da4-48fc-9cc9-bfe88441b531,network=Network(b3014958-040c-44b4-94cc-1099e8fe3750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cf50e3d-3d') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8cf50e3d-3d, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f3deef76-b2b3-4818-8218-f4506b0e6d14) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:12 user nova-compute[74996]: INFO os_vif [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=8cf50e3d-3da4-48fc-9cc9-bfe88441b531,network=Network(b3014958-040c-44b4-94cc-1099e8fe3750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cf50e3d-3d')
Nov 02 01:45:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VOtcoRsW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:45:12 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:45:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d46a80-853e-45a3-bc03-f82daf0d56c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:45:12 user nova-compute[74996]: No targets found.
Nov 02 01:45:12 user nova-compute[74996]: iSNS:
Nov 02 01:45:12 user nova-compute[74996]: No targets found.
Nov 02 01:45:12 user nova-compute[74996]: STATIC:
Nov 02 01:45:12 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b
Nov 02 01:45:12 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:45:12 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:45:12 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67
Nov 02 01:45:12 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:45:12 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:45:12 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494
Nov 02 01:45:12 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:45:12 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:45:12 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d
Nov 02 01:45:12 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:45:12 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:45:12 user nova-compute[74996]: FIRMWARE:
Nov 02 01:45:12 user nova-compute[74996]: No targets found.
Nov 02 01:45:12 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:45:12 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:45:12 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[72016515-a1ee-44b4-bd29-323922d40ee5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[baff89c1-0c1e-4308-b0cb-46472f95892a]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:45:12 user nova-compute[74996]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:45:12 user nova-compute[74996]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)
Nov 02 01:45:12 user nova-compute[74996]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)
Nov 02 01:45:12 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:45:12 user nova-compute[74996]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:45:12 user nova-compute[74996]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)
Nov 02 01:45:12 user nova-compute[74996]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)
Nov 02 01:45:12 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830c706b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494'): ({'sdf'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Removing single pathed devices sdf {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cfe7e4-e628-4f4a-b813-e856071d5e26]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[881ab1bc-7dd2-46c6-9f09-3da81a964f66]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Flushing IO for device /dev/sdf {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[468ecefd-2b80-45e3-96a0-05e70d31bed1]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:12 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[68490729-2139-41c5-90d9-27fa689f5035]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] SCSI volumes sdf have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6c9b42-e33e-4a88-b6d5-484337a6143e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6628d7-eeed-414d-a5fb-e23479a07ef9]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494, portal: 172.16.0.220,3260]
Nov 02 01:45:13 user nova-compute[74996]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494, portal: 172.16.0.220,3260] successful.
Nov 02 01:45:13 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1299c0ab-b03e-4489-9db0-9aea35ae7eaa]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] <== disconnect_volume: return (314ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:45:13 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Deleting instance files /opt/stack/data/nova/instances/effec7f0-1006-4081-91f4-e2d96fd0a87a_del
Nov 02 01:45:13 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Deletion of /opt/stack/data/nova/instances/effec7f0-1006-4081-91f4-e2d96fd0a87a_del complete
Nov 02 01:45:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:45:13 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Creating image(s)
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Did not create local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Ensure instance console log exists: /opt/stack/data/nova/instances/382dce4d-dd73-4929-81dc-bcc3bb987045/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Start _get_guest_xml network_info=[{"id": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "address": "fa:16:3e:a3:71:72", "network": {"id": "2923ade6-4530-4109-8e37-67123fa93c05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-147878200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b53bc3f0b994ceeb8e6cff9f8fb1980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce4de8d2-0f", "ovs_interfaceid": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '602d2319-483c-49f7-a62d-5b931d79f80f', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MOdlBbYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '382dce4d-dd73-4929-81dc-bcc3bb987045', 'attached_at': '', 'detached_at': '', 'volume_id': '5f7cff97-bd0e-4b25-a3da-398d425d9ed4', 'serial': '5f7cff97-bd0e-4b25-a3da-398d425d9ed4'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:45:13 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 02 01:45:13 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.objects.instance [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lazy-loading 'vcpu_model' on Instance uuid 382dce4d-dd73-4929-81dc-bcc3bb987045 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.compute.manager [req-c8573efe-b805-4ebf-883e-dbf2f0066f16 req-5808a514-e07f-431a-883a-9734fe87f149 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Received event network-vif-plugged-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c8573efe-b805-4ebf-883e-dbf2f0066f16 req-5808a514-e07f-431a-883a-9734fe87f149 service nova] Acquiring lock "effec7f0-1006-4081-91f4-e2d96fd0a87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c8573efe-b805-4ebf-883e-dbf2f0066f16 req-5808a514-e07f-431a-883a-9734fe87f149 service nova] Lock "effec7f0-1006-4081-91f4-e2d96fd0a87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c8573efe-b805-4ebf-883e-dbf2f0066f16 req-5808a514-e07f-431a-883a-9734fe87f149 service nova] Lock "effec7f0-1006-4081-91f4-e2d96fd0a87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.compute.manager [req-c8573efe-b805-4ebf-883e-dbf2f0066f16 req-5808a514-e07f-431a-883a-9734fe87f149 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] No waiting events found dispatching network-vif-plugged-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:45:13 user nova-compute[74996]: WARNING nova.compute.manager [req-c8573efe-b805-4ebf-883e-dbf2f0066f16 req-5808a514-e07f-431a-883a-9734fe87f149 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Received unexpected event network-vif-plugged-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 for instance with vm_state active and task_state shelving.
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.compute.manager [req-c8573efe-b805-4ebf-883e-dbf2f0066f16 req-5808a514-e07f-431a-883a-9734fe87f149 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Received event network-changed-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.compute.manager [req-c8573efe-b805-4ebf-883e-dbf2f0066f16 req-5808a514-e07f-431a-883a-9734fe87f149 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Refreshing instance network info cache due to event network-changed-8cf50e3d-3da4-48fc-9cc9-bfe88441b531. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c8573efe-b805-4ebf-883e-dbf2f0066f16 req-5808a514-e07f-431a-883a-9734fe87f149 service nova] Acquiring lock "refresh_cache-effec7f0-1006-4081-91f4-e2d96fd0a87a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c8573efe-b805-4ebf-883e-dbf2f0066f16 req-5808a514-e07f-431a-883a-9734fe87f149 service nova] Acquired lock "refresh_cache-effec7f0-1006-4081-91f4-e2d96fd0a87a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.network.neutron [req-c8573efe-b805-4ebf-883e-dbf2f0066f16 req-5808a514-e07f-431a-883a-9734fe87f149 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Refreshing network info cache for port 8cf50e3d-3da4-48fc-9cc9-bfe88441b531 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MOdlBbYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:45:13 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:45:13 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:45:13 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a27852-d374-493c-8710-b463e691e545]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:45:13 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdec26f2-0703-40b8-b5bc-b73346f6c67f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4] added
Nov 02 01:45:13 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc12570d-7f95-4ab0-80db-3d94ad71627d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c692ab-97c2-48b2-b079-3ad4f06a157a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MOdlBbYq {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MOdlBbYq" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f756b7a-57fb-4636-bdad-7507d24723ea]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MOdlBbYq'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c00e21a-cb2f-497d-ab17-6b556f081b1c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[55862349-5e47-46bb-a3d5-d9d2c78d1b94]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:45:13 user nova-compute[74996]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)
Nov 02 01:45:13 user nova-compute[74996]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)
Nov 02 01:45:13 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:45:13 user nova-compute[74996]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)
Nov 02 01:45:13 user nova-compute[74996]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)
Nov 02 01:45:13 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bdfad4-6550-4fd6-8e78-8170618654b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4, portal: 172.16.0.220,3260]
Nov 02 01:45:13 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4, portal: 172.16.0.220,3260] successful.
Nov 02 01:45:13 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffa7861-ef5a-435d-927a-1869e3337d45]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b405c9f7-db20-4453-b8f3-7eb7266860b6]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:45:13 user nova-compute[74996]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)
Nov 02 01:45:13 user nova-compute[74996]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)
Nov 02 01:45:13 user nova-compute[74996]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)
Nov 02 01:45:13 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:45:13 user nova-compute[74996]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)
Nov 02 01:45:13 user nova-compute[74996]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)
Nov 02 01:45:13 user nova-compute[74996]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)
Nov 02 01:45:13 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9298fb84-ec64-4532-a79f-6edd23d3d6c6]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MOdlBbYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.network.neutron [req-c8573efe-b805-4ebf-883e-dbf2f0066f16 req-5808a514-e07f-431a-883a-9734fe87f149 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Updated VIF entry in instance network info cache for port 8cf50e3d-3da4-48fc-9cc9-bfe88441b531. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG nova.network.neutron [req-c8573efe-b805-4ebf-883e-dbf2f0066f16 req-5808a514-e07f-431a-883a-9734fe87f149 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Updating instance_info_cache with network_info: [{"id": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "address": "fa:16:3e:56:0b:6b", "network": {"id": "b3014958-040c-44b4-94cc-1099e8fe3750", "bridge": null, "label": "tempest-TestShelveInstance-1407890304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca87a25a8b244b7989ea459300036d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8cf50e3d-3d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:45:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c8573efe-b805-4ebf-883e-dbf2f0066f16 req-5808a514-e07f-431a-883a-9734fe87f149 service nova] Releasing lock "refresh_cache-effec7f0-1006-4081-91f4-e2d96fd0a87a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:45:14 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:45:14 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26633346133383932', 'path': '/dev/sdb'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:45:14 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633346133383932', 'path': '/dev/sdb'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:45:14 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T01:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-27410822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-692359628',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY+Zv0aRo1up7UitzxFVT1vKWf8cixyY3iz2qNf6VRlBWYW6c7XWIJe+dxRZCmSX/K8EfSE0Gl/Oobz82iIrY1fQpASD+/UO110wRUprmiqDBAkbDpFOw/i0LToaceywQ==',key_name='tempest-keypair-693568396',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:42:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3b53bc3f0b994ceeb8e6cff9f8fb1980',ramdisk_id='',reservation_id='r-uylmojhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-272873490',owner_user_name='tempest-ServerActionsV293TestJSON-272873490-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:44:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3295b6af73fe474ca0c00efe655866ec',uuid=382dce4d-dd73-4929-81dc-bcc3bb987045,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "address": "fa:16:3e:a3:71:72", "network": {"id": "2923ade6-4530-4109-8e37-67123fa93c05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-147878200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b53bc3f0b994ceeb8e6cff9f8fb1980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce4de8d2-0f", "ovs_interfaceid": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:45:14 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Converting VIF {"id": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "address": "fa:16:3e:a3:71:72", "network": {"id": "2923ade6-4530-4109-8e37-67123fa93c05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-147878200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b53bc3f0b994ceeb8e6cff9f8fb1980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce4de8d2-0f", "ovs_interfaceid": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:45:14 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:71:72,bridge_name='br-int',has_traffic_filtering=True,id=ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf,network=Network(2923ade6-4530-4109-8e37-67123fa93c05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce4de8d2-0f') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:45:14 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:45:14 user nova-compute[74996]:   <uuid>382dce4d-dd73-4929-81dc-bcc3bb987045</uuid>
Nov 02 01:45:14 user nova-compute[74996]:   <name>instance-0000001a</name>
Nov 02 01:45:14 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:45:14 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:45:14 user nova-compute[74996]:   <metadata>
Nov 02 01:45:14 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:45:14 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:45:14 user nova-compute[74996]:       <nova:name>tempest-ServerActionsV293TestJSON-server-27410822</nova:name>
Nov 02 01:45:14 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:45:13</nova:creationTime>
Nov 02 01:45:14 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:45:14 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:45:14 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:45:14 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:45:14 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:45:14 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:45:14 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:45:14 user nova-compute[74996]:       <nova:owner>
Nov 02 01:45:14 user nova-compute[74996]:         <nova:user uuid="3295b6af73fe474ca0c00efe655866ec">tempest-ServerActionsV293TestJSON-272873490-project-member</nova:user>
Nov 02 01:45:14 user nova-compute[74996]:         <nova:project uuid="3b53bc3f0b994ceeb8e6cff9f8fb1980">tempest-ServerActionsV293TestJSON-272873490</nova:project>
Nov 02 01:45:14 user nova-compute[74996]:       </nova:owner>
Nov 02 01:45:14 user nova-compute[74996]:       <nova:ports>
Nov 02 01:45:14 user nova-compute[74996]:         <nova:port uuid="ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf">
Nov 02 01:45:14 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 02 01:45:14 user nova-compute[74996]:         </nova:port>
Nov 02 01:45:14 user nova-compute[74996]:       </nova:ports>
Nov 02 01:45:14 user nova-compute[74996]:     </nova:instance>
Nov 02 01:45:14 user nova-compute[74996]:   </metadata>
Nov 02 01:45:14 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:45:14 user nova-compute[74996]:     <system>
Nov 02 01:45:14 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:45:14 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:45:14 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:45:14 user nova-compute[74996]:       <entry name="serial">382dce4d-dd73-4929-81dc-bcc3bb987045</entry>
Nov 02 01:45:14 user nova-compute[74996]:       <entry name="uuid">382dce4d-dd73-4929-81dc-bcc3bb987045</entry>
Nov 02 01:45:14 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:45:14 user nova-compute[74996]:     </system>
Nov 02 01:45:14 user nova-compute[74996]:   </sysinfo>
Nov 02 01:45:14 user nova-compute[74996]:   <os>
Nov 02 01:45:14 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:45:14 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:45:14 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:45:14 user nova-compute[74996]:   </os>
Nov 02 01:45:14 user nova-compute[74996]:   <features>
Nov 02 01:45:14 user nova-compute[74996]:     <acpi/>
Nov 02 01:45:14 user nova-compute[74996]:     <apic/>
Nov 02 01:45:14 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:45:14 user nova-compute[74996]:   </features>
Nov 02 01:45:14 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:45:14 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:45:14 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:45:14 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:45:14 user nova-compute[74996]:   </clock>
Nov 02 01:45:14 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:45:14 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:45:14 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:45:14 user nova-compute[74996]:   </cpu>
Nov 02 01:45:14 user nova-compute[74996]:   <devices>
Nov 02 01:45:14 user nova-compute[74996]:     <disk type="block" device="disk">
Nov 02 01:45:14 user nova-compute[74996]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:45:14 user nova-compute[74996]:       <source dev="/dev/sdb"/>
Nov 02 01:45:14 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:45:14 user nova-compute[74996]:       <serial>5f7cff97-bd0e-4b25-a3da-398d425d9ed4</serial>
Nov 02 01:45:14 user nova-compute[74996]:     </disk>
Nov 02 01:45:14 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:45:14 user nova-compute[74996]:       <mac address="fa:16:3e:a3:71:72"/>
Nov 02 01:45:14 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:45:14 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:45:14 user nova-compute[74996]:       <target dev="tapce4de8d2-0f"/>
Nov 02 01:45:14 user nova-compute[74996]:     </interface>
Nov 02 01:45:14 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:45:14 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/382dce4d-dd73-4929-81dc-bcc3bb987045/console.log" append="off"/>
Nov 02 01:45:14 user nova-compute[74996]:     </serial>
Nov 02 01:45:14 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:45:14 user nova-compute[74996]:     <video>
Nov 02 01:45:14 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:45:14 user nova-compute[74996]:     </video>
Nov 02 01:45:14 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:45:14 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:45:14 user nova-compute[74996]:     </rng>
Nov 02 01:45:14 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:45:14 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:45:14 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:45:14 user nova-compute[74996]:     </memballoon>
Nov 02 01:45:14 user nova-compute[74996]:   </devices>
Nov 02 01:45:14 user nova-compute[74996]: </domain>
Nov 02 01:45:14 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:45:14 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T01:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-27410822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-692359628',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY+Zv0aRo1up7UitzxFVT1vKWf8cixyY3iz2qNf6VRlBWYW6c7XWIJe+dxRZCmSX/K8EfSE0Gl/Oobz82iIrY1fQpASD+/UO110wRUprmiqDBAkbDpFOw/i0LToaceywQ==',key_name='tempest-keypair-693568396',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:42:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3b53bc3f0b994ceeb8e6cff9f8fb1980',ramdisk_id='',reservation_id='r-uylmojhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-272873490',owner_user_name='tempest-ServerActionsV293TestJSON-272873490-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:44:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3295b6af73fe474ca0c00efe655866ec',uuid=382dce4d-dd73-4929-81dc-bcc3bb987045,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "address": "fa:16:3e:a3:71:72", "network": {"id": "2923ade6-4530-4109-8e37-67123fa93c05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-147878200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b53bc3f0b994ceeb8e6cff9f8fb1980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce4de8d2-0f", "ovs_interfaceid": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:45:14 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Converting VIF {"id": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "address": "fa:16:3e:a3:71:72", "network": {"id": "2923ade6-4530-4109-8e37-67123fa93c05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-147878200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b53bc3f0b994ceeb8e6cff9f8fb1980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce4de8d2-0f", "ovs_interfaceid": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:45:14 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:71:72,bridge_name='br-int',has_traffic_filtering=True,id=ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf,network=Network(2923ade6-4530-4109-8e37-67123fa93c05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce4de8d2-0f') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:45:14 user nova-compute[74996]: DEBUG os_vif [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:71:72,bridge_name='br-int',has_traffic_filtering=True,id=ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf,network=Network(2923ade6-4530-4109-8e37-67123fa93c05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce4de8d2-0f') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:45:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:45:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:45:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f885463-0f88-51c9-a83b-33f97e2ff533', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:45:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:45:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce4de8d2-0f, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:45:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapce4de8d2-0f, col_values=(('qos', UUID('42b47149-cd88-4b07-95b5-7d6227347d06')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:45:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapce4de8d2-0f, col_values=(('external_ids', {'iface-id': 'ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:71:72', 'vm-uuid': '382dce4d-dd73-4929-81dc-bcc3bb987045'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:45:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:45:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:14 user nova-compute[74996]: INFO os_vif [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:71:72,bridge_name='br-int',has_traffic_filtering=True,id=ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf,network=Network(2923ade6-4530-4109-8e37-67123fa93c05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce4de8d2-0f')
Nov 02 01:45:14 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:45:14 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:45:14 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] No VIF found with MAC fa:16:3e:a3:71:72, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:45:16 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:16 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:16 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:16 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:16 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:45:16 user nova-compute[74996]: DEBUG nova.compute.manager [req-1466e748-6268-4d29-b589-e32de92b0f79 req-10dbbeb6-2ac1-4903-9204-dbf4eaecaf7f service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Received event network-vif-plugged-ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:45:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1466e748-6268-4d29-b589-e32de92b0f79 req-10dbbeb6-2ac1-4903-9204-dbf4eaecaf7f service nova] Acquiring lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1466e748-6268-4d29-b589-e32de92b0f79 req-10dbbeb6-2ac1-4903-9204-dbf4eaecaf7f service nova] Lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1466e748-6268-4d29-b589-e32de92b0f79 req-10dbbeb6-2ac1-4903-9204-dbf4eaecaf7f service nova] Lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:16 user nova-compute[74996]: DEBUG nova.compute.manager [req-1466e748-6268-4d29-b589-e32de92b0f79 req-10dbbeb6-2ac1-4903-9204-dbf4eaecaf7f service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] No waiting events found dispatching network-vif-plugged-ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:45:16 user nova-compute[74996]: WARNING nova.compute.manager [req-1466e748-6268-4d29-b589-e32de92b0f79 req-10dbbeb6-2ac1-4903-9204-dbf4eaecaf7f service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Received unexpected event network-vif-plugged-ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf for instance with vm_state active and task_state rebuild_spawning.
Nov 02 01:45:16 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:16 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:16 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:16 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:18 user nova-compute[74996]: DEBUG nova.compute.manager [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:45:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:45:18 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Instance spawned successfully.
Nov 02 01:45:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:45:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:45:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:45:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:45:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:45:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:45:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:45:18 user nova-compute[74996]: DEBUG nova.compute.manager [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:45:18 user nova-compute[74996]: DEBUG nova.compute.manager [req-7749d291-9407-4b53-9d8e-4f81d4ed5757 req-4fc93229-4108-4374-8abb-ea9ffa9aa7b5 service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Received event network-vif-plugged-ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:45:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7749d291-9407-4b53-9d8e-4f81d4ed5757 req-4fc93229-4108-4374-8abb-ea9ffa9aa7b5 service nova] Acquiring lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7749d291-9407-4b53-9d8e-4f81d4ed5757 req-4fc93229-4108-4374-8abb-ea9ffa9aa7b5 service nova] Lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7749d291-9407-4b53-9d8e-4f81d4ed5757 req-4fc93229-4108-4374-8abb-ea9ffa9aa7b5 service nova] Lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:18 user nova-compute[74996]: DEBUG nova.compute.manager [req-7749d291-9407-4b53-9d8e-4f81d4ed5757 req-4fc93229-4108-4374-8abb-ea9ffa9aa7b5 service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] No waiting events found dispatching network-vif-plugged-ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:45:18 user nova-compute[74996]: WARNING nova.compute.manager [req-7749d291-9407-4b53-9d8e-4f81d4ed5757 req-4fc93229-4108-4374-8abb-ea9ffa9aa7b5 service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Received unexpected event network-vif-plugged-ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf for instance with vm_state active and task_state rebuild_spawning.
Nov 02 01:45:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:18 user nova-compute[74996]: DEBUG nova.objects.instance [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74996) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 02 01:45:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-01a0abd7-93c7-46d7-964c-27cacdf61ecc tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.264s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:19 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:45:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:21 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:45:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:21 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:45:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:45:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:45:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f395088d-c7db-4a64-ab03-38cefee60231/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f395088d-c7db-4a64-ab03-38cefee60231/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f395088d-c7db-4a64-ab03-38cefee60231/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f395088d-c7db-4a64-ab03-38cefee60231/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:45:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:45:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:45:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:24 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:45:24 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:45:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=7876MB free_disk=25.103683471679688GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:45:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Applying migration context for instance d28b9820-c059-46cb-9bb0-132e447fca1b as it has an incoming, in-progress migration 404789e4-99ac-4290-8d63-1f7e34c99e57. Migration status is error {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 02 01:45:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Skipping migration as instance is neither resizing nor live-migrating. {{(pid=74996) _update_usage_from_migrations /opt/stack/nova/nova/compute/resource_tracker.py:1563}}
Nov 02 01:45:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance fea802b7-64d9-4c77-87a7-eaba1dce5c22 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:45:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7307f3a3-1ad1-43f7-be49-9cd03a626cd7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:45:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 3b5719c9-08ad-4a01-b960-23328b537283 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:45:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance f0de5980-334b-4654-8b1a-88c4c861aa49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:45:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 382dce4d-dd73-4929-81dc-bcc3bb987045 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:45:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance effec7f0-1006-4081-91f4-e2d96fd0a87a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:45:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:45:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance f395088d-c7db-4a64-ab03-38cefee60231 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:45:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance d28b9820-c059-46cb-9bb0-132e447fca1b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:45:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:45:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:45:24 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Deleted allocations for instance effec7f0-1006-4081-91f4-e2d96fd0a87a
Nov 02 01:45:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:24 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:45:24 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:45:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:45:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.617s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.091s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:24 user nova-compute[74996]: DEBUG nova.objects.instance [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lazy-loading 'numa_topology' on Instance uuid effec7f0-1006-4081-91f4-e2d96fd0a87a {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:45:24 user nova-compute[74996]: DEBUG nova.objects.base [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Object Instance<effec7f0-1006-4081-91f4-e2d96fd0a87a> lazy-loaded attributes: resources,numa_topology {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:45:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:45:24 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:45:24 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:45:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-23cb8ae1-08c1-4b31-8292-381e11835090 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "effec7f0-1006-4081-91f4-e2d96fd0a87a" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 14.008s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:25 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:45:25 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:45:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-3b5719c9-08ad-4a01-b960-23328b537283" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:45:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-3b5719c9-08ad-4a01-b960-23328b537283" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:45:25 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 01:45:25 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Updating instance_info_cache with network_info: [{"id": "39bb24a8-37e5-43fc-839b-203634b56ad6", "address": "fa:16:3e:31:e2:fb", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bb24a8-37", "ovs_interfaceid": "39bb24a8-37e5-43fc-839b-203634b56ad6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:45:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-3b5719c9-08ad-4a01-b960-23328b537283" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:45:25 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 01:45:25 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:45:25 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:45:25 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:45:25 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:45:25 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:45:26 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:45:26 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:45:26 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74996) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 01:45:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:29 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:45:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:37 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:45:37 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Cleaning up deleted instances {{(pid=74996) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 01:45:37 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] There are 0 instances to clean {{(pid=74996) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 01:45:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:40 user nova-compute[74996]: DEBUG nova.compute.manager [req-10cfcbeb-e621-47e3-a1bb-be4af7847a5f req-ece280e1-acfb-42b0-831a-a081cdfcaa45 service nova] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Received event network-changed-2fc01b4a-295e-4fa2-97c2-f76e903c1a41 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:45:40 user nova-compute[74996]: DEBUG nova.compute.manager [req-10cfcbeb-e621-47e3-a1bb-be4af7847a5f req-ece280e1-acfb-42b0-831a-a081cdfcaa45 service nova] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Refreshing instance network info cache due to event network-changed-2fc01b4a-295e-4fa2-97c2-f76e903c1a41. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:45:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-10cfcbeb-e621-47e3-a1bb-be4af7847a5f req-ece280e1-acfb-42b0-831a-a081cdfcaa45 service nova] Acquiring lock "refresh_cache-2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:45:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-10cfcbeb-e621-47e3-a1bb-be4af7847a5f req-ece280e1-acfb-42b0-831a-a081cdfcaa45 service nova] Acquired lock "refresh_cache-2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:45:40 user nova-compute[74996]: DEBUG nova.network.neutron [req-10cfcbeb-e621-47e3-a1bb-be4af7847a5f req-ece280e1-acfb-42b0-831a-a081cdfcaa45 service nova] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Refreshing network info cache for port 2fc01b4a-295e-4fa2-97c2-f76e903c1a41 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG nova.network.neutron [req-10cfcbeb-e621-47e3-a1bb-be4af7847a5f req-ece280e1-acfb-42b0-831a-a081cdfcaa45 service nova] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Updated VIF entry in instance network info cache for port 2fc01b4a-295e-4fa2-97c2-f76e903c1a41. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG nova.network.neutron [req-10cfcbeb-e621-47e3-a1bb-be4af7847a5f req-ece280e1-acfb-42b0-831a-a081cdfcaa45 service nova] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Updating instance_info_cache with network_info: [{"id": "2fc01b4a-295e-4fa2-97c2-f76e903c1a41", "address": "fa:16:3e:25:84:57", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc01b4a-29", "ovs_interfaceid": "2fc01b4a-295e-4fa2-97c2-f76e903c1a41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-10cfcbeb-e621-47e3-a1bb-be4af7847a5f req-ece280e1-acfb-42b0-831a-a081cdfcaa45 service nova] Releasing lock "refresh_cache-2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:41 user nova-compute[74996]: INFO nova.compute.manager [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Terminating instance
Nov 02 01:45:41 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid fea802b7-64d9-4c77-87a7-eaba1dce5c22 {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid 7307f3a3-1ad1-43f7-be49-9cd03a626cd7 {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid 3b5719c9-08ad-4a01-b960-23328b537283 {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid f0de5980-334b-4654-8b1a-88c4c861aa49 {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid d28b9820-c059-46cb-9bb0-132e447fca1b {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6 {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid f395088d-c7db-4a64-ab03-38cefee60231 {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid 382dce4d-dd73-4929-81dc-bcc3bb987045 {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "fea802b7-64d9-4c77-87a7-eaba1dce5c22" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "fea802b7-64d9-4c77-87a7-eaba1dce5c22" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "7307f3a3-1ad1-43f7-be49-9cd03a626cd7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "7307f3a3-1ad1-43f7-be49-9cd03a626cd7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "3b5719c9-08ad-4a01-b960-23328b537283" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "3b5719c9-08ad-4a01-b960-23328b537283" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "f0de5980-334b-4654-8b1a-88c4c861aa49" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "d28b9820-c059-46cb-9bb0-132e447fca1b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "d28b9820-c059-46cb-9bb0-132e447fca1b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "f395088d-c7db-4a64-ab03-38cefee60231" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "f395088d-c7db-4a64-ab03-38cefee60231" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "382dce4d-dd73-4929-81dc-bcc3bb987045" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "382dce4d-dd73-4929-81dc-bcc3bb987045" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "7307f3a3-1ad1-43f7-be49-9cd03a626cd7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "3b5719c9-08ad-4a01-b960-23328b537283" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "fea802b7-64d9-4c77-87a7-eaba1dce5c22" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "f395088d-c7db-4a64-ab03-38cefee60231" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:41 user nova-compute[74996]: INFO nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] During _sync_instance_power_state the DB power_state (1) does not match the vm_power_state from the hypervisor (4). Updating power_state in the DB to match the hypervisor.
Nov 02 01:45:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "382dce4d-dd73-4929-81dc-bcc3bb987045" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "d28b9820-c059-46cb-9bb0-132e447fca1b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.145s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:42 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Instance destroyed successfully.
Nov 02 01:45:42 user nova-compute[74996]: DEBUG nova.objects.instance [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lazy-loading 'resources' on Instance uuid 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:42:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1148286830',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1148286830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1148286830',id=28,image_ref='d3d953ec-9220-4634-b8d7-483843069272',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+EIEgzLU1isk3JNPYYaGgR6oj5RqJMig8ul/3Wh+D1BCOWlnvZJYtVl3TZHRUu2AeW8xXQMeVGdfePhkI5Tomd+UzCSYw09hqMIWYiJDB59odqgDRCp+1g8wSK/a6S/g==',key_name='tempest-keypair-1597605523',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:44:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31965b482eb243a69112a49bf1302779',ramdisk_id='',reservation_id='r-6kcyvfj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-216720976',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-216720976-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-216720976',owner_user_name='tempest-TestVolumeBootPattern-216720976-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:44:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be6bf504c3a649898e8c83399f6fee8e',uuid=2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2fc01b4a-295e-4fa2-97c2-f76e903c1a41", "address": "fa:16:3e:25:84:57", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc01b4a-29", "ovs_interfaceid": "2fc01b4a-295e-4fa2-97c2-f76e903c1a41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converting VIF {"id": "2fc01b4a-295e-4fa2-97c2-f76e903c1a41", "address": "fa:16:3e:25:84:57", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc01b4a-29", "ovs_interfaceid": "2fc01b4a-295e-4fa2-97c2-f76e903c1a41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:84:57,bridge_name='br-int',has_traffic_filtering=True,id=2fc01b4a-295e-4fa2-97c2-f76e903c1a41,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fc01b4a-29') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG os_vif [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:84:57,bridge_name='br-int',has_traffic_filtering=True,id=2fc01b4a-295e-4fa2-97c2-f76e903c1a41,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fc01b4a-29') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2fc01b4a-29, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6abb3482-9254-4742-a5c2-7171f417962e) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:42 user nova-compute[74996]: INFO os_vif [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:84:57,bridge_name='br-int',has_traffic_filtering=True,id=2fc01b4a-295e-4fa2-97c2-f76e903c1a41,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fc01b4a-29')
Nov 02 01:45:42 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sUJyIEBb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:45:42 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:45:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[af99ab76-e527-4c4b-b9fe-3dd3ab26d48b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:45:42 user nova-compute[74996]: No targets found.
Nov 02 01:45:42 user nova-compute[74996]: iSNS:
Nov 02 01:45:42 user nova-compute[74996]: No targets found.
Nov 02 01:45:42 user nova-compute[74996]: STATIC:
Nov 02 01:45:42 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b
Nov 02 01:45:42 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:45:42 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:45:42 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67
Nov 02 01:45:42 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:45:42 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:45:42 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d
Nov 02 01:45:42 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:45:42 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:45:42 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4
Nov 02 01:45:42 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:45:42 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:45:42 user nova-compute[74996]: FIRMWARE:
Nov 02 01:45:42 user nova-compute[74996]: No targets found.
Nov 02 01:45:42 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:45:42 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:45:42 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee3ea24-a4c4-40c8-8177-aa414687974a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[76274b4b-7dcb-46fc-9be0-144e41dbe686]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:45:42 user nova-compute[74996]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)
Nov 02 01:45:42 user nova-compute[74996]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)
Nov 02 01:45:42 user nova-compute[74996]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)
Nov 02 01:45:42 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:45:42 user nova-compute[74996]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b (non-flash)
Nov 02 01:45:42 user nova-compute[74996]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)
Nov 02 01:45:42 user nova-compute[74996]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)
Nov 02 01:45:42 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830c7b1240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b'): ({'sdh'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Removing single pathed devices sdh {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a66a9c9-3174-4d30-ae64-c0644e452d34]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4055717-3c32-41c5-9c42-f8af87de9d88]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Flushing IO for device /dev/sdh {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[783f907e-def9-4a99-8d67-1d5f267385fe]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.043s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d959f2aa-9b7b-4faf-87c5-31e6616c0261]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] SCSI volumes sdh have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79790c5-112a-4155-99be-248b692c5295]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[13560b87-5ef0-42c3-9c7a-805eb081d33b]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b, portal: 172.16.0.220,3260]
Nov 02 01:45:42 user nova-compute[74996]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b, portal: 172.16.0.220,3260] successful.
Nov 02 01:45:42 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9434b777-eacc-4c26-b844-5f0515395a7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69e5238-678e-4c65-b868-e8a8f59b3704]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] <== disconnect_volume: return (304ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:45:42 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Deleting instance files /opt/stack/data/nova/instances/2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6_del
Nov 02 01:45:42 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Deletion of /opt/stack/data/nova/instances/2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6_del complete
Nov 02 01:45:42 user nova-compute[74996]: INFO nova.compute.manager [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 02 01:45:42 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:45:42 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:45:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-b130bb32-d2c4-4397-a175-fc546cf3b72f req-f1a9c7ff-83d8-4572-a985-af38ab27b10c service nova] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Received event network-vif-unplugged-2fc01b4a-295e-4fa2-97c2-f76e903c1a41 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:45:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b130bb32-d2c4-4397-a175-fc546cf3b72f req-f1a9c7ff-83d8-4572-a985-af38ab27b10c service nova] Acquiring lock "2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b130bb32-d2c4-4397-a175-fc546cf3b72f req-f1a9c7ff-83d8-4572-a985-af38ab27b10c service nova] Lock "2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b130bb32-d2c4-4397-a175-fc546cf3b72f req-f1a9c7ff-83d8-4572-a985-af38ab27b10c service nova] Lock "2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-b130bb32-d2c4-4397-a175-fc546cf3b72f req-f1a9c7ff-83d8-4572-a985-af38ab27b10c service nova] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] No waiting events found dispatching network-vif-unplugged-2fc01b4a-295e-4fa2-97c2-f76e903c1a41 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:45:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-b130bb32-d2c4-4397-a175-fc546cf3b72f req-f1a9c7ff-83d8-4572-a985-af38ab27b10c service nova] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Received event network-vif-unplugged-2fc01b4a-295e-4fa2-97c2-f76e903c1a41 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:45:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-b130bb32-d2c4-4397-a175-fc546cf3b72f req-f1a9c7ff-83d8-4572-a985-af38ab27b10c service nova] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Received event network-vif-plugged-2fc01b4a-295e-4fa2-97c2-f76e903c1a41 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:45:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b130bb32-d2c4-4397-a175-fc546cf3b72f req-f1a9c7ff-83d8-4572-a985-af38ab27b10c service nova] Acquiring lock "2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b130bb32-d2c4-4397-a175-fc546cf3b72f req-f1a9c7ff-83d8-4572-a985-af38ab27b10c service nova] Lock "2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b130bb32-d2c4-4397-a175-fc546cf3b72f req-f1a9c7ff-83d8-4572-a985-af38ab27b10c service nova] Lock "2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-b130bb32-d2c4-4397-a175-fc546cf3b72f req-f1a9c7ff-83d8-4572-a985-af38ab27b10c service nova] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] No waiting events found dispatching network-vif-plugged-2fc01b4a-295e-4fa2-97c2-f76e903c1a41 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:45:43 user nova-compute[74996]: WARNING nova.compute.manager [req-b130bb32-d2c4-4397-a175-fc546cf3b72f req-f1a9c7ff-83d8-4572-a985-af38ab27b10c service nova] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Received unexpected event network-vif-plugged-2fc01b4a-295e-4fa2-97c2-f76e903c1a41 for instance with vm_state active and task_state deleting.
Nov 02 01:45:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:43 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:45:43 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Took 0.77 seconds to deallocate network for instance.
Nov 02 01:45:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-58a2f214-6a70-42fa-98e6-f8389e2112a3 req-b18d44d9-b6fc-4363-8967-59546e5c355e service nova] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Received event network-vif-deleted-2fc01b4a-295e-4fa2-97c2-f76e903c1a41 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:45:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:46 user nova-compute[74996]: INFO nova.compute.manager [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Took 3.56 seconds to detach 1 volumes for instance.
Nov 02 01:45:46 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] Deleting volume: 9434b777-eacc-4c26-b844-5f0515395a7b {{(pid=74996) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 01:45:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:47 user nova-compute[74996]: DEBUG nova.compute.manager [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:45:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:47 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:45:47 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:45:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.210s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:47 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:45:47 user nova-compute[74996]: INFO nova.compute.claims [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Claim successful on node user
Nov 02 01:45:47 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Deleted allocations for instance 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6
Nov 02 01:45:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a08b7526-ee97-4201-a9f8-a2fa43c34f01 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.143s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.710s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:47 user nova-compute[74996]: INFO nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 02 01:45:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "2dc296e7-4c2f-4fe8-aa5f-0cddaa5ac1c6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:47 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:45:47 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:45:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:47 user nova-compute[74996]: DEBUG nova.compute.manager [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:45:47 user nova-compute[74996]: DEBUG nova.compute.manager [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:45:47 user nova-compute[74996]: DEBUG nova.network.neutron [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:45:47 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:45:47 user nova-compute[74996]: DEBUG nova.policy [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '700d6c84a40547e99f3e364d6447ad4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6b2c4a38374459b73fa76b8dde9db4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:45:48 user nova-compute[74996]: DEBUG nova.compute.manager [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:45:48 user nova-compute[74996]: DEBUG nova.compute.manager [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:45:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:45:48 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Creating image(s)
Nov 02 01:45:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "/opt/stack/data/nova/instances/1fd1c257-2903-47ce-bd31-a00ba6a8b9df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "/opt/stack/data/nova/instances/1fd1c257-2903-47ce-bd31-a00ba6a8b9df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "/opt/stack/data/nova/instances/1fd1c257-2903-47ce-bd31-a00ba6a8b9df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.194s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.202s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/1fd1c257-2903-47ce-bd31-a00ba6a8b9df/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/1fd1c257-2903-47ce-bd31-a00ba6a8b9df/disk 1073741824" returned: 0 in 0.049s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:48 user nova-compute[74996]: DEBUG nova.network.neutron [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Successfully created port: b2105173-adeb-478a-abf5-24a32a1922fb {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:45:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.177s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:48 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1fd1c257-2903-47ce-bd31-a00ba6a8b9df/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:45:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd1c257-2903-47ce-bd31-a00ba6a8b9df/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:45:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd1c257-2903-47ce-bd31-a00ba6a8b9df/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:45:48 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Cannot resize image /opt/stack/data/nova/instances/1fd1c257-2903-47ce-bd31-a00ba6a8b9df/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:45:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:45:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Ensure instance console log exists: /opt/stack/data/nova/instances/1fd1c257-2903-47ce-bd31-a00ba6a8b9df/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:45:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:49 user nova-compute[74996]: DEBUG nova.network.neutron [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Successfully updated port: b2105173-adeb-478a-abf5-24a32a1922fb {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:45:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "refresh_cache-1fd1c257-2903-47ce-bd31-a00ba6a8b9df" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:45:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquired lock "refresh_cache-1fd1c257-2903-47ce-bd31-a00ba6a8b9df" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:45:49 user nova-compute[74996]: DEBUG nova.network.neutron [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:45:49 user nova-compute[74996]: DEBUG nova.network.neutron [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:45:49 user nova-compute[74996]: DEBUG nova.compute.manager [req-910c3f72-3041-4780-bbcd-eeb825468950 req-58bbdd90-84ae-4e15-b905-d246a8442b1d service nova] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Received event network-changed-b2105173-adeb-478a-abf5-24a32a1922fb {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:45:49 user nova-compute[74996]: DEBUG nova.compute.manager [req-910c3f72-3041-4780-bbcd-eeb825468950 req-58bbdd90-84ae-4e15-b905-d246a8442b1d service nova] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Refreshing instance network info cache due to event network-changed-b2105173-adeb-478a-abf5-24a32a1922fb. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:45:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-910c3f72-3041-4780-bbcd-eeb825468950 req-58bbdd90-84ae-4e15-b905-d246a8442b1d service nova] Acquiring lock "refresh_cache-1fd1c257-2903-47ce-bd31-a00ba6a8b9df" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.network.neutron [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Updating instance_info_cache with network_info: [{"id": "b2105173-adeb-478a-abf5-24a32a1922fb", "address": "fa:16:3e:90:44:8b", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2105173-ad", "ovs_interfaceid": "b2105173-adeb-478a-abf5-24a32a1922fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Releasing lock "refresh_cache-1fd1c257-2903-47ce-bd31-a00ba6a8b9df" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.compute.manager [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Instance network_info: |[{"id": "b2105173-adeb-478a-abf5-24a32a1922fb", "address": "fa:16:3e:90:44:8b", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2105173-ad", "ovs_interfaceid": "b2105173-adeb-478a-abf5-24a32a1922fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-910c3f72-3041-4780-bbcd-eeb825468950 req-58bbdd90-84ae-4e15-b905-d246a8442b1d service nova] Acquired lock "refresh_cache-1fd1c257-2903-47ce-bd31-a00ba6a8b9df" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.network.neutron [req-910c3f72-3041-4780-bbcd-eeb825468950 req-58bbdd90-84ae-4e15-b905-d246a8442b1d service nova] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Refreshing network info cache for port b2105173-adeb-478a-abf5-24a32a1922fb {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Start _get_guest_xml network_info=[{"id": "b2105173-adeb-478a-abf5-24a32a1922fb", "address": "fa:16:3e:90:44:8b", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2105173-ad", "ovs_interfaceid": "b2105173-adeb-478a-abf5-24a32a1922fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:45:50 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:45:50 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:45:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-492951611',display_name='tempest-AttachVolumeNegativeTest-server-492951611',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-492951611',id=30,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzLXv6dZduFFX76MvEeDq6D3AwnICQsD5RiGuawtXhQxA6q8rUs83WtToJ8Lq1QKf+SJUdDnWOw7LdEgzG9a2SxRsnYoNrcEXcKUCKIwwVnm0fewuVkCW3xMyDqR0v2jw==',key_name='tempest-keypair-1898707231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b6b2c4a38374459b73fa76b8dde9db4',ramdisk_id='',reservation_id='r-0kc2201p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1395123327',owner_user_name='tempest-AttachVolumeNegativeTest-1395123327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:45:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='700d6c84a40547e99f3e364d6447ad4e',uuid=1fd1c257-2903-47ce-bd31-a00ba6a8b9df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2105173-adeb-478a-abf5-24a32a1922fb", "address": "fa:16:3e:90:44:8b", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2105173-ad", "ovs_interfaceid": "b2105173-adeb-478a-abf5-24a32a1922fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Converting VIF {"id": "b2105173-adeb-478a-abf5-24a32a1922fb", "address": "fa:16:3e:90:44:8b", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2105173-ad", "ovs_interfaceid": "b2105173-adeb-478a-abf5-24a32a1922fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:44:8b,bridge_name='br-int',has_traffic_filtering=True,id=b2105173-adeb-478a-abf5-24a32a1922fb,network=Network(d18bfd38-1454-4665-a175-2c7d0e2002ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2105173-ad') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.objects.instance [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fd1c257-2903-47ce-bd31-a00ba6a8b9df {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:45:50 user nova-compute[74996]:   <uuid>1fd1c257-2903-47ce-bd31-a00ba6a8b9df</uuid>
Nov 02 01:45:50 user nova-compute[74996]:   <name>instance-0000001e</name>
Nov 02 01:45:50 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:45:50 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:45:50 user nova-compute[74996]:   <metadata>
Nov 02 01:45:50 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:45:50 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:45:50 user nova-compute[74996]:       <nova:name>tempest-AttachVolumeNegativeTest-server-492951611</nova:name>
Nov 02 01:45:50 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:45:50</nova:creationTime>
Nov 02 01:45:50 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:45:50 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:45:50 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:45:50 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:45:50 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:45:50 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:45:50 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:45:50 user nova-compute[74996]:       <nova:owner>
Nov 02 01:45:50 user nova-compute[74996]:         <nova:user uuid="700d6c84a40547e99f3e364d6447ad4e">tempest-AttachVolumeNegativeTest-1395123327-project-member</nova:user>
Nov 02 01:45:50 user nova-compute[74996]:         <nova:project uuid="9b6b2c4a38374459b73fa76b8dde9db4">tempest-AttachVolumeNegativeTest-1395123327</nova:project>
Nov 02 01:45:50 user nova-compute[74996]:       </nova:owner>
Nov 02 01:45:50 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:45:50 user nova-compute[74996]:       <nova:ports>
Nov 02 01:45:50 user nova-compute[74996]:         <nova:port uuid="b2105173-adeb-478a-abf5-24a32a1922fb">
Nov 02 01:45:50 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 01:45:50 user nova-compute[74996]:         </nova:port>
Nov 02 01:45:50 user nova-compute[74996]:       </nova:ports>
Nov 02 01:45:50 user nova-compute[74996]:     </nova:instance>
Nov 02 01:45:50 user nova-compute[74996]:   </metadata>
Nov 02 01:45:50 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:45:50 user nova-compute[74996]:     <system>
Nov 02 01:45:50 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:45:50 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:45:50 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:45:50 user nova-compute[74996]:       <entry name="serial">1fd1c257-2903-47ce-bd31-a00ba6a8b9df</entry>
Nov 02 01:45:50 user nova-compute[74996]:       <entry name="uuid">1fd1c257-2903-47ce-bd31-a00ba6a8b9df</entry>
Nov 02 01:45:50 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:45:50 user nova-compute[74996]:     </system>
Nov 02 01:45:50 user nova-compute[74996]:   </sysinfo>
Nov 02 01:45:50 user nova-compute[74996]:   <os>
Nov 02 01:45:50 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:45:50 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:45:50 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:45:50 user nova-compute[74996]:   </os>
Nov 02 01:45:50 user nova-compute[74996]:   <features>
Nov 02 01:45:50 user nova-compute[74996]:     <acpi/>
Nov 02 01:45:50 user nova-compute[74996]:     <apic/>
Nov 02 01:45:50 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:45:50 user nova-compute[74996]:   </features>
Nov 02 01:45:50 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:45:50 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:45:50 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:45:50 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:45:50 user nova-compute[74996]:   </clock>
Nov 02 01:45:50 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:45:50 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:45:50 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:45:50 user nova-compute[74996]:   </cpu>
Nov 02 01:45:50 user nova-compute[74996]:   <devices>
Nov 02 01:45:50 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:45:50 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:45:50 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/1fd1c257-2903-47ce-bd31-a00ba6a8b9df/disk"/>
Nov 02 01:45:50 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:45:50 user nova-compute[74996]:     </disk>
Nov 02 01:45:50 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:45:50 user nova-compute[74996]:       <mac address="fa:16:3e:90:44:8b"/>
Nov 02 01:45:50 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:45:50 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:45:50 user nova-compute[74996]:       <target dev="tapb2105173-ad"/>
Nov 02 01:45:50 user nova-compute[74996]:     </interface>
Nov 02 01:45:50 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:45:50 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/1fd1c257-2903-47ce-bd31-a00ba6a8b9df/console.log" append="off"/>
Nov 02 01:45:50 user nova-compute[74996]:     </serial>
Nov 02 01:45:50 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:45:50 user nova-compute[74996]:     <video>
Nov 02 01:45:50 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:45:50 user nova-compute[74996]:     </video>
Nov 02 01:45:50 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:45:50 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:45:50 user nova-compute[74996]:     </rng>
Nov 02 01:45:50 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:45:50 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:45:50 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:45:50 user nova-compute[74996]:     </memballoon>
Nov 02 01:45:50 user nova-compute[74996]:   </devices>
Nov 02 01:45:50 user nova-compute[74996]: </domain>
Nov 02 01:45:50 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:45:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-492951611',display_name='tempest-AttachVolumeNegativeTest-server-492951611',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-492951611',id=30,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzLXv6dZduFFX76MvEeDq6D3AwnICQsD5RiGuawtXhQxA6q8rUs83WtToJ8Lq1QKf+SJUdDnWOw7LdEgzG9a2SxRsnYoNrcEXcKUCKIwwVnm0fewuVkCW3xMyDqR0v2jw==',key_name='tempest-keypair-1898707231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b6b2c4a38374459b73fa76b8dde9db4',ramdisk_id='',reservation_id='r-0kc2201p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1395123327',owner_user_name='tempest-AttachVolumeNegativeTest-1395123327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:45:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='700d6c84a40547e99f3e364d6447ad4e',uuid=1fd1c257-2903-47ce-bd31-a00ba6a8b9df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2105173-adeb-478a-abf5-24a32a1922fb", "address": "fa:16:3e:90:44:8b", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2105173-ad", "ovs_interfaceid": "b2105173-adeb-478a-abf5-24a32a1922fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Converting VIF {"id": "b2105173-adeb-478a-abf5-24a32a1922fb", "address": "fa:16:3e:90:44:8b", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2105173-ad", "ovs_interfaceid": "b2105173-adeb-478a-abf5-24a32a1922fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:44:8b,bridge_name='br-int',has_traffic_filtering=True,id=b2105173-adeb-478a-abf5-24a32a1922fb,network=Network(d18bfd38-1454-4665-a175-2c7d0e2002ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2105173-ad') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG os_vif [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:44:8b,bridge_name='br-int',has_traffic_filtering=True,id=b2105173-adeb-478a-abf5-24a32a1922fb,network=Network(d18bfd38-1454-4665-a175-2c7d0e2002ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2105173-ad') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb870f90-d660-56b3-a985-46c2fc286aa9', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2105173-ad, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb2105173-ad, col_values=(('qos', UUID('8e34cbde-c319-4ae9-84f2-fcb6ebd51802')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb2105173-ad, col_values=(('external_ids', {'iface-id': 'b2105173-adeb-478a-abf5-24a32a1922fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:44:8b', 'vm-uuid': '1fd1c257-2903-47ce-bd31-a00ba6a8b9df'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:50 user nova-compute[74996]: INFO os_vif [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:44:8b,bridge_name='br-int',has_traffic_filtering=True,id=b2105173-adeb-478a-abf5-24a32a1922fb,network=Network(d18bfd38-1454-4665-a175-2c7d0e2002ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2105173-ad')
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] No VIF found with MAC fa:16:3e:90:44:8b, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.network.neutron [req-910c3f72-3041-4780-bbcd-eeb825468950 req-58bbdd90-84ae-4e15-b905-d246a8442b1d service nova] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Updated VIF entry in instance network info cache for port b2105173-adeb-478a-abf5-24a32a1922fb. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG nova.network.neutron [req-910c3f72-3041-4780-bbcd-eeb825468950 req-58bbdd90-84ae-4e15-b905-d246a8442b1d service nova] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Updating instance_info_cache with network_info: [{"id": "b2105173-adeb-478a-abf5-24a32a1922fb", "address": "fa:16:3e:90:44:8b", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2105173-ad", "ovs_interfaceid": "b2105173-adeb-478a-abf5-24a32a1922fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:45:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-910c3f72-3041-4780-bbcd-eeb825468950 req-58bbdd90-84ae-4e15-b905-d246a8442b1d service nova] Releasing lock "refresh_cache-1fd1c257-2903-47ce-bd31-a00ba6a8b9df" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:45:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-4407f859-55ee-43a4-bdd4-8ee45fa6ed57 req-e3086962-363b-4dff-b23f-f0335ed4da72 service nova] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Received event network-vif-plugged-b2105173-adeb-478a-abf5-24a32a1922fb {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:45:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4407f859-55ee-43a4-bdd4-8ee45fa6ed57 req-e3086962-363b-4dff-b23f-f0335ed4da72 service nova] Acquiring lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4407f859-55ee-43a4-bdd4-8ee45fa6ed57 req-e3086962-363b-4dff-b23f-f0335ed4da72 service nova] Lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4407f859-55ee-43a4-bdd4-8ee45fa6ed57 req-e3086962-363b-4dff-b23f-f0335ed4da72 service nova] Lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-4407f859-55ee-43a4-bdd4-8ee45fa6ed57 req-e3086962-363b-4dff-b23f-f0335ed4da72 service nova] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] No waiting events found dispatching network-vif-plugged-b2105173-adeb-478a-abf5-24a32a1922fb {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:45:51 user nova-compute[74996]: WARNING nova.compute.manager [req-4407f859-55ee-43a4-bdd4-8ee45fa6ed57 req-e3086962-363b-4dff-b23f-f0335ed4da72 service nova] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Received unexpected event network-vif-plugged-b2105173-adeb-478a-abf5-24a32a1922fb for instance with vm_state building and task_state spawning.
Nov 02 01:45:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:53 user nova-compute[74996]: DEBUG nova.compute.manager [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:45:53 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:45:53 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Instance spawned successfully.
Nov 02 01:45:53 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:45:53 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:45:53 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:45:53 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:45:53 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:45:53 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:45:53 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:45:53 user nova-compute[74996]: DEBUG nova.compute.manager [req-f3dc5de5-80d2-4e2c-be21-c02ff8ff9c08 req-9e6065ac-a436-4bb9-a53e-b8cc283c673c service nova] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Received event network-vif-plugged-b2105173-adeb-478a-abf5-24a32a1922fb {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:45:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f3dc5de5-80d2-4e2c-be21-c02ff8ff9c08 req-9e6065ac-a436-4bb9-a53e-b8cc283c673c service nova] Acquiring lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f3dc5de5-80d2-4e2c-be21-c02ff8ff9c08 req-9e6065ac-a436-4bb9-a53e-b8cc283c673c service nova] Lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f3dc5de5-80d2-4e2c-be21-c02ff8ff9c08 req-9e6065ac-a436-4bb9-a53e-b8cc283c673c service nova] Lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:53 user nova-compute[74996]: DEBUG nova.compute.manager [req-f3dc5de5-80d2-4e2c-be21-c02ff8ff9c08 req-9e6065ac-a436-4bb9-a53e-b8cc283c673c service nova] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] No waiting events found dispatching network-vif-plugged-b2105173-adeb-478a-abf5-24a32a1922fb {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:45:53 user nova-compute[74996]: WARNING nova.compute.manager [req-f3dc5de5-80d2-4e2c-be21-c02ff8ff9c08 req-9e6065ac-a436-4bb9-a53e-b8cc283c673c service nova] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Received unexpected event network-vif-plugged-b2105173-adeb-478a-abf5-24a32a1922fb for instance with vm_state building and task_state spawning.
Nov 02 01:45:53 user nova-compute[74996]: INFO nova.compute.manager [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Took 5.70 seconds to spawn the instance on the hypervisor.
Nov 02 01:45:53 user nova-compute[74996]: DEBUG nova.compute.manager [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:45:53 user nova-compute[74996]: INFO nova.compute.manager [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Took 6.71 seconds to build instance.
Nov 02 01:45:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8acfbd91-3032-42cf-9ee8-0956fadd2b33 tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.811s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:55 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1402bfa2-8c69-4c2b-9c1f-39b547d10a50 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "fea802b7-64d9-4c77-87a7-eaba1dce5c22" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1402bfa2-8c69-4c2b-9c1f-39b547d10a50 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "fea802b7-64d9-4c77-87a7-eaba1dce5c22" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1402bfa2-8c69-4c2b-9c1f-39b547d10a50 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "fea802b7-64d9-4c77-87a7-eaba1dce5c22-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1402bfa2-8c69-4c2b-9c1f-39b547d10a50 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "fea802b7-64d9-4c77-87a7-eaba1dce5c22-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1402bfa2-8c69-4c2b-9c1f-39b547d10a50 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "fea802b7-64d9-4c77-87a7-eaba1dce5c22-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:55 user nova-compute[74996]: INFO nova.compute.manager [None req-1402bfa2-8c69-4c2b-9c1f-39b547d10a50 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Terminating instance
Nov 02 01:45:55 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1402bfa2-8c69-4c2b-9c1f-39b547d10a50 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:45:55 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:55 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:55 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:55 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:55 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:55 user nova-compute[74996]: DEBUG nova.compute.manager [req-58248ce5-5c2e-418f-9ceb-197b2ddaea28 req-423c0b70-5256-4f2e-8a14-e79c14383756 service nova] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Received event network-vif-unplugged-c458c481-1588-4776-a269-8f95b72195dd {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:45:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-58248ce5-5c2e-418f-9ceb-197b2ddaea28 req-423c0b70-5256-4f2e-8a14-e79c14383756 service nova] Acquiring lock "fea802b7-64d9-4c77-87a7-eaba1dce5c22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-58248ce5-5c2e-418f-9ceb-197b2ddaea28 req-423c0b70-5256-4f2e-8a14-e79c14383756 service nova] Lock "fea802b7-64d9-4c77-87a7-eaba1dce5c22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-58248ce5-5c2e-418f-9ceb-197b2ddaea28 req-423c0b70-5256-4f2e-8a14-e79c14383756 service nova] Lock "fea802b7-64d9-4c77-87a7-eaba1dce5c22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:55 user nova-compute[74996]: DEBUG nova.compute.manager [req-58248ce5-5c2e-418f-9ceb-197b2ddaea28 req-423c0b70-5256-4f2e-8a14-e79c14383756 service nova] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] No waiting events found dispatching network-vif-unplugged-c458c481-1588-4776-a269-8f95b72195dd {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:45:55 user nova-compute[74996]: DEBUG nova.compute.manager [req-58248ce5-5c2e-418f-9ceb-197b2ddaea28 req-423c0b70-5256-4f2e-8a14-e79c14383756 service nova] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Received event network-vif-unplugged-c458c481-1588-4776-a269-8f95b72195dd for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:45:56 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Instance destroyed successfully.
Nov 02 01:45:56 user nova-compute[74996]: DEBUG nova.objects.instance [None req-1402bfa2-8c69-4c2b-9c1f-39b547d10a50 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lazy-loading 'resources' on Instance uuid fea802b7-64d9-4c77-87a7-eaba1dce5c22 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:45:56 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-1402bfa2-8c69-4c2b-9c1f-39b547d10a50 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:29:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1604386891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1604386891',id=3,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:29:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='142161c2fae44bdea848619580195795',ramdisk_id='',reservation_id='r-b6qt65yz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1294190560',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:31:10Z,user_data=None,user_id='15affb427e9b4fb8873accf286510e14',uuid=fea802b7-64d9-4c77-87a7-eaba1dce5c22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c458c481-1588-4776-a269-8f95b72195dd", "address": "fa:16:3e:7f:23:3e", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc458c481-15", "ovs_interfaceid": "c458c481-1588-4776-a269-8f95b72195dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:45:56 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-1402bfa2-8c69-4c2b-9c1f-39b547d10a50 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Converting VIF {"id": "c458c481-1588-4776-a269-8f95b72195dd", "address": "fa:16:3e:7f:23:3e", "network": {"id": "b5218514-0348-4dcc-8ecf-4595a87e204a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-179801609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "142161c2fae44bdea848619580195795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc458c481-15", "ovs_interfaceid": "c458c481-1588-4776-a269-8f95b72195dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:45:56 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-1402bfa2-8c69-4c2b-9c1f-39b547d10a50 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:23:3e,bridge_name='br-int',has_traffic_filtering=True,id=c458c481-1588-4776-a269-8f95b72195dd,network=Network(b5218514-0348-4dcc-8ecf-4595a87e204a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc458c481-15') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:45:56 user nova-compute[74996]: DEBUG os_vif [None req-1402bfa2-8c69-4c2b-9c1f-39b547d10a50 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:23:3e,bridge_name='br-int',has_traffic_filtering=True,id=c458c481-1588-4776-a269-8f95b72195dd,network=Network(b5218514-0348-4dcc-8ecf-4595a87e204a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc458c481-15') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:45:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc458c481-15, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:45:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:45:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6c250c2a-80fa-460f-b82d-17e72e87a18a) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:45:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:45:56 user nova-compute[74996]: INFO os_vif [None req-1402bfa2-8c69-4c2b-9c1f-39b547d10a50 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:23:3e,bridge_name='br-int',has_traffic_filtering=True,id=c458c481-1588-4776-a269-8f95b72195dd,network=Network(b5218514-0348-4dcc-8ecf-4595a87e204a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc458c481-15')
Nov 02 01:45:56 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-1402bfa2-8c69-4c2b-9c1f-39b547d10a50 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Deleting instance files /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22_del
Nov 02 01:45:56 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-1402bfa2-8c69-4c2b-9c1f-39b547d10a50 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Deletion of /opt/stack/data/nova/instances/fea802b7-64d9-4c77-87a7-eaba1dce5c22_del complete
Nov 02 01:45:56 user nova-compute[74996]: INFO nova.compute.manager [None req-1402bfa2-8c69-4c2b-9c1f-39b547d10a50 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 02 01:45:56 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-1402bfa2-8c69-4c2b-9c1f-39b547d10a50 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:45:56 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:45:56 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:45:56 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:45:56 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Took 0.58 seconds to deallocate network for instance.
Nov 02 01:45:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1402bfa2-8c69-4c2b-9c1f-39b547d10a50 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1402bfa2-8c69-4c2b-9c1f-39b547d10a50 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:57 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-1402bfa2-8c69-4c2b-9c1f-39b547d10a50 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:45:57 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-1402bfa2-8c69-4c2b-9c1f-39b547d10a50 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:45:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1402bfa2-8c69-4c2b-9c1f-39b547d10a50 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:57 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-1402bfa2-8c69-4c2b-9c1f-39b547d10a50 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Deleted allocations for instance fea802b7-64d9-4c77-87a7-eaba1dce5c22
Nov 02 01:45:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1402bfa2-8c69-4c2b-9c1f-39b547d10a50 tempest-ServerBootFromVolumeStableRescueTest-1294190560 tempest-ServerBootFromVolumeStableRescueTest-1294190560-project-member] Lock "fea802b7-64d9-4c77-87a7-eaba1dce5c22" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.041s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:57 user nova-compute[74996]: DEBUG nova.compute.manager [req-12228fc3-a1ea-4000-9281-fcb6eb604b89 req-aed7eb46-455b-4dcd-aa96-624a51e5d6de service nova] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Received event network-vif-plugged-c458c481-1588-4776-a269-8f95b72195dd {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:45:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-12228fc3-a1ea-4000-9281-fcb6eb604b89 req-aed7eb46-455b-4dcd-aa96-624a51e5d6de service nova] Acquiring lock "fea802b7-64d9-4c77-87a7-eaba1dce5c22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-12228fc3-a1ea-4000-9281-fcb6eb604b89 req-aed7eb46-455b-4dcd-aa96-624a51e5d6de service nova] Lock "fea802b7-64d9-4c77-87a7-eaba1dce5c22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-12228fc3-a1ea-4000-9281-fcb6eb604b89 req-aed7eb46-455b-4dcd-aa96-624a51e5d6de service nova] Lock "fea802b7-64d9-4c77-87a7-eaba1dce5c22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:57 user nova-compute[74996]: DEBUG nova.compute.manager [req-12228fc3-a1ea-4000-9281-fcb6eb604b89 req-aed7eb46-455b-4dcd-aa96-624a51e5d6de service nova] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] No waiting events found dispatching network-vif-plugged-c458c481-1588-4776-a269-8f95b72195dd {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:45:57 user nova-compute[74996]: WARNING nova.compute.manager [req-12228fc3-a1ea-4000-9281-fcb6eb604b89 req-aed7eb46-455b-4dcd-aa96-624a51e5d6de service nova] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Received unexpected event network-vif-plugged-c458c481-1588-4776-a269-8f95b72195dd for instance with vm_state deleted and task_state None.
Nov 02 01:45:57 user nova-compute[74996]: DEBUG nova.compute.manager [req-12228fc3-a1ea-4000-9281-fcb6eb604b89 req-aed7eb46-455b-4dcd-aa96-624a51e5d6de service nova] [instance: fea802b7-64d9-4c77-87a7-eaba1dce5c22] Received event network-vif-deleted-c458c481-1588-4776-a269-8f95b72195dd {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:45:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ce06f1aa-33a1-4477-854a-06fae39c0c3a tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Acquiring lock "f395088d-c7db-4a64-ab03-38cefee60231" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ce06f1aa-33a1-4477-854a-06fae39c0c3a tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Lock "f395088d-c7db-4a64-ab03-38cefee60231" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ce06f1aa-33a1-4477-854a-06fae39c0c3a tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Acquiring lock "f395088d-c7db-4a64-ab03-38cefee60231-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ce06f1aa-33a1-4477-854a-06fae39c0c3a tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Lock "f395088d-c7db-4a64-ab03-38cefee60231-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ce06f1aa-33a1-4477-854a-06fae39c0c3a tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Lock "f395088d-c7db-4a64-ab03-38cefee60231-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:59 user nova-compute[74996]: INFO nova.compute.manager [None req-ce06f1aa-33a1-4477-854a-06fae39c0c3a tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Terminating instance
Nov 02 01:45:59 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ce06f1aa-33a1-4477-854a-06fae39c0c3a tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG nova.compute.manager [req-347e62f3-809e-4338-8172-6ad128bcb827 req-4b27524d-8058-40b4-a790-89ea7946ac91 service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Received event network-vif-unplugged-cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-347e62f3-809e-4338-8172-6ad128bcb827 req-4b27524d-8058-40b4-a790-89ea7946ac91 service nova] Acquiring lock "f395088d-c7db-4a64-ab03-38cefee60231-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-347e62f3-809e-4338-8172-6ad128bcb827 req-4b27524d-8058-40b4-a790-89ea7946ac91 service nova] Lock "f395088d-c7db-4a64-ab03-38cefee60231-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-347e62f3-809e-4338-8172-6ad128bcb827 req-4b27524d-8058-40b4-a790-89ea7946ac91 service nova] Lock "f395088d-c7db-4a64-ab03-38cefee60231-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG nova.compute.manager [req-347e62f3-809e-4338-8172-6ad128bcb827 req-4b27524d-8058-40b4-a790-89ea7946ac91 service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] No waiting events found dispatching network-vif-unplugged-cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG nova.compute.manager [req-347e62f3-809e-4338-8172-6ad128bcb827 req-4b27524d-8058-40b4-a790-89ea7946ac91 service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Received event network-vif-unplugged-cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:59 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Instance destroyed successfully.
Nov 02 01:45:59 user nova-compute[74996]: DEBUG nova.objects.instance [None req-ce06f1aa-33a1-4477-854a-06fae39c0c3a tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Lazy-loading 'resources' on Instance uuid f395088d-c7db-4a64-ab03-38cefee60231 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-ce06f1aa-33a1-4477-854a-06fae39c0c3a tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:44:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1957960014',display_name='tempest-VolumesNegativeTest-instance-1957960014',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1957960014',id=29,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:44:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c4eebeae2fa47399c9c1064ac8ebafa',ramdisk_id='',reservation_id='r-v6drfr3s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-285716449',owner_user_name='tempest-VolumesNegativeTest-285716449-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:44:18Z,user_data=None,user_id='46ff1a9da6e3470eadc46cc13c482fb0',uuid=f395088d-c7db-4a64-ab03-38cefee60231,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0", "address": "fa:16:3e:88:bc:1a", "network": {"id": "f4effa4b-9479-42c3-b5fe-2e997f187ec7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b7bb81c16b2f458a85ebcf2fb18f7709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc0b256e-e9", "ovs_interfaceid": "cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-ce06f1aa-33a1-4477-854a-06fae39c0c3a tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Converting VIF {"id": "cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0", "address": "fa:16:3e:88:bc:1a", "network": {"id": "f4effa4b-9479-42c3-b5fe-2e997f187ec7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b7bb81c16b2f458a85ebcf2fb18f7709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc0b256e-e9", "ovs_interfaceid": "cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-ce06f1aa-33a1-4477-854a-06fae39c0c3a tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:bc:1a,bridge_name='br-int',has_traffic_filtering=True,id=cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0,network=Network(f4effa4b-9479-42c3-b5fe-2e997f187ec7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc0b256e-e9') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG os_vif [None req-ce06f1aa-33a1-4477-854a-06fae39c0c3a tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:bc:1a,bridge_name='br-int',has_traffic_filtering=True,id=cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0,network=Network(f4effa4b-9479-42c3-b5fe-2e997f187ec7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc0b256e-e9') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc0b256e-e9, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cade3079-0a07-4b9c-af03-11d6f8cacf8f) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:45:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:45:59 user nova-compute[74996]: INFO os_vif [None req-ce06f1aa-33a1-4477-854a-06fae39c0c3a tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:bc:1a,bridge_name='br-int',has_traffic_filtering=True,id=cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0,network=Network(f4effa4b-9479-42c3-b5fe-2e997f187ec7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc0b256e-e9')
Nov 02 01:45:59 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-ce06f1aa-33a1-4477-854a-06fae39c0c3a tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Deleting instance files /opt/stack/data/nova/instances/f395088d-c7db-4a64-ab03-38cefee60231_del
Nov 02 01:46:00 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-ce06f1aa-33a1-4477-854a-06fae39c0c3a tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Deletion of /opt/stack/data/nova/instances/f395088d-c7db-4a64-ab03-38cefee60231_del complete
Nov 02 01:46:00 user nova-compute[74996]: INFO nova.compute.manager [None req-ce06f1aa-33a1-4477-854a-06fae39c0c3a tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 02 01:46:00 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-ce06f1aa-33a1-4477-854a-06fae39c0c3a tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:46:00 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:46:00 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: f395088d-c7db-4a64-ab03-38cefee60231] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:46:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:00 user nova-compute[74996]: DEBUG nova.compute.manager [req-969d8690-5162-4c76-82e3-3f65b4c9ec16 req-8660b1ee-551b-4b8b-af61-7407a101f7b5 service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Received event network-vif-deleted-cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:46:00 user nova-compute[74996]: INFO nova.compute.manager [req-969d8690-5162-4c76-82e3-3f65b4c9ec16 req-8660b1ee-551b-4b8b-af61-7407a101f7b5 service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Neutron deleted interface cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0; detaching it from the instance and deleting it from the info cache
Nov 02 01:46:00 user nova-compute[74996]: DEBUG nova.network.neutron [req-969d8690-5162-4c76-82e3-3f65b4c9ec16 req-8660b1ee-551b-4b8b-af61-7407a101f7b5 service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:46:00 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:46:00 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Took 0.57 seconds to deallocate network for instance.
Nov 02 01:46:00 user nova-compute[74996]: DEBUG nova.compute.manager [req-969d8690-5162-4c76-82e3-3f65b4c9ec16 req-8660b1ee-551b-4b8b-af61-7407a101f7b5 service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Detach interface failed, port_id=cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0, reason: Instance f395088d-c7db-4a64-ab03-38cefee60231 could not be found. {{(pid=74996) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 01:46:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ce06f1aa-33a1-4477-854a-06fae39c0c3a tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ce06f1aa-33a1-4477-854a-06fae39c0c3a tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:00 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-ce06f1aa-33a1-4477-854a-06fae39c0c3a tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:46:00 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-ce06f1aa-33a1-4477-854a-06fae39c0c3a tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:46:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ce06f1aa-33a1-4477-854a-06fae39c0c3a tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:01 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-ce06f1aa-33a1-4477-854a-06fae39c0c3a tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Deleted allocations for instance f395088d-c7db-4a64-ab03-38cefee60231
Nov 02 01:46:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ce06f1aa-33a1-4477-854a-06fae39c0c3a tempest-VolumesNegativeTest-285716449 tempest-VolumesNegativeTest-285716449-project-member] Lock "f395088d-c7db-4a64-ab03-38cefee60231" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.039s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:01 user nova-compute[74996]: DEBUG nova.compute.manager [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Received event network-vif-plugged-cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:46:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] Acquiring lock "f395088d-c7db-4a64-ab03-38cefee60231-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] Lock "f395088d-c7db-4a64-ab03-38cefee60231-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] Lock "f395088d-c7db-4a64-ab03-38cefee60231-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:01 user nova-compute[74996]: DEBUG nova.compute.manager [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] No waiting events found dispatching network-vif-plugged-cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:46:01 user nova-compute[74996]: WARNING nova.compute.manager [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Received unexpected event network-vif-plugged-cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0 for instance with vm_state deleted and task_state None.
Nov 02 01:46:01 user nova-compute[74996]: DEBUG nova.compute.manager [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Received event network-vif-plugged-cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:46:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] Acquiring lock "f395088d-c7db-4a64-ab03-38cefee60231-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] Lock "f395088d-c7db-4a64-ab03-38cefee60231-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] Lock "f395088d-c7db-4a64-ab03-38cefee60231-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:01 user nova-compute[74996]: DEBUG nova.compute.manager [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] No waiting events found dispatching network-vif-plugged-cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:46:01 user nova-compute[74996]: WARNING nova.compute.manager [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Received unexpected event network-vif-plugged-cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0 for instance with vm_state deleted and task_state None.
Nov 02 01:46:01 user nova-compute[74996]: DEBUG nova.compute.manager [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Received event network-vif-plugged-cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:46:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] Acquiring lock "f395088d-c7db-4a64-ab03-38cefee60231-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] Lock "f395088d-c7db-4a64-ab03-38cefee60231-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] Lock "f395088d-c7db-4a64-ab03-38cefee60231-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:01 user nova-compute[74996]: DEBUG nova.compute.manager [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] No waiting events found dispatching network-vif-plugged-cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:46:01 user nova-compute[74996]: WARNING nova.compute.manager [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Received unexpected event network-vif-plugged-cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0 for instance with vm_state deleted and task_state None.
Nov 02 01:46:01 user nova-compute[74996]: DEBUG nova.compute.manager [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Received event network-vif-unplugged-cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:46:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] Acquiring lock "f395088d-c7db-4a64-ab03-38cefee60231-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] Lock "f395088d-c7db-4a64-ab03-38cefee60231-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] Lock "f395088d-c7db-4a64-ab03-38cefee60231-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:01 user nova-compute[74996]: DEBUG nova.compute.manager [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] No waiting events found dispatching network-vif-unplugged-cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:46:01 user nova-compute[74996]: WARNING nova.compute.manager [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Received unexpected event network-vif-unplugged-cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0 for instance with vm_state deleted and task_state None.
Nov 02 01:46:01 user nova-compute[74996]: DEBUG nova.compute.manager [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Received event network-vif-plugged-cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:46:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] Acquiring lock "f395088d-c7db-4a64-ab03-38cefee60231-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] Lock "f395088d-c7db-4a64-ab03-38cefee60231-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] Lock "f395088d-c7db-4a64-ab03-38cefee60231-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:01 user nova-compute[74996]: DEBUG nova.compute.manager [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] No waiting events found dispatching network-vif-plugged-cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:46:01 user nova-compute[74996]: WARNING nova.compute.manager [req-d633a50f-dbaf-4cb7-a3de-be49ca4c1c3d req-247484c3-13e5-4e86-8425-e539dddd5ac1 service nova] [instance: f395088d-c7db-4a64-ab03-38cefee60231] Received unexpected event network-vif-plugged-cc0b256e-e97a-492d-bf68-bd0ba5d2b7c0 for instance with vm_state deleted and task_state None.
Nov 02 01:46:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "d28b9820-c059-46cb-9bb0-132e447fca1b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "d28b9820-c059-46cb-9bb0-132e447fca1b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "d28b9820-c059-46cb-9bb0-132e447fca1b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "d28b9820-c059-46cb-9bb0-132e447fca1b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "d28b9820-c059-46cb-9bb0-132e447fca1b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:03 user nova-compute[74996]: INFO nova.compute.manager [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Terminating instance
Nov 02 01:46:03 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:46:03 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Instance destroyed successfully.
Nov 02 01:46:03 user nova-compute[74996]: DEBUG nova.objects.instance [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lazy-loading 'resources' on Instance uuid d28b9820-c059-46cb-9bb0-132e447fca1b {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:41:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1119191985',display_name='tempest-ServerActionsTestOtherA-server-1119191985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1119191985',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuGPSdhZpoJV1Cta3eTfZjI1QRYRGe6Y8DzUdNt6ZIoysubzlLd36OVzphJd/MOKltwOpW5QoJYEARWlOQfh2pk3msvJuTgQKOLlFS0wLTIMWMdtr2LMQxjw6cacUWITQ==',key_name='tempest-keypair-1376755092',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:42:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f462793d4eb4433c9c27d92f80518db1',ramdisk_id='',reservation_id='r-ptctrwds',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-852070362',owner_user_name='tempest-ServerActionsTestOtherA-852070362-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:45:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0ac87391a0140ba83743c0a2cd193fe',uuid=d28b9820-c059-46cb-9bb0-132e447fca1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='error') vif={"id": "498304ed-92a0-4c70-88e1-d668894f583a", "address": "fa:16:3e:7e:df:ab", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap498304ed-92", "ovs_interfaceid": "498304ed-92a0-4c70-88e1-d668894f583a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Converting VIF {"id": "498304ed-92a0-4c70-88e1-d668894f583a", "address": "fa:16:3e:7e:df:ab", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap498304ed-92", "ovs_interfaceid": "498304ed-92a0-4c70-88e1-d668894f583a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:df:ab,bridge_name='br-int',has_traffic_filtering=True,id=498304ed-92a0-4c70-88e1-d668894f583a,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap498304ed-92') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG os_vif [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:df:ab,bridge_name='br-int',has_traffic_filtering=True,id=498304ed-92a0-4c70-88e1-d668894f583a,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap498304ed-92') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap498304ed-92, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:46:03 user nova-compute[74996]: INFO os_vif [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:df:ab,bridge_name='br-int',has_traffic_filtering=True,id=498304ed-92a0-4c70-88e1-d668894f583a,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap498304ed-92')
Nov 02 01:46:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCNKbdPs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:46:03 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:46:03 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ad570f-2e8e-47c3-9027-5c5bb73c7c63]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:46:03 user nova-compute[74996]: No targets found.
Nov 02 01:46:03 user nova-compute[74996]: iSNS:
Nov 02 01:46:03 user nova-compute[74996]: No targets found.
Nov 02 01:46:03 user nova-compute[74996]: STATIC:
Nov 02 01:46:03 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67
Nov 02 01:46:03 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:46:03 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:46:03 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d
Nov 02 01:46:03 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:46:03 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:46:03 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4
Nov 02 01:46:03 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:46:03 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:46:03 user nova-compute[74996]: FIRMWARE:
Nov 02 01:46:03 user nova-compute[74996]: No targets found.
Nov 02 01:46:03 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:46:03 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:46:03 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5a76a61-6046-4d4d-9acc-1213893f10a8', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7489d2a7-97e2-454a-824e-06e57ff23ebf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a316afa-9c82-4c1d-9c1a-e3b1fcd3dcf3]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:46:03 user nova-compute[74996]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)
Nov 02 01:46:03 user nova-compute[74996]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)
Nov 02 01:46:03 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:46:03 user nova-compute[74996]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)
Nov 02 01:46:03 user nova-compute[74996]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)
Nov 02 01:46:03 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e852e200>, {}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Disconnecting from: [] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.081s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] <== disconnect_volume: return (82ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:46:03 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Deletion of /opt/stack/data/nova/instances/d28b9820-c059-46cb-9bb0-132e447fca1b_resize failed
Nov 02 01:46:03 user nova-compute[74996]: INFO nova.compute.manager [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Took 0.23 seconds to destroy the instance on the hypervisor.
Nov 02 01:46:03 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:46:03 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:46:04 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Took 0.78 seconds to deallocate network for instance.
Nov 02 01:46:04 user nova-compute[74996]: DEBUG nova.compute.manager [req-694a2ea3-d3ea-455a-ae38-2b8a2b845d98 req-b0e01be4-c0f4-4b75-8da3-56c15b17c8db service nova] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Received event network-vif-deleted-498304ed-92a0-4c70-88e1-d668894f583a {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:46:04 user nova-compute[74996]: INFO nova.compute.manager [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Took 0.08 seconds to detach 1 volumes for instance.
Nov 02 01:46:04 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Deleting volume: c5a76a61-6046-4d4d-9acc-1213893f10a8 {{(pid=74996) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 01:46:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:04 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:46:04 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:46:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.218s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:04 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Deleted allocations for instance d28b9820-c059-46cb-9bb0-132e447fca1b
Nov 02 01:46:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7859bde4-14a4-4695-bb35-ab67d63da2c4 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "d28b9820-c059-46cb-9bb0-132e447fca1b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.686s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:16 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:46:18 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:46:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:21 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:46:22 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:46:22 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:46:22 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:46:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:22 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:46:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:46:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:46:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:46:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd1c257-2903-47ce-bd31-a00ba6a8b9df/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd1c257-2903-47ce-bd31-a00ba6a8b9df/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd1c257-2903-47ce-bd31-a00ba6a8b9df/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd1c257-2903-47ce-bd31-a00ba6a8b9df/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:24 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:46:24 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:46:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8002MB free_disk=25.168880462646484GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:46:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7307f3a3-1ad1-43f7-be49-9cd03a626cd7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:46:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 3b5719c9-08ad-4a01-b960-23328b537283 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:46:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance f0de5980-334b-4654-8b1a-88c4c861aa49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:46:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 382dce4d-dd73-4929-81dc-bcc3bb987045 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:46:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 1fd1c257-2903-47ce-bd31-a00ba6a8b9df actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:46:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:46:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:46:24 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Refreshing inventories for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 01:46:24 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Updating ProviderTree inventory for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 01:46:24 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Updating inventory in ProviderTree for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 01:46:24 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Refreshing aggregate associations for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259, aggregates: None {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 01:46:24 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Refreshing trait associations for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 01:46:24 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:46:24 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:46:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:46:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.447s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:26 user nova-compute[74996]: INFO nova.compute.manager [None req-3074a2a6-7cd1-49a8-b364-cf0949d12897 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Unrescuing
Nov 02 01:46:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3074a2a6-7cd1-49a8-b364-cf0949d12897 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Acquiring lock "refresh_cache-f0de5980-334b-4654-8b1a-88c4c861aa49" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:46:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3074a2a6-7cd1-49a8-b364-cf0949d12897 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Acquired lock "refresh_cache-f0de5980-334b-4654-8b1a-88c4c861aa49" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:46:26 user nova-compute[74996]: DEBUG nova.network.neutron [None req-3074a2a6-7cd1-49a8-b364-cf0949d12897 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:46:26 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:46:26 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:46:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-f0de5980-334b-4654-8b1a-88c4c861aa49" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:46:27 user nova-compute[74996]: DEBUG nova.network.neutron [None req-3074a2a6-7cd1-49a8-b364-cf0949d12897 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Updating instance_info_cache with network_info: [{"id": "a8fe6401-b45e-4c64-b975-963eeecc7516", "address": "fa:16:3e:02:4b:04", "network": {"id": "7de1ec81-4bf0-4099-a317-52e3c4b64f4e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-840004831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cafad1855f4b3b98cba6bb24f7562b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8fe6401-b4", "ovs_interfaceid": "a8fe6401-b45e-4c64-b975-963eeecc7516", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:46:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3074a2a6-7cd1-49a8-b364-cf0949d12897 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Releasing lock "refresh_cache-f0de5980-334b-4654-8b1a-88c4c861aa49" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:46:27 user nova-compute[74996]: DEBUG nova.objects.instance [None req-3074a2a6-7cd1-49a8-b364-cf0949d12897 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lazy-loading 'flavor' on Instance uuid f0de5980-334b-4654-8b1a-88c4c861aa49 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:46:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-f0de5980-334b-4654-8b1a-88c4c861aa49" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:46:27 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 01:46:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:27 user nova-compute[74996]: DEBUG nova.compute.manager [req-4ba1cf58-d0e5-45f7-bb11-ad05f4521e15 req-add5d9f4-cfde-40e3-8410-54f0f1038c94 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Received event network-vif-unplugged-a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:46:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4ba1cf58-d0e5-45f7-bb11-ad05f4521e15 req-add5d9f4-cfde-40e3-8410-54f0f1038c94 service nova] Acquiring lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4ba1cf58-d0e5-45f7-bb11-ad05f4521e15 req-add5d9f4-cfde-40e3-8410-54f0f1038c94 service nova] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4ba1cf58-d0e5-45f7-bb11-ad05f4521e15 req-add5d9f4-cfde-40e3-8410-54f0f1038c94 service nova] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:27 user nova-compute[74996]: DEBUG nova.compute.manager [req-4ba1cf58-d0e5-45f7-bb11-ad05f4521e15 req-add5d9f4-cfde-40e3-8410-54f0f1038c94 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] No waiting events found dispatching network-vif-unplugged-a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:46:27 user nova-compute[74996]: WARNING nova.compute.manager [req-4ba1cf58-d0e5-45f7-bb11-ad05f4521e15 req-add5d9f4-cfde-40e3-8410-54f0f1038c94 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Received unexpected event network-vif-unplugged-a8fe6401-b45e-4c64-b975-963eeecc7516 for instance with vm_state rescued and task_state unrescuing.
Nov 02 01:46:28 user nova-compute[74996]: DEBUG nova.compute.manager [req-bb6ef974-8710-4c3d-a55c-d67b00047ebc req-a328f99c-2f28-49a2-a07d-20fb69a6c90b service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Received event network-changed-a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:46:28 user nova-compute[74996]: DEBUG nova.compute.manager [req-bb6ef974-8710-4c3d-a55c-d67b00047ebc req-a328f99c-2f28-49a2-a07d-20fb69a6c90b service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Refreshing instance network info cache due to event network-changed-a8fe6401-b45e-4c64-b975-963eeecc7516. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:46:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-bb6ef974-8710-4c3d-a55c-d67b00047ebc req-a328f99c-2f28-49a2-a07d-20fb69a6c90b service nova] Acquiring lock "refresh_cache-f0de5980-334b-4654-8b1a-88c4c861aa49" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:46:28 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Updating instance_info_cache with network_info: [{"id": "a8fe6401-b45e-4c64-b975-963eeecc7516", "address": "fa:16:3e:02:4b:04", "network": {"id": "7de1ec81-4bf0-4099-a317-52e3c4b64f4e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-840004831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cafad1855f4b3b98cba6bb24f7562b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8fe6401-b4", "ovs_interfaceid": "a8fe6401-b45e-4c64-b975-963eeecc7516", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:46:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-f0de5980-334b-4654-8b1a-88c4c861aa49" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:46:28 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 01:46:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-bb6ef974-8710-4c3d-a55c-d67b00047ebc req-a328f99c-2f28-49a2-a07d-20fb69a6c90b service nova] Acquired lock "refresh_cache-f0de5980-334b-4654-8b1a-88c4c861aa49" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:46:28 user nova-compute[74996]: DEBUG nova.network.neutron [req-bb6ef974-8710-4c3d-a55c-d67b00047ebc req-a328f99c-2f28-49a2-a07d-20fb69a6c90b service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Refreshing network info cache for port a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:46:28 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:46:28 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:46:28 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:46:28 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Instance destroyed successfully.
Nov 02 01:46:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:28 user nova-compute[74996]: DEBUG nova.network.neutron [req-bb6ef974-8710-4c3d-a55c-d67b00047ebc req-a328f99c-2f28-49a2-a07d-20fb69a6c90b service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Updated VIF entry in instance network info cache for port a8fe6401-b45e-4c64-b975-963eeecc7516. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:46:28 user nova-compute[74996]: DEBUG nova.network.neutron [req-bb6ef974-8710-4c3d-a55c-d67b00047ebc req-a328f99c-2f28-49a2-a07d-20fb69a6c90b service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Updating instance_info_cache with network_info: [{"id": "a8fe6401-b45e-4c64-b975-963eeecc7516", "address": "fa:16:3e:02:4b:04", "network": {"id": "7de1ec81-4bf0-4099-a317-52e3c4b64f4e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-840004831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cafad1855f4b3b98cba6bb24f7562b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8fe6401-b4", "ovs_interfaceid": "a8fe6401-b45e-4c64-b975-963eeecc7516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:46:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-bb6ef974-8710-4c3d-a55c-d67b00047ebc req-a328f99c-2f28-49a2-a07d-20fb69a6c90b service nova] Releasing lock "refresh_cache-f0de5980-334b-4654-8b1a-88c4c861aa49" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:46:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Acquiring lock "382dce4d-dd73-4929-81dc-bcc3bb987045" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "382dce4d-dd73-4929-81dc-bcc3bb987045" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Acquiring lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:28 user nova-compute[74996]: INFO nova.compute.manager [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Terminating instance
Nov 02 01:46:28 user nova-compute[74996]: DEBUG nova.compute.manager [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:46:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG nova.compute.manager [req-b95f6a8b-00c5-414a-ac4d-75a6cf1225e6 req-3d3e2036-5c4c-46dd-8c54-20678a26d7f4 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Received event network-vif-plugged-a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b95f6a8b-00c5-414a-ac4d-75a6cf1225e6 req-3d3e2036-5c4c-46dd-8c54-20678a26d7f4 service nova] Acquiring lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b95f6a8b-00c5-414a-ac4d-75a6cf1225e6 req-3d3e2036-5c4c-46dd-8c54-20678a26d7f4 service nova] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b95f6a8b-00c5-414a-ac4d-75a6cf1225e6 req-3d3e2036-5c4c-46dd-8c54-20678a26d7f4 service nova] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG nova.compute.manager [req-b95f6a8b-00c5-414a-ac4d-75a6cf1225e6 req-3d3e2036-5c4c-46dd-8c54-20678a26d7f4 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] No waiting events found dispatching network-vif-plugged-a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:46:29 user nova-compute[74996]: WARNING nova.compute.manager [req-b95f6a8b-00c5-414a-ac4d-75a6cf1225e6 req-3d3e2036-5c4c-46dd-8c54-20678a26d7f4 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Received unexpected event network-vif-plugged-a8fe6401-b45e-4c64-b975-963eeecc7516 for instance with vm_state rescued and task_state unrescuing.
Nov 02 01:46:29 user nova-compute[74996]: DEBUG nova.compute.manager [req-b95f6a8b-00c5-414a-ac4d-75a6cf1225e6 req-3d3e2036-5c4c-46dd-8c54-20678a26d7f4 service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Received event network-vif-unplugged-ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b95f6a8b-00c5-414a-ac4d-75a6cf1225e6 req-3d3e2036-5c4c-46dd-8c54-20678a26d7f4 service nova] Acquiring lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b95f6a8b-00c5-414a-ac4d-75a6cf1225e6 req-3d3e2036-5c4c-46dd-8c54-20678a26d7f4 service nova] Lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b95f6a8b-00c5-414a-ac4d-75a6cf1225e6 req-3d3e2036-5c4c-46dd-8c54-20678a26d7f4 service nova] Lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG nova.compute.manager [req-b95f6a8b-00c5-414a-ac4d-75a6cf1225e6 req-3d3e2036-5c4c-46dd-8c54-20678a26d7f4 service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] No waiting events found dispatching network-vif-unplugged-ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG nova.compute.manager [req-b95f6a8b-00c5-414a-ac4d-75a6cf1225e6 req-3d3e2036-5c4c-46dd-8c54-20678a26d7f4 service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Received event network-vif-unplugged-ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG nova.compute.manager [req-b95f6a8b-00c5-414a-ac4d-75a6cf1225e6 req-3d3e2036-5c4c-46dd-8c54-20678a26d7f4 service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Received event network-vif-plugged-ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b95f6a8b-00c5-414a-ac4d-75a6cf1225e6 req-3d3e2036-5c4c-46dd-8c54-20678a26d7f4 service nova] Acquiring lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b95f6a8b-00c5-414a-ac4d-75a6cf1225e6 req-3d3e2036-5c4c-46dd-8c54-20678a26d7f4 service nova] Lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b95f6a8b-00c5-414a-ac4d-75a6cf1225e6 req-3d3e2036-5c4c-46dd-8c54-20678a26d7f4 service nova] Lock "382dce4d-dd73-4929-81dc-bcc3bb987045-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG nova.compute.manager [req-b95f6a8b-00c5-414a-ac4d-75a6cf1225e6 req-3d3e2036-5c4c-46dd-8c54-20678a26d7f4 service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] No waiting events found dispatching network-vif-plugged-ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:46:29 user nova-compute[74996]: WARNING nova.compute.manager [req-b95f6a8b-00c5-414a-ac4d-75a6cf1225e6 req-3d3e2036-5c4c-46dd-8c54-20678a26d7f4 service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Received unexpected event network-vif-plugged-ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf for instance with vm_state active and task_state deleting.
Nov 02 01:46:29 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Instance destroyed successfully.
Nov 02 01:46:29 user nova-compute[74996]: DEBUG nova.objects.instance [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lazy-loading 'resources' on Instance uuid 382dce4d-dd73-4929-81dc-bcc3bb987045 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T01:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-27410822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-692359628',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY+Zv0aRo1up7UitzxFVT1vKWf8cixyY3iz2qNf6VRlBWYW6c7XWIJe+dxRZCmSX/K8EfSE0Gl/Oobz82iIrY1fQpASD+/UO110wRUprmiqDBAkbDpFOw/i0LToaceywQ==',key_name='tempest-keypair-693568396',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:45:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b53bc3f0b994ceeb8e6cff9f8fb1980',ramdisk_id='',reservation_id='r-uylmojhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-272873490',owner_user_name='tempest-ServerActionsV293TestJSON-272873490-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:45:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3295b6af73fe474ca0c00efe655866ec',uuid=382dce4d-dd73-4929-81dc-bcc3bb987045,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "address": "fa:16:3e:a3:71:72", "network": {"id": "2923ade6-4530-4109-8e37-67123fa93c05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-147878200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b53bc3f0b994ceeb8e6cff9f8fb1980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce4de8d2-0f", "ovs_interfaceid": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Converting VIF {"id": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "address": "fa:16:3e:a3:71:72", "network": {"id": "2923ade6-4530-4109-8e37-67123fa93c05", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-147878200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b53bc3f0b994ceeb8e6cff9f8fb1980", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce4de8d2-0f", "ovs_interfaceid": "ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:71:72,bridge_name='br-int',has_traffic_filtering=True,id=ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf,network=Network(2923ade6-4530-4109-8e37-67123fa93c05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce4de8d2-0f') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG os_vif [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:71:72,bridge_name='br-int',has_traffic_filtering=True,id=ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf,network=Network(2923ade6-4530-4109-8e37-67123fa93c05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce4de8d2-0f') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce4de8d2-0f, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42b47149-cd88-4b07-95b5-7d6227347d06) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:46:29 user nova-compute[74996]: INFO os_vif [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:71:72,bridge_name='br-int',has_traffic_filtering=True,id=ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf,network=Network(2923ade6-4530-4109-8e37-67123fa93c05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce4de8d2-0f')
Nov 02 01:46:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MOdlBbYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:46:29 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:46:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:46:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de81eb6-2aeb-442c-baed-9d92523ea014]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:46:30 user nova-compute[74996]: No targets found.
Nov 02 01:46:30 user nova-compute[74996]: iSNS:
Nov 02 01:46:30 user nova-compute[74996]: No targets found.
Nov 02 01:46:30 user nova-compute[74996]: STATIC:
Nov 02 01:46:30 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67
Nov 02 01:46:30 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:46:30 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:46:30 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d
Nov 02 01:46:30 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:46:30 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:46:30 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4
Nov 02 01:46:30 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:46:30 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:46:30 user nova-compute[74996]: FIRMWARE:
Nov 02 01:46:30 user nova-compute[74996]: No targets found.
Nov 02 01:46:30 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:46:30 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:46:30 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fc904e-09d9-4219-bfdc-77c7f44cb5de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0c97c1-ce92-49ff-91eb-1dc432a1e873]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:46:30 user nova-compute[74996]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)
Nov 02 01:46:30 user nova-compute[74996]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)
Nov 02 01:46:30 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:46:30 user nova-compute[74996]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)
Nov 02 01:46:30 user nova-compute[74996]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 (non-flash)
Nov 02 01:46:30 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e87e5f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4'): ({'sdb'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Removing single pathed devices sdb {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG nova.compute.manager [req-a1795f29-f8f5-43a9-b5b1-f780baaa7767 req-8060799a-1ef7-4bae-bcaa-3633a41667b6 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Received event network-changed-a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG nova.compute.manager [req-a1795f29-f8f5-43a9-b5b1-f780baaa7767 req-8060799a-1ef7-4bae-bcaa-3633a41667b6 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Refreshing instance network info cache due to event network-changed-a8fe6401-b45e-4c64-b975-963eeecc7516. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a1795f29-f8f5-43a9-b5b1-f780baaa7767 req-8060799a-1ef7-4bae-bcaa-3633a41667b6 service nova] Acquiring lock "refresh_cache-f0de5980-334b-4654-8b1a-88c4c861aa49" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a1795f29-f8f5-43a9-b5b1-f780baaa7767 req-8060799a-1ef7-4bae-bcaa-3633a41667b6 service nova] Acquired lock "refresh_cache-f0de5980-334b-4654-8b1a-88c4c861aa49" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG nova.network.neutron [req-a1795f29-f8f5-43a9-b5b1-f780baaa7767 req-8060799a-1ef7-4bae-bcaa-3633a41667b6 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Refreshing network info cache for port a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[53062c18-48d4-463c-8471-23e9629c6902]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.035s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b252da-1e41-4e2c-9545-4ce06b996e58]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Flushing IO for device /dev/sdb {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cc4dee-0900-4b35-964c-7c97b35d39f0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0a101d-0d1c-445e-af6d-4195a49e23c4]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f423f9b-40df-4d12-8ce2-a95079175a44]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[89651c7d-edee-41e8-abf0-a23dc9cf785f]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4, portal: 172.16.0.220,3260]
Nov 02 01:46:30 user nova-compute[74996]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4, portal: 172.16.0.220,3260] successful.
Nov 02 01:46:30 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7cff97-bd0e-4b25-a3da-398d425d9ed4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[69506898-6786-4a76-9688-dc28d6049434]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] <== disconnect_volume: return (365ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:46:30 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Deleting instance files /opt/stack/data/nova/instances/382dce4d-dd73-4929-81dc-bcc3bb987045_del
Nov 02 01:46:30 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Deletion of /opt/stack/data/nova/instances/382dce4d-dd73-4929-81dc-bcc3bb987045_del complete
Nov 02 01:46:30 user nova-compute[74996]: INFO nova.compute.manager [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Took 1.66 seconds to destroy the instance on the hypervisor.
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG nova.network.neutron [req-a1795f29-f8f5-43a9-b5b1-f780baaa7767 req-8060799a-1ef7-4bae-bcaa-3633a41667b6 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Updated VIF entry in instance network info cache for port a8fe6401-b45e-4c64-b975-963eeecc7516. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG nova.network.neutron [req-a1795f29-f8f5-43a9-b5b1-f780baaa7767 req-8060799a-1ef7-4bae-bcaa-3633a41667b6 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Updating instance_info_cache with network_info: [{"id": "a8fe6401-b45e-4c64-b975-963eeecc7516", "address": "fa:16:3e:02:4b:04", "network": {"id": "7de1ec81-4bf0-4099-a317-52e3c4b64f4e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-840004831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cafad1855f4b3b98cba6bb24f7562b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8fe6401-b4", "ovs_interfaceid": "a8fe6401-b45e-4c64-b975-963eeecc7516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a1795f29-f8f5-43a9-b5b1-f780baaa7767 req-8060799a-1ef7-4bae-bcaa-3633a41667b6 service nova] Releasing lock "refresh_cache-f0de5980-334b-4654-8b1a-88c4c861aa49" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:31 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:46:31 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Took 0.67 seconds to deallocate network for instance.
Nov 02 01:46:31 user nova-compute[74996]: DEBUG nova.compute.manager [req-3d196877-9424-48a7-9f13-82d27f86d760 req-92c31a0d-169b-4fdf-95b0-f05ead394e99 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Received event network-vif-plugged-a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:46:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3d196877-9424-48a7-9f13-82d27f86d760 req-92c31a0d-169b-4fdf-95b0-f05ead394e99 service nova] Acquiring lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3d196877-9424-48a7-9f13-82d27f86d760 req-92c31a0d-169b-4fdf-95b0-f05ead394e99 service nova] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3d196877-9424-48a7-9f13-82d27f86d760 req-92c31a0d-169b-4fdf-95b0-f05ead394e99 service nova] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:31 user nova-compute[74996]: DEBUG nova.compute.manager [req-3d196877-9424-48a7-9f13-82d27f86d760 req-92c31a0d-169b-4fdf-95b0-f05ead394e99 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] No waiting events found dispatching network-vif-plugged-a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:46:31 user nova-compute[74996]: WARNING nova.compute.manager [req-3d196877-9424-48a7-9f13-82d27f86d760 req-92c31a0d-169b-4fdf-95b0-f05ead394e99 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Received unexpected event network-vif-plugged-a8fe6401-b45e-4c64-b975-963eeecc7516 for instance with vm_state rescued and task_state unrescuing.
Nov 02 01:46:31 user nova-compute[74996]: DEBUG nova.compute.manager [req-3d196877-9424-48a7-9f13-82d27f86d760 req-92c31a0d-169b-4fdf-95b0-f05ead394e99 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Received event network-vif-plugged-a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:46:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3d196877-9424-48a7-9f13-82d27f86d760 req-92c31a0d-169b-4fdf-95b0-f05ead394e99 service nova] Acquiring lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3d196877-9424-48a7-9f13-82d27f86d760 req-92c31a0d-169b-4fdf-95b0-f05ead394e99 service nova] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3d196877-9424-48a7-9f13-82d27f86d760 req-92c31a0d-169b-4fdf-95b0-f05ead394e99 service nova] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:31 user nova-compute[74996]: DEBUG nova.compute.manager [req-3d196877-9424-48a7-9f13-82d27f86d760 req-92c31a0d-169b-4fdf-95b0-f05ead394e99 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] No waiting events found dispatching network-vif-plugged-a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:46:31 user nova-compute[74996]: WARNING nova.compute.manager [req-3d196877-9424-48a7-9f13-82d27f86d760 req-92c31a0d-169b-4fdf-95b0-f05ead394e99 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Received unexpected event network-vif-plugged-a8fe6401-b45e-4c64-b975-963eeecc7516 for instance with vm_state rescued and task_state unrescuing.
Nov 02 01:46:32 user nova-compute[74996]: INFO nova.compute.manager [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Took 0.92 seconds to detach 1 volumes for instance.
Nov 02 01:46:32 user nova-compute[74996]: DEBUG nova.compute.manager [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Deleting volume: 5f7cff97-bd0e-4b25-a3da-398d425d9ed4 {{(pid=74996) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 01:46:32 user nova-compute[74996]: DEBUG nova.compute.manager [None req-3074a2a6-7cd1-49a8-b364-cf0949d12897 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:46:32 user nova-compute[74996]: DEBUG nova.compute.manager [req-c8802c7d-63b1-424e-bca1-153df5644033 req-965fc9c0-4611-4d72-8f32-48ae52a975b1 service nova] [instance: 382dce4d-dd73-4929-81dc-bcc3bb987045] Received event network-vif-deleted-ce4de8d2-0f7e-49aa-a5f6-fddae53b8fbf {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:46:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:32 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:46:32 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:46:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:32 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Deleted allocations for instance 382dce4d-dd73-4929-81dc-bcc3bb987045
Nov 02 01:46:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6e4fc0d5-e180-450f-960f-f31f1767de9e tempest-ServerActionsV293TestJSON-272873490 tempest-ServerActionsV293TestJSON-272873490-project-member] Lock "382dce4d-dd73-4929-81dc-bcc3bb987045" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.766s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "3b5719c9-08ad-4a01-b960-23328b537283" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "3b5719c9-08ad-4a01-b960-23328b537283" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "3b5719c9-08ad-4a01-b960-23328b537283-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "3b5719c9-08ad-4a01-b960-23328b537283-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "3b5719c9-08ad-4a01-b960-23328b537283-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:43 user nova-compute[74996]: INFO nova.compute.manager [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Terminating instance
Nov 02 01:46:43 user nova-compute[74996]: DEBUG nova.compute.manager [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:46:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-005cc63b-d024-483d-ac2c-bca487561db8 req-f930be69-6820-4896-a548-381209f95d93 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Received event network-vif-unplugged-39bb24a8-37e5-43fc-839b-203634b56ad6 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:46:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-005cc63b-d024-483d-ac2c-bca487561db8 req-f930be69-6820-4896-a548-381209f95d93 service nova] Acquiring lock "3b5719c9-08ad-4a01-b960-23328b537283-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-005cc63b-d024-483d-ac2c-bca487561db8 req-f930be69-6820-4896-a548-381209f95d93 service nova] Lock "3b5719c9-08ad-4a01-b960-23328b537283-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-005cc63b-d024-483d-ac2c-bca487561db8 req-f930be69-6820-4896-a548-381209f95d93 service nova] Lock "3b5719c9-08ad-4a01-b960-23328b537283-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-005cc63b-d024-483d-ac2c-bca487561db8 req-f930be69-6820-4896-a548-381209f95d93 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] No waiting events found dispatching network-vif-unplugged-39bb24a8-37e5-43fc-839b-203634b56ad6 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:46:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-005cc63b-d024-483d-ac2c-bca487561db8 req-f930be69-6820-4896-a548-381209f95d93 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Received event network-vif-unplugged-39bb24a8-37e5-43fc-839b-203634b56ad6 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:44 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Instance destroyed successfully.
Nov 02 01:46:44 user nova-compute[74996]: DEBUG nova.objects.instance [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lazy-loading 'resources' on Instance uuid 3b5719c9-08ad-4a01-b960-23328b537283 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:39:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-526618239',display_name='tempest-TestVolumeBootPattern-volume-backed-server-526618239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-526618239',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsu+6bAxft2jCgvqyoEb61WCp3Bze3XC2Jn+gJFBiBov2pPxhEmYz7teo9ZT67hMugA7baU5FLQoRNjrUoiZCUdPX3jVoKwMGttZ7yPK0WkwoGj6BfMePZ2IY4sI/p4bA==',key_name='tempest-keypair-190111910',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:40:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31965b482eb243a69112a49bf1302779',ramdisk_id='',reservation_id='r-qkvo4v7f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-216720976',owner_user_name='tempest-TestVolumeBootPattern-216720976-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:40:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be6bf504c3a649898e8c83399f6fee8e',uuid=3b5719c9-08ad-4a01-b960-23328b537283,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39bb24a8-37e5-43fc-839b-203634b56ad6", "address": "fa:16:3e:31:e2:fb", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bb24a8-37", "ovs_interfaceid": "39bb24a8-37e5-43fc-839b-203634b56ad6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converting VIF {"id": "39bb24a8-37e5-43fc-839b-203634b56ad6", "address": "fa:16:3e:31:e2:fb", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bb24a8-37", "ovs_interfaceid": "39bb24a8-37e5-43fc-839b-203634b56ad6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:e2:fb,bridge_name='br-int',has_traffic_filtering=True,id=39bb24a8-37e5-43fc-839b-203634b56ad6,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39bb24a8-37') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG os_vif [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:e2:fb,bridge_name='br-int',has_traffic_filtering=True,id=39bb24a8-37e5-43fc-839b-203634b56ad6,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39bb24a8-37') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39bb24a8-37, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=80cb0f6f-a5d3-4301-a334-7b6beba0a7a2) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:44 user nova-compute[74996]: INFO os_vif [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:e2:fb,bridge_name='br-int',has_traffic_filtering=True,id=39bb24a8-37e5-43fc-839b-203634b56ad6,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39bb24a8-37')
Nov 02 01:46:44 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JFqYIoyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:46:44 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:46:44 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9213cf-8c66-41a8-84f1-169e3c165639]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:46:44 user nova-compute[74996]: No targets found.
Nov 02 01:46:44 user nova-compute[74996]: iSNS:
Nov 02 01:46:44 user nova-compute[74996]: No targets found.
Nov 02 01:46:44 user nova-compute[74996]: STATIC:
Nov 02 01:46:44 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67
Nov 02 01:46:44 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:46:44 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:46:44 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d
Nov 02 01:46:44 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:46:44 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:46:44 user nova-compute[74996]: FIRMWARE:
Nov 02 01:46:44 user nova-compute[74996]: No targets found.
Nov 02 01:46:44 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:46:44 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:46:44 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87c608e-77a9-4645-8d85-56db51164343]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f0d803-5b9a-4a38-b6cc-d98a44e0a561]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:46:44 user nova-compute[74996]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)
Nov 02 01:46:44 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d (non-flash)
Nov 02 01:46:44 user nova-compute[74996]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)
Nov 02 01:46:44 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f83142444c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d'): ({'sdc'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Removing single pathed devices sdc {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a192537-720a-4181-83b2-19b44837ac71]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3088342-b9bd-4f28-a627-46904d6536f7]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Flushing IO for device /dev/sdc {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.030s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7b35cf-b158-4fbd-9525-0a3094642f63]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.069s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[50eeedd1-aaf0-4f63-b570-fbe5426ee54a]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.087s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f880a321-1381-4ace-88e7-a7293ea4990d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[95de9385-21fb-47d2-b058-261cbabb2020]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d, portal: 172.16.0.220,3260]
Nov 02 01:46:44 user nova-compute[74996]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d, portal: 172.16.0.220,3260] successful.
Nov 02 01:46:44 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2c466a-1b32-4336-aae3-0dd383f2f59d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e98063c-30f6-4c8f-a75c-cbc5006d89f7]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.468s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] <== disconnect_volume: return (469ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:46:44 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Deleting instance files /opt/stack/data/nova/instances/3b5719c9-08ad-4a01-b960-23328b537283_del
Nov 02 01:46:44 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Deletion of /opt/stack/data/nova/instances/3b5719c9-08ad-4a01-b960-23328b537283_del complete
Nov 02 01:46:44 user nova-compute[74996]: INFO nova.compute.manager [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Took 1.43 seconds to destroy the instance on the hypervisor.
Nov 02 01:46:44 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:46:45 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Took 0.76 seconds to deallocate network for instance.
Nov 02 01:46:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-4957ec27-bbda-43a2-8e40-9b7b41d712d6 req-14598ec5-b110-4a2f-9e08-6b3c77f16a7a service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Received event network-vif-deleted-39bb24a8-37e5-43fc-839b-203634b56ad6 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:46:45 user nova-compute[74996]: INFO nova.compute.manager [req-4957ec27-bbda-43a2-8e40-9b7b41d712d6 req-14598ec5-b110-4a2f-9e08-6b3c77f16a7a service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Neutron deleted interface 39bb24a8-37e5-43fc-839b-203634b56ad6; detaching it from the instance and deleting it from the info cache
Nov 02 01:46:45 user nova-compute[74996]: DEBUG nova.network.neutron [req-4957ec27-bbda-43a2-8e40-9b7b41d712d6 req-14598ec5-b110-4a2f-9e08-6b3c77f16a7a service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-4957ec27-bbda-43a2-8e40-9b7b41d712d6 req-14598ec5-b110-4a2f-9e08-6b3c77f16a7a service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Detach interface failed, port_id=39bb24a8-37e5-43fc-839b-203634b56ad6, reason: Instance 3b5719c9-08ad-4a01-b960-23328b537283 could not be found. {{(pid=74996) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Received event network-vif-plugged-39bb24a8-37e5-43fc-839b-203634b56ad6 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] Acquiring lock "3b5719c9-08ad-4a01-b960-23328b537283-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] Lock "3b5719c9-08ad-4a01-b960-23328b537283-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] Lock "3b5719c9-08ad-4a01-b960-23328b537283-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] No waiting events found dispatching network-vif-plugged-39bb24a8-37e5-43fc-839b-203634b56ad6 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:46:45 user nova-compute[74996]: WARNING nova.compute.manager [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Received unexpected event network-vif-plugged-39bb24a8-37e5-43fc-839b-203634b56ad6 for instance with vm_state active and task_state deleting.
Nov 02 01:46:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Received event network-vif-plugged-39bb24a8-37e5-43fc-839b-203634b56ad6 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] Acquiring lock "3b5719c9-08ad-4a01-b960-23328b537283-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] Lock "3b5719c9-08ad-4a01-b960-23328b537283-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] Lock "3b5719c9-08ad-4a01-b960-23328b537283-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] No waiting events found dispatching network-vif-plugged-39bb24a8-37e5-43fc-839b-203634b56ad6 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:46:45 user nova-compute[74996]: WARNING nova.compute.manager [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Received unexpected event network-vif-plugged-39bb24a8-37e5-43fc-839b-203634b56ad6 for instance with vm_state active and task_state deleting.
Nov 02 01:46:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Received event network-vif-plugged-39bb24a8-37e5-43fc-839b-203634b56ad6 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] Acquiring lock "3b5719c9-08ad-4a01-b960-23328b537283-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] Lock "3b5719c9-08ad-4a01-b960-23328b537283-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] Lock "3b5719c9-08ad-4a01-b960-23328b537283-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] No waiting events found dispatching network-vif-plugged-39bb24a8-37e5-43fc-839b-203634b56ad6 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:46:45 user nova-compute[74996]: WARNING nova.compute.manager [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Received unexpected event network-vif-plugged-39bb24a8-37e5-43fc-839b-203634b56ad6 for instance with vm_state active and task_state deleting.
Nov 02 01:46:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Received event network-vif-unplugged-39bb24a8-37e5-43fc-839b-203634b56ad6 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] Acquiring lock "3b5719c9-08ad-4a01-b960-23328b537283-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] Lock "3b5719c9-08ad-4a01-b960-23328b537283-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] Lock "3b5719c9-08ad-4a01-b960-23328b537283-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] No waiting events found dispatching network-vif-unplugged-39bb24a8-37e5-43fc-839b-203634b56ad6 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Received event network-vif-unplugged-39bb24a8-37e5-43fc-839b-203634b56ad6 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Received event network-vif-plugged-39bb24a8-37e5-43fc-839b-203634b56ad6 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] Acquiring lock "3b5719c9-08ad-4a01-b960-23328b537283-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] Lock "3b5719c9-08ad-4a01-b960-23328b537283-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] Lock "3b5719c9-08ad-4a01-b960-23328b537283-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] No waiting events found dispatching network-vif-plugged-39bb24a8-37e5-43fc-839b-203634b56ad6 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:46:45 user nova-compute[74996]: WARNING nova.compute.manager [req-3457ba46-147e-4354-aa21-9d2053314966 req-0da63cbf-852a-44b9-98fb-ae0195e4a480 service nova] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Received unexpected event network-vif-plugged-39bb24a8-37e5-43fc-839b-203634b56ad6 for instance with vm_state active and task_state deleting.
Nov 02 01:46:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:54 user nova-compute[74996]: INFO nova.compute.manager [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Took 8.48 seconds to detach 1 volumes for instance.
Nov 02 01:46:54 user nova-compute[74996]: DEBUG nova.compute.manager [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3b5719c9-08ad-4a01-b960-23328b537283] Deleting volume: 9c2c466a-1b32-4336-aae3-0dd383f2f59d {{(pid=74996) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 01:46:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:54 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:46:54 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:46:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:54 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Deleted allocations for instance 3b5719c9-08ad-4a01-b960-23328b537283
Nov 02 01:46:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-777ec219-9ca1-4097-b379-c263e0057a45 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "3b5719c9-08ad-4a01-b960-23328b537283" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.292s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "e38704a7-f8a0-482c-bd51-26a90d37b71d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:57 user nova-compute[74996]: DEBUG nova.compute.manager [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:46:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:58 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:46:58 user nova-compute[74996]: INFO nova.compute.claims [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Claim successful on node user
Nov 02 01:46:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:58 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:46:58 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:46:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:58 user nova-compute[74996]: DEBUG nova.compute.manager [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:46:58 user nova-compute[74996]: DEBUG nova.compute.manager [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:46:58 user nova-compute[74996]: DEBUG nova.network.neutron [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:46:58 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:46:58 user nova-compute[74996]: DEBUG nova.compute.manager [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:46:58 user nova-compute[74996]: DEBUG nova.compute.manager [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:46:58 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:46:58 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Creating image(s)
Nov 02 01:46:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "/opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "/opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "/opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.015s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:58 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:58 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.222s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:58 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:58 user nova-compute[74996]: DEBUG nova.compute.manager [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:46:59 user nova-compute[74996]: INFO nova.compute.claims [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Claim successful on node user
Nov 02 01:46:59 user nova-compute[74996]: DEBUG nova.policy [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '87e5cf8786fe44b5a5305f3be11d64c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89083c24ba475f9159a80fddfe9159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.188s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk 1073741824" returned: 0 in 0.074s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.237s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG nova.compute.manager [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Cannot resize image /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Ensure instance console log exists: /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG nova.compute.manager [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG nova.network.neutron [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:46:59 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:46:59 user nova-compute[74996]: DEBUG nova.compute.manager [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG nova.network.neutron [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Successfully created port: b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG nova.policy [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '87e5cf8786fe44b5a5305f3be11d64c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89083c24ba475f9159a80fddfe9159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG nova.compute.manager [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:46:59 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Creating image(s)
Nov 02 01:46:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "/opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "/opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:46:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.254s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Acquiring lock "f0de5980-334b-4654-8b1a-88c4c861aa49" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:00 user nova-compute[74996]: INFO nova.compute.manager [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Detaching volume 6d78e413-aba3-423c-a337-cede9e863e67
Nov 02 01:47:00 user nova-compute[74996]: INFO nova.virt.block_device [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Attempting to driver detach volume 6d78e413-aba3-423c-a337-cede9e863e67 from mountpoint /dev/vdb
Nov 02 01:47:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.225s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG nova.network.neutron [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Successfully created port: 391c1ab0-6a16-4d16-894f-a061aac3fc6a {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Attempting to detach device vdb from instance f0de5980-334b-4654-8b1a-88c4c861aa49 from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 01:47:00 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:47:00 user nova-compute[74996]:   <source dev="/dev/sdd"/>
Nov 02 01:47:00 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:47:00 user nova-compute[74996]:   <serial>6d78e413-aba3-423c-a337-cede9e863e67</serial>
Nov 02 01:47:00 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 01:47:00 user nova-compute[74996]: </disk>
Nov 02 01:47:00 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:47:00 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Successfully detached device vdb from instance f0de5980-334b-4654-8b1a-88c4c861aa49 from the persistent domain config.
Nov 02 01:47:00 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f0de5980-334b-4654-8b1a-88c4c861aa49 from the live domain config. {{(pid=74996) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 01:47:00 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:47:00 user nova-compute[74996]:   <source dev="/dev/sdd"/>
Nov 02 01:47:00 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:47:00 user nova-compute[74996]:   <serial>6d78e413-aba3-423c-a337-cede9e863e67</serial>
Nov 02 01:47:00 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 01:47:00 user nova-compute[74996]: </disk>
Nov 02 01:47:00 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk 1073741824" returned: 0 in 0.108s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.336s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG nova.network.neutron [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Successfully updated port: b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "refresh_cache-e38704a7-f8a0-482c-bd51-26a90d37b71d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquired lock "refresh_cache-e38704a7-f8a0-482c-bd51-26a90d37b71d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG nova.network.neutron [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG nova.compute.manager [req-e2e829a7-11a6-4f1c-bfd2-f953179e3468 req-a5425037-4b49-439b-af20-6ff63717c81e service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received event network-changed-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG nova.compute.manager [req-e2e829a7-11a6-4f1c-bfd2-f953179e3468 req-a5425037-4b49-439b-af20-6ff63717c81e service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Refreshing instance network info cache due to event network-changed-b5d6eb99-a00c-4440-98d6-6432b493f131. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-e2e829a7-11a6-4f1c-bfd2-f953179e3468 req-a5425037-4b49-439b-af20-6ff63717c81e service nova] Acquiring lock "refresh_cache-e38704a7-f8a0-482c-bd51-26a90d37b71d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.208s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG nova.network.neutron [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Cannot resize image /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Ensure instance console log exists: /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:00 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f0de5980-334b-4654-8b1a-88c4c861aa49 {{(pid=74996) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.network.neutron [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Updating instance_info_cache with network_info: [{"id": "b5d6eb99-a00c-4440-98d6-6432b493f131", "address": "fa:16:3e:67:64:10", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d6eb99-a0", "ovs_interfaceid": "b5d6eb99-a00c-4440-98d6-6432b493f131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Releasing lock "refresh_cache-e38704a7-f8a0-482c-bd51-26a90d37b71d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.compute.manager [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Instance network_info: |[{"id": "b5d6eb99-a00c-4440-98d6-6432b493f131", "address": "fa:16:3e:67:64:10", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d6eb99-a0", "ovs_interfaceid": "b5d6eb99-a00c-4440-98d6-6432b493f131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-e2e829a7-11a6-4f1c-bfd2-f953179e3468 req-a5425037-4b49-439b-af20-6ff63717c81e service nova] Acquired lock "refresh_cache-e38704a7-f8a0-482c-bd51-26a90d37b71d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.network.neutron [req-e2e829a7-11a6-4f1c-bfd2-f953179e3468 req-a5425037-4b49-439b-af20-6ff63717c81e service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Refreshing network info cache for port b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Start _get_guest_xml network_info=[{"id": "b5d6eb99-a00c-4440-98d6-6432b493f131", "address": "fa:16:3e:67:64:10", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d6eb99-a0", "ovs_interfaceid": "b5d6eb99-a00c-4440-98d6-6432b493f131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:47:01 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:47:01 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1755702352',display_name='tempest-ServerRescueNegativeTestJSON-server-1755702352',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1755702352',id=31,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d89083c24ba475f9159a80fddfe9159',ramdisk_id='',reservation_id='r-oqxxr67v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1433266011',owner_user_name='tempest-ServerRescueNegativeTestJSON-1433266011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:46:59Z,user_data=None,user_id='87e5cf8786fe44b5a5305f3be11d64c2',uuid=e38704a7-f8a0-482c-bd51-26a90d37b71d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5d6eb99-a00c-4440-98d6-6432b493f131", "address": "fa:16:3e:67:64:10", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d6eb99-a0", "ovs_interfaceid": "b5d6eb99-a00c-4440-98d6-6432b493f131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Converting VIF {"id": "b5d6eb99-a00c-4440-98d6-6432b493f131", "address": "fa:16:3e:67:64:10", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d6eb99-a0", "ovs_interfaceid": "b5d6eb99-a00c-4440-98d6-6432b493f131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:64:10,bridge_name='br-int',has_traffic_filtering=True,id=b5d6eb99-a00c-4440-98d6-6432b493f131,network=Network(81a443a7-0a10-4c81-9903-853291c58596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5d6eb99-a0') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.objects.instance [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lazy-loading 'pci_devices' on Instance uuid e38704a7-f8a0-482c-bd51-26a90d37b71d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.network.neutron [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Successfully updated port: 391c1ab0-6a16-4d16-894f-a061aac3fc6a {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:47:01 user nova-compute[74996]:   <uuid>e38704a7-f8a0-482c-bd51-26a90d37b71d</uuid>
Nov 02 01:47:01 user nova-compute[74996]:   <name>instance-0000001f</name>
Nov 02 01:47:01 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:47:01 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:47:01 user nova-compute[74996]:   <metadata>
Nov 02 01:47:01 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:47:01 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:47:01 user nova-compute[74996]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1755702352</nova:name>
Nov 02 01:47:01 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:47:01</nova:creationTime>
Nov 02 01:47:01 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:47:01 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:47:01 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:47:01 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:47:01 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:47:01 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:47:01 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:47:01 user nova-compute[74996]:       <nova:owner>
Nov 02 01:47:01 user nova-compute[74996]:         <nova:user uuid="87e5cf8786fe44b5a5305f3be11d64c2">tempest-ServerRescueNegativeTestJSON-1433266011-project-member</nova:user>
Nov 02 01:47:01 user nova-compute[74996]:         <nova:project uuid="6d89083c24ba475f9159a80fddfe9159">tempest-ServerRescueNegativeTestJSON-1433266011</nova:project>
Nov 02 01:47:01 user nova-compute[74996]:       </nova:owner>
Nov 02 01:47:01 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:47:01 user nova-compute[74996]:       <nova:ports>
Nov 02 01:47:01 user nova-compute[74996]:         <nova:port uuid="b5d6eb99-a00c-4440-98d6-6432b493f131">
Nov 02 01:47:01 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 01:47:01 user nova-compute[74996]:         </nova:port>
Nov 02 01:47:01 user nova-compute[74996]:       </nova:ports>
Nov 02 01:47:01 user nova-compute[74996]:     </nova:instance>
Nov 02 01:47:01 user nova-compute[74996]:   </metadata>
Nov 02 01:47:01 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:47:01 user nova-compute[74996]:     <system>
Nov 02 01:47:01 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:47:01 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:47:01 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:47:01 user nova-compute[74996]:       <entry name="serial">e38704a7-f8a0-482c-bd51-26a90d37b71d</entry>
Nov 02 01:47:01 user nova-compute[74996]:       <entry name="uuid">e38704a7-f8a0-482c-bd51-26a90d37b71d</entry>
Nov 02 01:47:01 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:47:01 user nova-compute[74996]:     </system>
Nov 02 01:47:01 user nova-compute[74996]:   </sysinfo>
Nov 02 01:47:01 user nova-compute[74996]:   <os>
Nov 02 01:47:01 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:47:01 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:47:01 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:47:01 user nova-compute[74996]:   </os>
Nov 02 01:47:01 user nova-compute[74996]:   <features>
Nov 02 01:47:01 user nova-compute[74996]:     <acpi/>
Nov 02 01:47:01 user nova-compute[74996]:     <apic/>
Nov 02 01:47:01 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:47:01 user nova-compute[74996]:   </features>
Nov 02 01:47:01 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:47:01 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:47:01 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:47:01 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:47:01 user nova-compute[74996]:   </clock>
Nov 02 01:47:01 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:47:01 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:47:01 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:47:01 user nova-compute[74996]:   </cpu>
Nov 02 01:47:01 user nova-compute[74996]:   <devices>
Nov 02 01:47:01 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:47:01 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:47:01 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk"/>
Nov 02 01:47:01 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:47:01 user nova-compute[74996]:     </disk>
Nov 02 01:47:01 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:47:01 user nova-compute[74996]:       <mac address="fa:16:3e:67:64:10"/>
Nov 02 01:47:01 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:47:01 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:47:01 user nova-compute[74996]:       <target dev="tapb5d6eb99-a0"/>
Nov 02 01:47:01 user nova-compute[74996]:     </interface>
Nov 02 01:47:01 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:47:01 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/console.log" append="off"/>
Nov 02 01:47:01 user nova-compute[74996]:     </serial>
Nov 02 01:47:01 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:47:01 user nova-compute[74996]:     <video>
Nov 02 01:47:01 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:47:01 user nova-compute[74996]:     </video>
Nov 02 01:47:01 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:47:01 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:47:01 user nova-compute[74996]:     </rng>
Nov 02 01:47:01 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:47:01 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:47:01 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:47:01 user nova-compute[74996]:     </memballoon>
Nov 02 01:47:01 user nova-compute[74996]:   </devices>
Nov 02 01:47:01 user nova-compute[74996]: </domain>
Nov 02 01:47:01 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1755702352',display_name='tempest-ServerRescueNegativeTestJSON-server-1755702352',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1755702352',id=31,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d89083c24ba475f9159a80fddfe9159',ramdisk_id='',reservation_id='r-oqxxr67v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1433266011',owner_user_name='tempest-ServerRescueNegativeTestJSON-1433266011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:46:59Z,user_data=None,user_id='87e5cf8786fe44b5a5305f3be11d64c2',uuid=e38704a7-f8a0-482c-bd51-26a90d37b71d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5d6eb99-a00c-4440-98d6-6432b493f131", "address": "fa:16:3e:67:64:10", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d6eb99-a0", "ovs_interfaceid": "b5d6eb99-a00c-4440-98d6-6432b493f131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Converting VIF {"id": "b5d6eb99-a00c-4440-98d6-6432b493f131", "address": "fa:16:3e:67:64:10", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d6eb99-a0", "ovs_interfaceid": "b5d6eb99-a00c-4440-98d6-6432b493f131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:64:10,bridge_name='br-int',has_traffic_filtering=True,id=b5d6eb99-a00c-4440-98d6-6432b493f131,network=Network(81a443a7-0a10-4c81-9903-853291c58596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5d6eb99-a0') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG os_vif [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:64:10,bridge_name='br-int',has_traffic_filtering=True,id=b5d6eb99-a00c-4440-98d6-6432b493f131,network=Network(81a443a7-0a10-4c81-9903-853291c58596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5d6eb99-a0') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "refresh_cache-7c53e6cc-cf69-485d-b24f-5e113dae0e5d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquired lock "refresh_cache-7c53e6cc-cf69-485d-b24f-5e113dae0e5d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.network.neutron [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '938a9fab-4220-50eb-8bfb-193d025789de', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5d6eb99-a0, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb5d6eb99-a0, col_values=(('qos', UUID('60f507ca-da06-4e72-b3d2-6de62c3b06d6')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb5d6eb99-a0, col_values=(('external_ids', {'iface-id': 'b5d6eb99-a00c-4440-98d6-6432b493f131', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:64:10', 'vm-uuid': 'e38704a7-f8a0-482c-bd51-26a90d37b71d'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.compute.manager [req-d0a784aa-3216-4d72-a098-5f386290c8e9 req-fa5bb408-0b49-4abe-af58-daebb5e40d03 service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Received event network-changed-391c1ab0-6a16-4d16-894f-a061aac3fc6a {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.compute.manager [req-d0a784aa-3216-4d72-a098-5f386290c8e9 req-fa5bb408-0b49-4abe-af58-daebb5e40d03 service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Refreshing instance network info cache due to event network-changed-391c1ab0-6a16-4d16-894f-a061aac3fc6a. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d0a784aa-3216-4d72-a098-5f386290c8e9 req-fa5bb408-0b49-4abe-af58-daebb5e40d03 service nova] Acquiring lock "refresh_cache-7c53e6cc-cf69-485d-b24f-5e113dae0e5d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:01 user nova-compute[74996]: INFO os_vif [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:64:10,bridge_name='br-int',has_traffic_filtering=True,id=b5d6eb99-a00c-4440-98d6-6432b493f131,network=Network(81a443a7-0a10-4c81-9903-853291c58596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5d6eb99-a0')
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.network.neutron [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] No VIF found with MAC fa:16:3e:67:64:10, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.network.neutron [req-e2e829a7-11a6-4f1c-bfd2-f953179e3468 req-a5425037-4b49-439b-af20-6ff63717c81e service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Updated VIF entry in instance network info cache for port b5d6eb99-a00c-4440-98d6-6432b493f131. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.network.neutron [req-e2e829a7-11a6-4f1c-bfd2-f953179e3468 req-a5425037-4b49-439b-af20-6ff63717c81e service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Updating instance_info_cache with network_info: [{"id": "b5d6eb99-a00c-4440-98d6-6432b493f131", "address": "fa:16:3e:67:64:10", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d6eb99-a0", "ovs_interfaceid": "b5d6eb99-a00c-4440-98d6-6432b493f131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.network.neutron [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Updating instance_info_cache with network_info: [{"id": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "address": "fa:16:3e:9b:c8:b7", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391c1ab0-6a", "ovs_interfaceid": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-e2e829a7-11a6-4f1c-bfd2-f953179e3468 req-a5425037-4b49-439b-af20-6ff63717c81e service nova] Releasing lock "refresh_cache-e38704a7-f8a0-482c-bd51-26a90d37b71d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Releasing lock "refresh_cache-7c53e6cc-cf69-485d-b24f-5e113dae0e5d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.compute.manager [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Instance network_info: |[{"id": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "address": "fa:16:3e:9b:c8:b7", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391c1ab0-6a", "ovs_interfaceid": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d0a784aa-3216-4d72-a098-5f386290c8e9 req-fa5bb408-0b49-4abe-af58-daebb5e40d03 service nova] Acquired lock "refresh_cache-7c53e6cc-cf69-485d-b24f-5e113dae0e5d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.network.neutron [req-d0a784aa-3216-4d72-a098-5f386290c8e9 req-fa5bb408-0b49-4abe-af58-daebb5e40d03 service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Refreshing network info cache for port 391c1ab0-6a16-4d16-894f-a061aac3fc6a {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Start _get_guest_xml network_info=[{"id": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "address": "fa:16:3e:9b:c8:b7", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391c1ab0-6a", "ovs_interfaceid": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:47:01 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:47:01 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1398759994',display_name='tempest-ServerRescueNegativeTestJSON-server-1398759994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1398759994',id=32,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d89083c24ba475f9159a80fddfe9159',ramdisk_id='',reservation_id='r-5l3af2z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1433266011',owner_user_name='tempest-ServerRescueNegativeTestJSON-1433266011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:47:00Z,user_data=None,user_id='87e5cf8786fe44b5a5305f3be11d64c2',uuid=7c53e6cc-cf69-485d-b24f-5e113dae0e5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "address": "fa:16:3e:9b:c8:b7", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391c1ab0-6a", "ovs_interfaceid": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Converting VIF {"id": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "address": "fa:16:3e:9b:c8:b7", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391c1ab0-6a", "ovs_interfaceid": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c8:b7,bridge_name='br-int',has_traffic_filtering=True,id=391c1ab0-6a16-4d16-894f-a061aac3fc6a,network=Network(81a443a7-0a10-4c81-9903-853291c58596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391c1ab0-6a') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.objects.instance [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c53e6cc-cf69-485d-b24f-5e113dae0e5d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:47:01 user nova-compute[74996]:   <uuid>7c53e6cc-cf69-485d-b24f-5e113dae0e5d</uuid>
Nov 02 01:47:01 user nova-compute[74996]:   <name>instance-00000020</name>
Nov 02 01:47:01 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:47:01 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:47:01 user nova-compute[74996]:   <metadata>
Nov 02 01:47:01 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:47:01 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:47:01 user nova-compute[74996]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1398759994</nova:name>
Nov 02 01:47:01 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:47:01</nova:creationTime>
Nov 02 01:47:01 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:47:01 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:47:01 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:47:01 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:47:01 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:47:01 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:47:01 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:47:01 user nova-compute[74996]:       <nova:owner>
Nov 02 01:47:01 user nova-compute[74996]:         <nova:user uuid="87e5cf8786fe44b5a5305f3be11d64c2">tempest-ServerRescueNegativeTestJSON-1433266011-project-member</nova:user>
Nov 02 01:47:01 user nova-compute[74996]:         <nova:project uuid="6d89083c24ba475f9159a80fddfe9159">tempest-ServerRescueNegativeTestJSON-1433266011</nova:project>
Nov 02 01:47:01 user nova-compute[74996]:       </nova:owner>
Nov 02 01:47:01 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:47:01 user nova-compute[74996]:       <nova:ports>
Nov 02 01:47:01 user nova-compute[74996]:         <nova:port uuid="391c1ab0-6a16-4d16-894f-a061aac3fc6a">
Nov 02 01:47:01 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 02 01:47:01 user nova-compute[74996]:         </nova:port>
Nov 02 01:47:01 user nova-compute[74996]:       </nova:ports>
Nov 02 01:47:01 user nova-compute[74996]:     </nova:instance>
Nov 02 01:47:01 user nova-compute[74996]:   </metadata>
Nov 02 01:47:01 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:47:01 user nova-compute[74996]:     <system>
Nov 02 01:47:01 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:47:01 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:47:01 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:47:01 user nova-compute[74996]:       <entry name="serial">7c53e6cc-cf69-485d-b24f-5e113dae0e5d</entry>
Nov 02 01:47:01 user nova-compute[74996]:       <entry name="uuid">7c53e6cc-cf69-485d-b24f-5e113dae0e5d</entry>
Nov 02 01:47:01 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:47:01 user nova-compute[74996]:     </system>
Nov 02 01:47:01 user nova-compute[74996]:   </sysinfo>
Nov 02 01:47:01 user nova-compute[74996]:   <os>
Nov 02 01:47:01 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:47:01 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:47:01 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:47:01 user nova-compute[74996]:   </os>
Nov 02 01:47:01 user nova-compute[74996]:   <features>
Nov 02 01:47:01 user nova-compute[74996]:     <acpi/>
Nov 02 01:47:01 user nova-compute[74996]:     <apic/>
Nov 02 01:47:01 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:47:01 user nova-compute[74996]:   </features>
Nov 02 01:47:01 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:47:01 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:47:01 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:47:01 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:47:01 user nova-compute[74996]:   </clock>
Nov 02 01:47:01 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:47:01 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:47:01 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:47:01 user nova-compute[74996]:   </cpu>
Nov 02 01:47:01 user nova-compute[74996]:   <devices>
Nov 02 01:47:01 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:47:01 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:47:01 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk"/>
Nov 02 01:47:01 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:47:01 user nova-compute[74996]:     </disk>
Nov 02 01:47:01 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:47:01 user nova-compute[74996]:       <mac address="fa:16:3e:9b:c8:b7"/>
Nov 02 01:47:01 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:47:01 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:47:01 user nova-compute[74996]:       <target dev="tap391c1ab0-6a"/>
Nov 02 01:47:01 user nova-compute[74996]:     </interface>
Nov 02 01:47:01 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:47:01 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/console.log" append="off"/>
Nov 02 01:47:01 user nova-compute[74996]:     </serial>
Nov 02 01:47:01 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:47:01 user nova-compute[74996]:     <video>
Nov 02 01:47:01 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:47:01 user nova-compute[74996]:     </video>
Nov 02 01:47:01 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:47:01 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:47:01 user nova-compute[74996]:     </rng>
Nov 02 01:47:01 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:47:01 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:47:01 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:47:01 user nova-compute[74996]:     </memballoon>
Nov 02 01:47:01 user nova-compute[74996]:   </devices>
Nov 02 01:47:01 user nova-compute[74996]: </domain>
Nov 02 01:47:01 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1398759994',display_name='tempest-ServerRescueNegativeTestJSON-server-1398759994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1398759994',id=32,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d89083c24ba475f9159a80fddfe9159',ramdisk_id='',reservation_id='r-5l3af2z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1433266011',owner_user_name='tempest-ServerRescueNegativeTestJSON-1433266011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:47:00Z,user_data=None,user_id='87e5cf8786fe44b5a5305f3be11d64c2',uuid=7c53e6cc-cf69-485d-b24f-5e113dae0e5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "address": "fa:16:3e:9b:c8:b7", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391c1ab0-6a", "ovs_interfaceid": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Converting VIF {"id": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "address": "fa:16:3e:9b:c8:b7", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391c1ab0-6a", "ovs_interfaceid": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c8:b7,bridge_name='br-int',has_traffic_filtering=True,id=391c1ab0-6a16-4d16-894f-a061aac3fc6a,network=Network(81a443a7-0a10-4c81-9903-853291c58596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391c1ab0-6a') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG os_vif [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c8:b7,bridge_name='br-int',has_traffic_filtering=True,id=391c1ab0-6a16-4d16-894f-a061aac3fc6a,network=Network(81a443a7-0a10-4c81-9903-853291c58596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391c1ab0-6a') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db0faa4e-0d8f-5a01-a2c8-7b69fff1420b', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap391c1ab0-6a, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap391c1ab0-6a, col_values=(('qos', UUID('8bb4d42b-c216-49ec-9a21-b3dc00353249')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap391c1ab0-6a, col_values=(('external_ids', {'iface-id': '391c1ab0-6a16-4d16-894f-a061aac3fc6a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:c8:b7', 'vm-uuid': '7c53e6cc-cf69-485d-b24f-5e113dae0e5d'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:01 user nova-compute[74996]: INFO os_vif [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c8:b7,bridge_name='br-int',has_traffic_filtering=True,id=391c1ab0-6a16-4d16-894f-a061aac3fc6a,network=Network(81a443a7-0a10-4c81-9903-853291c58596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391c1ab0-6a')
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:47:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] No VIF found with MAC fa:16:3e:9b:c8:b7, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:47:02 user nova-compute[74996]: DEBUG nova.network.neutron [req-d0a784aa-3216-4d72-a098-5f386290c8e9 req-fa5bb408-0b49-4abe-af58-daebb5e40d03 service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Updated VIF entry in instance network info cache for port 391c1ab0-6a16-4d16-894f-a061aac3fc6a. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:47:02 user nova-compute[74996]: DEBUG nova.network.neutron [req-d0a784aa-3216-4d72-a098-5f386290c8e9 req-fa5bb408-0b49-4abe-af58-daebb5e40d03 service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Updating instance_info_cache with network_info: [{"id": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "address": "fa:16:3e:9b:c8:b7", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391c1ab0-6a", "ovs_interfaceid": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:47:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d0a784aa-3216-4d72-a098-5f386290c8e9 req-fa5bb408-0b49-4abe-af58-daebb5e40d03 service nova] Releasing lock "refresh_cache-7c53e6cc-cf69-485d-b24f-5e113dae0e5d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:47:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Acquiring lock "effec7f0-1006-4081-91f4-e2d96fd0a87a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "effec7f0-1006-4081-91f4-e2d96fd0a87a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:02 user nova-compute[74996]: INFO nova.compute.manager [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Unshelving
Nov 02 01:47:02 user nova-compute[74996]: INFO nova.virt.block_device [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Booting with volume 5b222ba0-7f5f-4d31-acb2-79257672c494 at /dev/vda
Nov 02 01:47:02 user nova-compute[74996]: DEBUG os_brick.utils [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:47:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:02 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd16053-5e08-4749-8504-892341ce3dbd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:02 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a868b2-03cf-4f81-9a49-d6d2f320bcb9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:03 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:03 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75ab69d-e319-4ce3-a197-2a7602faa51e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:03 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbbfb7d-966a-4a99-b4ed-a613725caf03]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:03 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:03 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:47:03 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:47:03 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:03 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:47:03 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:47:03 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c99b6e-abc2-488e-9e25-29af16536989]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:03 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:47:03 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:47:03 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:47:03 user nova-compute[74996]: DEBUG os_brick.utils [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:47:03 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Updating existing volume attachment record: 4655d4f6-7139-4a31-833f-1a468f92d315 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:47:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:03 user nova-compute[74996]: DEBUG nova.compute.manager [req-8ddccda4-42bb-4d40-9629-1ff4e8bbcef9 req-b281cda1-2bbb-4ed1-8ca4-bfba233c544f service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received event network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:47:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8ddccda4-42bb-4d40-9629-1ff4e8bbcef9 req-b281cda1-2bbb-4ed1-8ca4-bfba233c544f service nova] Acquiring lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8ddccda4-42bb-4d40-9629-1ff4e8bbcef9 req-b281cda1-2bbb-4ed1-8ca4-bfba233c544f service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8ddccda4-42bb-4d40-9629-1ff4e8bbcef9 req-b281cda1-2bbb-4ed1-8ca4-bfba233c544f service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:03 user nova-compute[74996]: DEBUG nova.compute.manager [req-8ddccda4-42bb-4d40-9629-1ff4e8bbcef9 req-b281cda1-2bbb-4ed1-8ca4-bfba233c544f service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] No waiting events found dispatching network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:47:03 user nova-compute[74996]: WARNING nova.compute.manager [req-8ddccda4-42bb-4d40-9629-1ff4e8bbcef9 req-b281cda1-2bbb-4ed1-8ca4-bfba233c544f service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received unexpected event network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 for instance with vm_state building and task_state spawning.
Nov 02 01:47:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:04 user nova-compute[74996]: DEBUG nova.compute.manager [req-6f31ad9f-a63c-4953-a134-033de24aa3a7 req-5f653ff1-0c15-4d18-a4c2-4d40c99b932c service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Received event network-vif-plugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:47:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6f31ad9f-a63c-4953-a134-033de24aa3a7 req-5f653ff1-0c15-4d18-a4c2-4d40c99b932c service nova] Acquiring lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6f31ad9f-a63c-4953-a134-033de24aa3a7 req-5f653ff1-0c15-4d18-a4c2-4d40c99b932c service nova] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6f31ad9f-a63c-4953-a134-033de24aa3a7 req-5f653ff1-0c15-4d18-a4c2-4d40c99b932c service nova] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:04 user nova-compute[74996]: DEBUG nova.compute.manager [req-6f31ad9f-a63c-4953-a134-033de24aa3a7 req-5f653ff1-0c15-4d18-a4c2-4d40c99b932c service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] No waiting events found dispatching network-vif-plugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:47:04 user nova-compute[74996]: WARNING nova.compute.manager [req-6f31ad9f-a63c-4953-a134-033de24aa3a7 req-5f653ff1-0c15-4d18-a4c2-4d40c99b932c service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Received unexpected event network-vif-plugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a for instance with vm_state building and task_state spawning.
Nov 02 01:47:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG nova.compute.manager [req-57b84f3c-594f-47e0-bf51-a191c89a9f15 req-45c2f081-6487-4cd9-80fd-e115f6461813 service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received event network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-57b84f3c-594f-47e0-bf51-a191c89a9f15 req-45c2f081-6487-4cd9-80fd-e115f6461813 service nova] Acquiring lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-57b84f3c-594f-47e0-bf51-a191c89a9f15 req-45c2f081-6487-4cd9-80fd-e115f6461813 service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-57b84f3c-594f-47e0-bf51-a191c89a9f15 req-45c2f081-6487-4cd9-80fd-e115f6461813 service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG nova.compute.manager [req-57b84f3c-594f-47e0-bf51-a191c89a9f15 req-45c2f081-6487-4cd9-80fd-e115f6461813 service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] No waiting events found dispatching network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:47:06 user nova-compute[74996]: WARNING nova.compute.manager [req-57b84f3c-594f-47e0-bf51-a191c89a9f15 req-45c2f081-6487-4cd9-80fd-e115f6461813 service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received unexpected event network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 for instance with vm_state building and task_state spawning.
Nov 02 01:47:06 user nova-compute[74996]: DEBUG nova.compute.manager [req-da4ef310-e4ca-4bfb-b4c1-3ff5b7810be6 req-78936d96-4c1b-439f-82bd-a69a076679a6 service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Received event network-vif-plugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-da4ef310-e4ca-4bfb-b4c1-3ff5b7810be6 req-78936d96-4c1b-439f-82bd-a69a076679a6 service nova] Acquiring lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-da4ef310-e4ca-4bfb-b4c1-3ff5b7810be6 req-78936d96-4c1b-439f-82bd-a69a076679a6 service nova] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-da4ef310-e4ca-4bfb-b4c1-3ff5b7810be6 req-78936d96-4c1b-439f-82bd-a69a076679a6 service nova] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG nova.compute.manager [req-da4ef310-e4ca-4bfb-b4c1-3ff5b7810be6 req-78936d96-4c1b-439f-82bd-a69a076679a6 service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] No waiting events found dispatching network-vif-plugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:47:06 user nova-compute[74996]: WARNING nova.compute.manager [req-da4ef310-e4ca-4bfb-b4c1-3ff5b7810be6 req-78936d96-4c1b-439f-82bd-a69a076679a6 service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Received unexpected event network-vif-plugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a for instance with vm_state building and task_state spawning.
Nov 02 01:47:06 user nova-compute[74996]: DEBUG nova.compute.manager [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:47:06 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Instance spawned successfully.
Nov 02 01:47:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG nova.compute.manager [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:47:06 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Instance spawned successfully.
Nov 02 01:47:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e6e6beb4-e742-4e36-a294-3b16bec89663 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "7307f3a3-1ad1-43f7-be49-9cd03a626cd7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e6e6beb4-e742-4e36-a294-3b16bec89663 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "7307f3a3-1ad1-43f7-be49-9cd03a626cd7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e6e6beb4-e742-4e36-a294-3b16bec89663 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "7307f3a3-1ad1-43f7-be49-9cd03a626cd7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e6e6beb4-e742-4e36-a294-3b16bec89663 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "7307f3a3-1ad1-43f7-be49-9cd03a626cd7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e6e6beb4-e742-4e36-a294-3b16bec89663 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "7307f3a3-1ad1-43f7-be49-9cd03a626cd7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:06 user nova-compute[74996]: INFO nova.compute.manager [None req-e6e6beb4-e742-4e36-a294-3b16bec89663 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Terminating instance
Nov 02 01:47:06 user nova-compute[74996]: DEBUG nova.compute.manager [None req-e6e6beb4-e742-4e36-a294-3b16bec89663 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:47:06 user nova-compute[74996]: INFO nova.compute.manager [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Took 8.22 seconds to spawn the instance on the hypervisor.
Nov 02 01:47:06 user nova-compute[74996]: DEBUG nova.compute.manager [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:06 user nova-compute[74996]: INFO nova.compute.manager [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Took 7.15 seconds to spawn the instance on the hypervisor.
Nov 02 01:47:06 user nova-compute[74996]: DEBUG nova.compute.manager [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:47:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:07 user nova-compute[74996]: INFO nova.compute.manager [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Took 9.01 seconds to build instance.
Nov 02 01:47:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9ad24b1f-b7fb-446b-ae07-6d726c511a66 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.137s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:07 user nova-compute[74996]: INFO nova.compute.manager [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Took 8.12 seconds to build instance.
Nov 02 01:47:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c2701b40-66dc-4850-a4de-8ef85ec1a73c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.276s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:07 user nova-compute[74996]: DEBUG nova.compute.manager [req-2d8fa768-dbe8-41b5-b0c3-bba2978dd72a req-5681af86-5557-4f13-9dcf-10aa1b5937dd service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Received event network-vif-unplugged-b645a26c-6fae-4cfc-97ee-951a1cf5aec9 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:47:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2d8fa768-dbe8-41b5-b0c3-bba2978dd72a req-5681af86-5557-4f13-9dcf-10aa1b5937dd service nova] Acquiring lock "7307f3a3-1ad1-43f7-be49-9cd03a626cd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2d8fa768-dbe8-41b5-b0c3-bba2978dd72a req-5681af86-5557-4f13-9dcf-10aa1b5937dd service nova] Lock "7307f3a3-1ad1-43f7-be49-9cd03a626cd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2d8fa768-dbe8-41b5-b0c3-bba2978dd72a req-5681af86-5557-4f13-9dcf-10aa1b5937dd service nova] Lock "7307f3a3-1ad1-43f7-be49-9cd03a626cd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:07 user nova-compute[74996]: DEBUG nova.compute.manager [req-2d8fa768-dbe8-41b5-b0c3-bba2978dd72a req-5681af86-5557-4f13-9dcf-10aa1b5937dd service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] No waiting events found dispatching network-vif-unplugged-b645a26c-6fae-4cfc-97ee-951a1cf5aec9 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:47:07 user nova-compute[74996]: DEBUG nova.compute.manager [req-2d8fa768-dbe8-41b5-b0c3-bba2978dd72a req-5681af86-5557-4f13-9dcf-10aa1b5937dd service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Received event network-vif-unplugged-b645a26c-6fae-4cfc-97ee-951a1cf5aec9 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:47:07 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Instance destroyed successfully.
Nov 02 01:47:07 user nova-compute[74996]: DEBUG nova.objects.instance [None req-e6e6beb4-e742-4e36-a294-3b16bec89663 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lazy-loading 'resources' on Instance uuid 7307f3a3-1ad1-43f7-be49-9cd03a626cd7 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:47:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-e6e6beb4-e742-4e36-a294-3b16bec89663 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:29:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1659521124',display_name='tempest-ServerActionsTestOtherA-server-1659521124',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1659521124',id=4,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuGPSdhZpoJV1Cta3eTfZjI1QRYRGe6Y8DzUdNt6ZIoysubzlLd36OVzphJd/MOKltwOpW5QoJYEARWlOQfh2pk3msvJuTgQKOLlFS0wLTIMWMdtr2LMQxjw6cacUWITQ==',key_name='tempest-keypair-1376755092',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:29:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f462793d4eb4433c9c27d92f80518db1',ramdisk_id='',reservation_id='r-rkqoqdgr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-852070362',owner_user_name='tempest-ServerActionsTestOtherA-852070362-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:29:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0ac87391a0140ba83743c0a2cd193fe',uuid=7307f3a3-1ad1-43f7-be49-9cd03a626cd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "address": "fa:16:3e:97:27:02", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb645a26c-6f", "ovs_interfaceid": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:47:07 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-e6e6beb4-e742-4e36-a294-3b16bec89663 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Converting VIF {"id": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "address": "fa:16:3e:97:27:02", "network": {"id": "399a4737-f7b2-43b7-95a6-50f96478ccd4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1218986437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462793d4eb4433c9c27d92f80518db1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb645a26c-6f", "ovs_interfaceid": "b645a26c-6fae-4cfc-97ee-951a1cf5aec9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:47:07 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-e6e6beb4-e742-4e36-a294-3b16bec89663 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:27:02,bridge_name='br-int',has_traffic_filtering=True,id=b645a26c-6fae-4cfc-97ee-951a1cf5aec9,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb645a26c-6f') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:47:07 user nova-compute[74996]: DEBUG os_vif [None req-e6e6beb4-e742-4e36-a294-3b16bec89663 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:27:02,bridge_name='br-int',has_traffic_filtering=True,id=b645a26c-6fae-4cfc-97ee-951a1cf5aec9,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb645a26c-6f') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:47:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb645a26c-6f, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:47:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0be50e7f-4352-4839-88f0-4218905f4c9a) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:47:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:07 user nova-compute[74996]: INFO os_vif [None req-e6e6beb4-e742-4e36-a294-3b16bec89663 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:27:02,bridge_name='br-int',has_traffic_filtering=True,id=b645a26c-6fae-4cfc-97ee-951a1cf5aec9,network=Network(399a4737-f7b2-43b7-95a6-50f96478ccd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb645a26c-6f')
Nov 02 01:47:07 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-e6e6beb4-e742-4e36-a294-3b16bec89663 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Deleting instance files /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7_del
Nov 02 01:47:07 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-e6e6beb4-e742-4e36-a294-3b16bec89663 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Deletion of /opt/stack/data/nova/instances/7307f3a3-1ad1-43f7-be49-9cd03a626cd7_del complete
Nov 02 01:47:07 user nova-compute[74996]: INFO nova.compute.manager [None req-e6e6beb4-e742-4e36-a294-3b16bec89663 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 02 01:47:07 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-e6e6beb4-e742-4e36-a294-3b16bec89663 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:47:07 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:47:07 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:47:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:08 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:47:08 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Took 0.69 seconds to deallocate network for instance.
Nov 02 01:47:08 user nova-compute[74996]: DEBUG nova.compute.manager [req-949a8d96-71a2-491d-9751-61692d10a422 req-7d7311e7-7dfd-44de-b003-1f9f9c416802 service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Received event network-vif-deleted-b645a26c-6fae-4cfc-97ee-951a1cf5aec9 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:47:08 user nova-compute[74996]: INFO nova.compute.manager [req-949a8d96-71a2-491d-9751-61692d10a422 req-7d7311e7-7dfd-44de-b003-1f9f9c416802 service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Neutron deleted interface b645a26c-6fae-4cfc-97ee-951a1cf5aec9; detaching it from the instance and deleting it from the info cache
Nov 02 01:47:08 user nova-compute[74996]: DEBUG nova.network.neutron [req-949a8d96-71a2-491d-9751-61692d10a422 req-7d7311e7-7dfd-44de-b003-1f9f9c416802 service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:47:08 user nova-compute[74996]: DEBUG nova.compute.manager [req-949a8d96-71a2-491d-9751-61692d10a422 req-7d7311e7-7dfd-44de-b003-1f9f9c416802 service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Detach interface failed, port_id=b645a26c-6fae-4cfc-97ee-951a1cf5aec9, reason: Instance 7307f3a3-1ad1-43f7-be49-9cd03a626cd7 could not be found. {{(pid=74996) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 01:47:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e6e6beb4-e742-4e36-a294-3b16bec89663 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e6e6beb4-e742-4e36-a294-3b16bec89663 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:09 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-e6e6beb4-e742-4e36-a294-3b16bec89663 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:47:09 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-e6e6beb4-e742-4e36-a294-3b16bec89663 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:47:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e6e6beb4-e742-4e36-a294-3b16bec89663 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.627s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:09 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-e6e6beb4-e742-4e36-a294-3b16bec89663 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Deleted allocations for instance 7307f3a3-1ad1-43f7-be49-9cd03a626cd7
Nov 02 01:47:09 user nova-compute[74996]: DEBUG nova.compute.manager [req-d84877a6-9816-47a9-a267-a968c75e3485 req-1ed5c9d8-e4ed-4a23-b48b-ec85b17d9e72 service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Received event network-vif-plugged-b645a26c-6fae-4cfc-97ee-951a1cf5aec9 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:47:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d84877a6-9816-47a9-a267-a968c75e3485 req-1ed5c9d8-e4ed-4a23-b48b-ec85b17d9e72 service nova] Acquiring lock "7307f3a3-1ad1-43f7-be49-9cd03a626cd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d84877a6-9816-47a9-a267-a968c75e3485 req-1ed5c9d8-e4ed-4a23-b48b-ec85b17d9e72 service nova] Lock "7307f3a3-1ad1-43f7-be49-9cd03a626cd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d84877a6-9816-47a9-a267-a968c75e3485 req-1ed5c9d8-e4ed-4a23-b48b-ec85b17d9e72 service nova] Lock "7307f3a3-1ad1-43f7-be49-9cd03a626cd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:09 user nova-compute[74996]: DEBUG nova.compute.manager [req-d84877a6-9816-47a9-a267-a968c75e3485 req-1ed5c9d8-e4ed-4a23-b48b-ec85b17d9e72 service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] No waiting events found dispatching network-vif-plugged-b645a26c-6fae-4cfc-97ee-951a1cf5aec9 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:47:09 user nova-compute[74996]: WARNING nova.compute.manager [req-d84877a6-9816-47a9-a267-a968c75e3485 req-1ed5c9d8-e4ed-4a23-b48b-ec85b17d9e72 service nova] [instance: 7307f3a3-1ad1-43f7-be49-9cd03a626cd7] Received unexpected event network-vif-plugged-b645a26c-6fae-4cfc-97ee-951a1cf5aec9 for instance with vm_state deleted and task_state None.
Nov 02 01:47:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e6e6beb4-e742-4e36-a294-3b16bec89663 tempest-ServerActionsTestOtherA-852070362 tempest-ServerActionsTestOtherA-852070362-project-member] Lock "7307f3a3-1ad1-43f7-be49-9cd03a626cd7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.499s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:16 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:19 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:47:19 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:47:20 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f0de5980-334b-4654-8b1a-88c4c861aa49 is timed out.
Nov 02 01:47:20 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Successfully detached device vdb from instance f0de5980-334b-4654-8b1a-88c4c861aa49 from the live domain config.
Nov 02 01:47:20 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:47:20 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPqMJDGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:47:20 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:47:20 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:47:20 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:47:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:20 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1432c4-717c-4521-8e46-0d1f216ec589]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:20 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:47:20 user nova-compute[74996]: No targets found.
Nov 02 01:47:20 user nova-compute[74996]: iSNS:
Nov 02 01:47:20 user nova-compute[74996]: No targets found.
Nov 02 01:47:20 user nova-compute[74996]: STATIC:
Nov 02 01:47:20 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67
Nov 02 01:47:20 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:47:20 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:47:20 user nova-compute[74996]: FIRMWARE:
Nov 02 01:47:20 user nova-compute[74996]: No targets found.
Nov 02 01:47:20 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:47:20 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:47:20 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:47:20 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:47:20 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:47:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:20 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d377488f-6d61-44c7-aa93-67aaccc0294d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:20 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[750fb199-bf52-4d6a-bedb-26ae918a9be2]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:20 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)
Nov 02 01:47:20 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:47:20 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 (non-flash)
Nov 02 01:47:20 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:47:20 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e852c160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67'): ({'sdd'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:47:20 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Removing single pathed devices sdd {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:47:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[62849de2-aa12-44b9-85a4-b20693921cce]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8640cc8f-dc58-487c-ba71-7ea564c2c2cd]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Flushing IO for device /dev/sdd {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbda0303-cc99-4117-9e7f-e3475dc7da5b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a079ff03-7777-4627-9a8d-e6639ba5b687]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] SCSI volumes sdd have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ff7e5a-3fd0-4843-80a7-febe3398f9b0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e5f762-1810-4a7f-833e-9e3c2442a421]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67, portal: 172.16.0.220,3260]
Nov 02 01:47:21 user nova-compute[74996]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67, portal: 172.16.0.220,3260] successful.
Nov 02 01:47:21 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d78e413-aba3-423c-a337-cede9e863e67 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4092a40a-8d4c-4c55-8d3c-df2a495a6bad]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] <== disconnect_volume: return (352ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:47:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:47:22 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:47:22 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:47:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:22 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:47:22 user nova-compute[74996]: DEBUG nova.objects.instance [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lazy-loading 'flavor' on Instance uuid f0de5980-334b-4654-8b1a-88c4c861aa49 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:47:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1e0be908-26d3-48ca-8627-0206a3eb6b81 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.178s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd1c257-2903-47ce-bd31-a00ba6a8b9df/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd1c257-2903-47ce-bd31-a00ba6a8b9df/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd1c257-2903-47ce-bd31-a00ba6a8b9df/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd1c257-2903-47ce-bd31-a00ba6a8b9df/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:24 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:47:24 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:47:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8117MB free_disk=25.130355834960938GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:47:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:25 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance f0de5980-334b-4654-8b1a-88c4c861aa49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:47:25 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 1fd1c257-2903-47ce-bd31-a00ba6a8b9df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:47:25 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance e38704a7-f8a0-482c-bd51-26a90d37b71d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:47:25 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7c53e6cc-cf69-485d-b24f-5e113dae0e5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:47:25 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance effec7f0-1006-4081-91f4-e2d96fd0a87a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 02 01:47:25 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:47:25 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:47:25 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:47:25 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:47:25 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:47:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.412s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.360s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:25 user nova-compute[74996]: DEBUG nova.objects.instance [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lazy-loading 'pci_requests' on Instance uuid effec7f0-1006-4081-91f4-e2d96fd0a87a {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:47:25 user nova-compute[74996]: DEBUG nova.objects.instance [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lazy-loading 'numa_topology' on Instance uuid effec7f0-1006-4081-91f4-e2d96fd0a87a {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:47:25 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:47:25 user nova-compute[74996]: INFO nova.compute.claims [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Claim successful on node user
Nov 02 01:47:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:25 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:47:25 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:47:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:25 user nova-compute[74996]: INFO nova.network.neutron [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Updating port 8cf50e3d-3da4-48fc-9cc9-bfe88441b531 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 02 01:47:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Acquiring lock "refresh_cache-effec7f0-1006-4081-91f4-e2d96fd0a87a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:47:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Acquired lock "refresh_cache-effec7f0-1006-4081-91f4-e2d96fd0a87a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:47:26 user nova-compute[74996]: DEBUG nova.network.neutron [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:47:26 user nova-compute[74996]: DEBUG nova.compute.manager [req-93258a39-4ad7-4547-a2c7-0c9e5178fe1c req-32320932-79a7-4bc2-b4df-13b628524a16 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Received event network-changed-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:47:26 user nova-compute[74996]: DEBUG nova.compute.manager [req-93258a39-4ad7-4547-a2c7-0c9e5178fe1c req-32320932-79a7-4bc2-b4df-13b628524a16 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Refreshing instance network info cache due to event network-changed-8cf50e3d-3da4-48fc-9cc9-bfe88441b531. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:47:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-93258a39-4ad7-4547-a2c7-0c9e5178fe1c req-32320932-79a7-4bc2-b4df-13b628524a16 service nova] Acquiring lock "refresh_cache-effec7f0-1006-4081-91f4-e2d96fd0a87a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:47:26 user nova-compute[74996]: DEBUG nova.network.neutron [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Updating instance_info_cache with network_info: [{"id": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "address": "fa:16:3e:56:0b:6b", "network": {"id": "b3014958-040c-44b4-94cc-1099e8fe3750", "bridge": "br-int", "label": "tempest-TestShelveInstance-1407890304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca87a25a8b244b7989ea459300036d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf50e3d-3d", "ovs_interfaceid": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Releasing lock "refresh_cache-effec7f0-1006-4081-91f4-e2d96fd0a87a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:47:27 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Creating image(s)
Nov 02 01:47:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Did not create local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Ensure instance console log exists: /opt/stack/data/nova/instances/effec7f0-1006-4081-91f4-e2d96fd0a87a/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Start _get_guest_xml network_info=[{"id": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "address": "fa:16:3e:56:0b:6b", "network": {"id": "b3014958-040c-44b4-94cc-1099e8fe3750", "bridge": "br-int", "label": "tempest-TestShelveInstance-1407890304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca87a25a8b244b7989ea459300036d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf50e3d-3d", "ovs_interfaceid": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4655d4f6-7139-4a31-833f-1a468f92d315', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VOtcoRsW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'effec7f0-1006-4081-91f4-e2d96fd0a87a', 'attached_at': '', 'detached_at': '', 'volume_id': '5b222ba0-7f5f-4d31-acb2-79257672c494', 'serial': '5b222ba0-7f5f-4d31-acb2-79257672c494'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-93258a39-4ad7-4547-a2c7-0c9e5178fe1c req-32320932-79a7-4bc2-b4df-13b628524a16 service nova] Acquired lock "refresh_cache-effec7f0-1006-4081-91f4-e2d96fd0a87a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG nova.network.neutron [req-93258a39-4ad7-4547-a2c7-0c9e5178fe1c req-32320932-79a7-4bc2-b4df-13b628524a16 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Refreshing network info cache for port 8cf50e3d-3da4-48fc-9cc9-bfe88441b531 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:47:27 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:47:27 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:47:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG nova.objects.instance [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lazy-loading 'vcpu_model' on Instance uuid effec7f0-1006-4081-91f4-e2d96fd0a87a {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG nova.objects.base [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Object Instance<effec7f0-1006-4081-91f4-e2d96fd0a87a> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VOtcoRsW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:47:27 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:47:27 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:47:27 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:47:27 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:47:27 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a21a18-b278-474c-9e47-ba4eb220c771]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:47:27 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55217d2-1605-46c2-b142-f4bd4df71e84]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494] added
Nov 02 01:47:27 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d33c10a-21d6-4868-81b9-b4ef7a4a7a01]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Didn't find any instances for network info cache update. {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2da6e7-ea3b-4933-8605-6b9c86b58c9d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VOtcoRsW {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VOtcoRsW" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fa6a89-c223-49d1-b826-2929a5d96d46]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VOtcoRsW'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7e303b-0fb6-41be-953f-ef43195908bf]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe23cb3-0b69-45a2-8ab2-5695e1a0875d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 01:47:27 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 01:47:27 user nova-compute[74996]:  {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:47:27 user nova-compute[74996]: WARNING os_brick.initiator.connectors.iscsi [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 01:47:27 user nova-compute[74996]: 
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[acecc07d-b9a9-4be9-8f62-d8da91145eb2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494, portal: 172.16.0.220,3260]
Nov 02 01:47:27 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494, portal: 172.16.0.220,3260] successful.
Nov 02 01:47:27 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[de95233e-8969-47e8-8670-f4cae672163b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e35597-36b6-4f28-8d68-da829b599a70]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:47:27 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:47:27 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG nova.network.neutron [req-93258a39-4ad7-4547-a2c7-0c9e5178fe1c req-32320932-79a7-4bc2-b4df-13b628524a16 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Updated VIF entry in instance network info cache for port 8cf50e3d-3da4-48fc-9cc9-bfe88441b531. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG nova.network.neutron [req-93258a39-4ad7-4547-a2c7-0c9e5178fe1c req-32320932-79a7-4bc2-b4df-13b628524a16 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Updating instance_info_cache with network_info: [{"id": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "address": "fa:16:3e:56:0b:6b", "network": {"id": "b3014958-040c-44b4-94cc-1099e8fe3750", "bridge": "br-int", "label": "tempest-TestShelveInstance-1407890304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca87a25a8b244b7989ea459300036d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf50e3d-3d", "ovs_interfaceid": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[519eb251-02a6-4510-9064-9f78a518304b]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VOtcoRsW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-93258a39-4ad7-4547-a2c7-0c9e5178fe1c req-32320932-79a7-4bc2-b4df-13b628524a16 service nova] Releasing lock "refresh_cache-effec7f0-1006-4081-91f4-e2d96fd0a87a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:47:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23064636433383066', 'path': '/dev/sdb'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064636433383066', 'path': '/dev/sdb'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T01:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1689709328',display_name='tempest-TestShelveInstance-server-1689709328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1689709328',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1132842490',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:43:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ca87a25a8b244b7989ea459300036d8d',ramdisk_id='',reservation_id='r-tfi2zjgk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-457210861',owner_user_name='tempest-TestShelveInstance-457210861-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:47:03Z,user_data=None,user_id='670f527ebd064a39a3d19edffd8393f3',uuid=effec7f0-1006-4081-91f4-e2d96fd0a87a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "address": "fa:16:3e:56:0b:6b", "network": {"id": "b3014958-040c-44b4-94cc-1099e8fe3750", "bridge": "br-int", "label": "tempest-TestShelveInstance-1407890304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca87a25a8b244b7989ea459300036d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf50e3d-3d", "ovs_interfaceid": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Converting VIF {"id": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "address": "fa:16:3e:56:0b:6b", "network": {"id": "b3014958-040c-44b4-94cc-1099e8fe3750", "bridge": "br-int", "label": "tempest-TestShelveInstance-1407890304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca87a25a8b244b7989ea459300036d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf50e3d-3d", "ovs_interfaceid": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=8cf50e3d-3da4-48fc-9cc9-bfe88441b531,network=Network(b3014958-040c-44b4-94cc-1099e8fe3750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cf50e3d-3d') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG nova.objects.instance [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lazy-loading 'pci_devices' on Instance uuid effec7f0-1006-4081-91f4-e2d96fd0a87a {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG nova.objects.base [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Object Instance<effec7f0-1006-4081-91f4-e2d96fd0a87a> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:47:28 user nova-compute[74996]:   <uuid>effec7f0-1006-4081-91f4-e2d96fd0a87a</uuid>
Nov 02 01:47:28 user nova-compute[74996]:   <name>instance-0000001b</name>
Nov 02 01:47:28 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:47:28 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:47:28 user nova-compute[74996]:   <metadata>
Nov 02 01:47:28 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:47:28 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:47:28 user nova-compute[74996]:       <nova:name>tempest-TestShelveInstance-server-1689709328</nova:name>
Nov 02 01:47:28 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:47:27</nova:creationTime>
Nov 02 01:47:28 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:47:28 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:47:28 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:47:28 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:47:28 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:47:28 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:47:28 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:47:28 user nova-compute[74996]:       <nova:owner>
Nov 02 01:47:28 user nova-compute[74996]:         <nova:user uuid="670f527ebd064a39a3d19edffd8393f3">tempest-TestShelveInstance-457210861-project-member</nova:user>
Nov 02 01:47:28 user nova-compute[74996]:         <nova:project uuid="ca87a25a8b244b7989ea459300036d8d">tempest-TestShelveInstance-457210861</nova:project>
Nov 02 01:47:28 user nova-compute[74996]:       </nova:owner>
Nov 02 01:47:28 user nova-compute[74996]:       <nova:ports>
Nov 02 01:47:28 user nova-compute[74996]:         <nova:port uuid="8cf50e3d-3da4-48fc-9cc9-bfe88441b531">
Nov 02 01:47:28 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 01:47:28 user nova-compute[74996]:         </nova:port>
Nov 02 01:47:28 user nova-compute[74996]:       </nova:ports>
Nov 02 01:47:28 user nova-compute[74996]:     </nova:instance>
Nov 02 01:47:28 user nova-compute[74996]:   </metadata>
Nov 02 01:47:28 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:47:28 user nova-compute[74996]:     <system>
Nov 02 01:47:28 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:47:28 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:47:28 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:47:28 user nova-compute[74996]:       <entry name="serial">effec7f0-1006-4081-91f4-e2d96fd0a87a</entry>
Nov 02 01:47:28 user nova-compute[74996]:       <entry name="uuid">effec7f0-1006-4081-91f4-e2d96fd0a87a</entry>
Nov 02 01:47:28 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:47:28 user nova-compute[74996]:     </system>
Nov 02 01:47:28 user nova-compute[74996]:   </sysinfo>
Nov 02 01:47:28 user nova-compute[74996]:   <os>
Nov 02 01:47:28 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:47:28 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:47:28 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:47:28 user nova-compute[74996]:   </os>
Nov 02 01:47:28 user nova-compute[74996]:   <features>
Nov 02 01:47:28 user nova-compute[74996]:     <acpi/>
Nov 02 01:47:28 user nova-compute[74996]:     <apic/>
Nov 02 01:47:28 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:47:28 user nova-compute[74996]:   </features>
Nov 02 01:47:28 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:47:28 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:47:28 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:47:28 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:47:28 user nova-compute[74996]:   </clock>
Nov 02 01:47:28 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:47:28 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:47:28 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:47:28 user nova-compute[74996]:   </cpu>
Nov 02 01:47:28 user nova-compute[74996]:   <devices>
Nov 02 01:47:28 user nova-compute[74996]:     <disk type="block" device="disk">
Nov 02 01:47:28 user nova-compute[74996]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:47:28 user nova-compute[74996]:       <source dev="/dev/sdb"/>
Nov 02 01:47:28 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:47:28 user nova-compute[74996]:       <serial>5b222ba0-7f5f-4d31-acb2-79257672c494</serial>
Nov 02 01:47:28 user nova-compute[74996]:     </disk>
Nov 02 01:47:28 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:47:28 user nova-compute[74996]:       <mac address="fa:16:3e:56:0b:6b"/>
Nov 02 01:47:28 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:47:28 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:47:28 user nova-compute[74996]:       <target dev="tap8cf50e3d-3d"/>
Nov 02 01:47:28 user nova-compute[74996]:     </interface>
Nov 02 01:47:28 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:47:28 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/effec7f0-1006-4081-91f4-e2d96fd0a87a/console.log" append="off"/>
Nov 02 01:47:28 user nova-compute[74996]:     </serial>
Nov 02 01:47:28 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:47:28 user nova-compute[74996]:     <video>
Nov 02 01:47:28 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:47:28 user nova-compute[74996]:     </video>
Nov 02 01:47:28 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:47:28 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:47:28 user nova-compute[74996]:     </rng>
Nov 02 01:47:28 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:47:28 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:47:28 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:47:28 user nova-compute[74996]:     </memballoon>
Nov 02 01:47:28 user nova-compute[74996]:   </devices>
Nov 02 01:47:28 user nova-compute[74996]: </domain>
Nov 02 01:47:28 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T01:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1689709328',display_name='tempest-TestShelveInstance-server-1689709328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1689709328',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1132842490',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:43:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ca87a25a8b244b7989ea459300036d8d',ramdisk_id='',reservation_id='r-tfi2zjgk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-457210861',owner_user_name='tempest-TestShelveInstance-457210861-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:47:03Z,user_data=None,user_id='670f527ebd064a39a3d19edffd8393f3',uuid=effec7f0-1006-4081-91f4-e2d96fd0a87a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "address": "fa:16:3e:56:0b:6b", "network": {"id": "b3014958-040c-44b4-94cc-1099e8fe3750", "bridge": "br-int", "label": "tempest-TestShelveInstance-1407890304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca87a25a8b244b7989ea459300036d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf50e3d-3d", "ovs_interfaceid": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Converting VIF {"id": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "address": "fa:16:3e:56:0b:6b", "network": {"id": "b3014958-040c-44b4-94cc-1099e8fe3750", "bridge": "br-int", "label": "tempest-TestShelveInstance-1407890304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca87a25a8b244b7989ea459300036d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf50e3d-3d", "ovs_interfaceid": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=8cf50e3d-3da4-48fc-9cc9-bfe88441b531,network=Network(b3014958-040c-44b4-94cc-1099e8fe3750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cf50e3d-3d') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG os_vif [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=8cf50e3d-3da4-48fc-9cc9-bfe88441b531,network=Network(b3014958-040c-44b4-94cc-1099e8fe3750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cf50e3d-3d') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47c51be3-c9b4-5a98-be7d-6bce1864bf64', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8cf50e3d-3d, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8cf50e3d-3d, col_values=(('qos', UUID('bd661feb-e2d6-42d7-866b-3908442768c3')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8cf50e3d-3d, col_values=(('external_ids', {'iface-id': '8cf50e3d-3da4-48fc-9cc9-bfe88441b531', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:0b:6b', 'vm-uuid': 'effec7f0-1006-4081-91f4-e2d96fd0a87a'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:28 user nova-compute[74996]: INFO os_vif [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=8cf50e3d-3da4-48fc-9cc9-bfe88441b531,network=Network(b3014958-040c-44b4-94cc-1099e8fe3750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cf50e3d-3d')
Nov 02 01:47:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Acquiring lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] No VIF found with MAC fa:16:3e:56:0b:6b, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG nova.compute.manager [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:28 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:47:28 user nova-compute[74996]: INFO nova.compute.claims [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Claim successful on node user
Nov 02 01:47:29 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:47:29 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:47:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.307s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:29 user nova-compute[74996]: DEBUG nova.compute.manager [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:47:29 user nova-compute[74996]: DEBUG nova.compute.manager [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:47:29 user nova-compute[74996]: DEBUG nova.network.neutron [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:47:29 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:47:29 user nova-compute[74996]: DEBUG nova.compute.manager [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:47:29 user nova-compute[74996]: DEBUG nova.policy [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '97ea3ba1bb9d4336999c9d5435100f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa3d5f0a7d4426695d83218ccf35a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:47:29 user nova-compute[74996]: DEBUG nova.compute.manager [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:47:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:47:29 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Creating image(s)
Nov 02 01:47:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Acquiring lock "/opt/stack/data/nova/instances/18c41599-fd0a-44d4-9289-fd92a4b86ca9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lock "/opt/stack/data/nova/instances/18c41599-fd0a-44d4-9289-fd92a4b86ca9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lock "/opt/stack/data/nova/instances/18c41599-fd0a-44d4-9289-fd92a4b86ca9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.228s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.182s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/18c41599-fd0a-44d4-9289-fd92a4b86ca9/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/18c41599-fd0a-44d4-9289-fd92a4b86ca9/disk 1073741824" returned: 0 in 0.075s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.176s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:30 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Checking if we can resize image /opt/stack/data/nova/instances/18c41599-fd0a-44d4-9289-fd92a4b86ca9/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:47:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c41599-fd0a-44d4-9289-fd92a4b86ca9/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c41599-fd0a-44d4-9289-fd92a4b86ca9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:30 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Cannot resize image /opt/stack/data/nova/instances/18c41599-fd0a-44d4-9289-fd92a4b86ca9/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:47:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:47:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Ensure instance console log exists: /opt/stack/data/nova/instances/18c41599-fd0a-44d4-9289-fd92a4b86ca9/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:47:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:31 user nova-compute[74996]: DEBUG nova.network.neutron [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Successfully created port: 775b74dc-ab9f-4185-b103-d08e272ef6b6 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:47:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:31 user nova-compute[74996]: DEBUG nova.compute.manager [req-42034244-cedf-4cc2-b2f3-b0fdde3b5ae8 req-396ae7fd-a76c-4f57-8886-6027f35218f9 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Received event network-vif-plugged-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:47:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-42034244-cedf-4cc2-b2f3-b0fdde3b5ae8 req-396ae7fd-a76c-4f57-8886-6027f35218f9 service nova] Acquiring lock "effec7f0-1006-4081-91f4-e2d96fd0a87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-42034244-cedf-4cc2-b2f3-b0fdde3b5ae8 req-396ae7fd-a76c-4f57-8886-6027f35218f9 service nova] Lock "effec7f0-1006-4081-91f4-e2d96fd0a87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-42034244-cedf-4cc2-b2f3-b0fdde3b5ae8 req-396ae7fd-a76c-4f57-8886-6027f35218f9 service nova] Lock "effec7f0-1006-4081-91f4-e2d96fd0a87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:31 user nova-compute[74996]: DEBUG nova.compute.manager [req-42034244-cedf-4cc2-b2f3-b0fdde3b5ae8 req-396ae7fd-a76c-4f57-8886-6027f35218f9 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] No waiting events found dispatching network-vif-plugged-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:47:31 user nova-compute[74996]: WARNING nova.compute.manager [req-42034244-cedf-4cc2-b2f3-b0fdde3b5ae8 req-396ae7fd-a76c-4f57-8886-6027f35218f9 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Received unexpected event network-vif-plugged-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.network.neutron [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Successfully updated port: 775b74dc-ab9f-4185-b103-d08e272ef6b6 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Acquiring lock "refresh_cache-18c41599-fd0a-44d4-9289-fd92a4b86ca9" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Acquired lock "refresh_cache-18c41599-fd0a-44d4-9289-fd92a4b86ca9" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.network.neutron [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.network.neutron [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.network.neutron [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Updating instance_info_cache with network_info: [{"id": "775b74dc-ab9f-4185-b103-d08e272ef6b6", "address": "fa:16:3e:61:ab:f8", "network": {"id": "dbee5f64-d4d8-4830-97de-59ca235212ed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1625669199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa3d5f0a7d4426695d83218ccf35a8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b74dc-ab", "ovs_interfaceid": "775b74dc-ab9f-4185-b103-d08e272ef6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.compute.manager [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:47:32 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Instance spawned successfully.
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.compute.manager [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Releasing lock "refresh_cache-18c41599-fd0a-44d4-9289-fd92a4b86ca9" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.compute.manager [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Instance network_info: |[{"id": "775b74dc-ab9f-4185-b103-d08e272ef6b6", "address": "fa:16:3e:61:ab:f8", "network": {"id": "dbee5f64-d4d8-4830-97de-59ca235212ed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1625669199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa3d5f0a7d4426695d83218ccf35a8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b74dc-ab", "ovs_interfaceid": "775b74dc-ab9f-4185-b103-d08e272ef6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Start _get_guest_xml network_info=[{"id": "775b74dc-ab9f-4185-b103-d08e272ef6b6", "address": "fa:16:3e:61:ab:f8", "network": {"id": "dbee5f64-d4d8-4830-97de-59ca235212ed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1625669199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa3d5f0a7d4426695d83218ccf35a8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b74dc-ab", "ovs_interfaceid": "775b74dc-ab9f-4185-b103-d08e272ef6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:47:32 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:47:32 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:47:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1274478760',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1274478760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1274478',id=33,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnxaEpv05BClrZu2yVhOZ+c5DwwGETJBNISxhJAi5S0uRY6GpIUu7Azq9UiaPsruEzEPqANkYLeNEXKtGv+dtamwQSOJO4m+V/hnFpc6FKDr8j5r9EGrPqlSxxfsOUK8w==',key_name='tempest-keypair-1780689397',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aaa3d5f0a7d4426695d83218ccf35a8c',ramdisk_id='',reservation_id='r-5528mj00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1436219902',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:47:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97ea3ba1bb9d4336999c9d5435100f7d',uuid=18c41599-fd0a-44d4-9289-fd92a4b86ca9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "775b74dc-ab9f-4185-b103-d08e272ef6b6", "address": "fa:16:3e:61:ab:f8", "network": {"id": "dbee5f64-d4d8-4830-97de-59ca235212ed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1625669199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa3d5f0a7d4426695d83218ccf35a8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b74dc-ab", "ovs_interfaceid": "775b74dc-ab9f-4185-b103-d08e272ef6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Converting VIF {"id": "775b74dc-ab9f-4185-b103-d08e272ef6b6", "address": "fa:16:3e:61:ab:f8", "network": {"id": "dbee5f64-d4d8-4830-97de-59ca235212ed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1625669199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa3d5f0a7d4426695d83218ccf35a8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b74dc-ab", "ovs_interfaceid": "775b74dc-ab9f-4185-b103-d08e272ef6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:ab:f8,bridge_name='br-int',has_traffic_filtering=True,id=775b74dc-ab9f-4185-b103-d08e272ef6b6,network=Network(dbee5f64-d4d8-4830-97de-59ca235212ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775b74dc-ab') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.objects.instance [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lazy-loading 'pci_devices' on Instance uuid 18c41599-fd0a-44d4-9289-fd92a4b86ca9 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-eb70757e-adff-4c19-afe1-c35bc8222bb0 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "effec7f0-1006-4081-91f4-e2d96fd0a87a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 29.828s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:47:32 user nova-compute[74996]:   <uuid>18c41599-fd0a-44d4-9289-fd92a4b86ca9</uuid>
Nov 02 01:47:32 user nova-compute[74996]:   <name>instance-00000021</name>
Nov 02 01:47:32 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:47:32 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:47:32 user nova-compute[74996]:   <metadata>
Nov 02 01:47:32 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:47:32 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:47:32 user nova-compute[74996]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1274478760</nova:name>
Nov 02 01:47:32 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:47:32</nova:creationTime>
Nov 02 01:47:32 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:47:32 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:47:32 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:47:32 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:47:32 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:47:32 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:47:32 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:47:32 user nova-compute[74996]:       <nova:owner>
Nov 02 01:47:32 user nova-compute[74996]:         <nova:user uuid="97ea3ba1bb9d4336999c9d5435100f7d">tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member</nova:user>
Nov 02 01:47:32 user nova-compute[74996]:         <nova:project uuid="aaa3d5f0a7d4426695d83218ccf35a8c">tempest-TestServerVolumeAttachScenarioOldVersion-1436219902</nova:project>
Nov 02 01:47:32 user nova-compute[74996]:       </nova:owner>
Nov 02 01:47:32 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:47:32 user nova-compute[74996]:       <nova:ports>
Nov 02 01:47:32 user nova-compute[74996]:         <nova:port uuid="775b74dc-ab9f-4185-b103-d08e272ef6b6">
Nov 02 01:47:32 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 02 01:47:32 user nova-compute[74996]:         </nova:port>
Nov 02 01:47:32 user nova-compute[74996]:       </nova:ports>
Nov 02 01:47:32 user nova-compute[74996]:     </nova:instance>
Nov 02 01:47:32 user nova-compute[74996]:   </metadata>
Nov 02 01:47:32 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:47:32 user nova-compute[74996]:     <system>
Nov 02 01:47:32 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:47:32 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:47:32 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:47:32 user nova-compute[74996]:       <entry name="serial">18c41599-fd0a-44d4-9289-fd92a4b86ca9</entry>
Nov 02 01:47:32 user nova-compute[74996]:       <entry name="uuid">18c41599-fd0a-44d4-9289-fd92a4b86ca9</entry>
Nov 02 01:47:32 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:47:32 user nova-compute[74996]:     </system>
Nov 02 01:47:32 user nova-compute[74996]:   </sysinfo>
Nov 02 01:47:32 user nova-compute[74996]:   <os>
Nov 02 01:47:32 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:47:32 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:47:32 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:47:32 user nova-compute[74996]:   </os>
Nov 02 01:47:32 user nova-compute[74996]:   <features>
Nov 02 01:47:32 user nova-compute[74996]:     <acpi/>
Nov 02 01:47:32 user nova-compute[74996]:     <apic/>
Nov 02 01:47:32 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:47:32 user nova-compute[74996]:   </features>
Nov 02 01:47:32 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:47:32 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:47:32 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:47:32 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:47:32 user nova-compute[74996]:   </clock>
Nov 02 01:47:32 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:47:32 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:47:32 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:47:32 user nova-compute[74996]:   </cpu>
Nov 02 01:47:32 user nova-compute[74996]:   <devices>
Nov 02 01:47:32 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:47:32 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:47:32 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/18c41599-fd0a-44d4-9289-fd92a4b86ca9/disk"/>
Nov 02 01:47:32 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:47:32 user nova-compute[74996]:     </disk>
Nov 02 01:47:32 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:47:32 user nova-compute[74996]:       <mac address="fa:16:3e:61:ab:f8"/>
Nov 02 01:47:32 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:47:32 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:47:32 user nova-compute[74996]:       <target dev="tap775b74dc-ab"/>
Nov 02 01:47:32 user nova-compute[74996]:     </interface>
Nov 02 01:47:32 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:47:32 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/18c41599-fd0a-44d4-9289-fd92a4b86ca9/console.log" append="off"/>
Nov 02 01:47:32 user nova-compute[74996]:     </serial>
Nov 02 01:47:32 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:47:32 user nova-compute[74996]:     <video>
Nov 02 01:47:32 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:47:32 user nova-compute[74996]:     </video>
Nov 02 01:47:32 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:47:32 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:47:32 user nova-compute[74996]:     </rng>
Nov 02 01:47:32 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:47:32 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:47:32 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:47:32 user nova-compute[74996]:     </memballoon>
Nov 02 01:47:32 user nova-compute[74996]:   </devices>
Nov 02 01:47:32 user nova-compute[74996]: </domain>
Nov 02 01:47:32 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:47:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1274478760',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1274478760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1274478',id=33,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnxaEpv05BClrZu2yVhOZ+c5DwwGETJBNISxhJAi5S0uRY6GpIUu7Azq9UiaPsruEzEPqANkYLeNEXKtGv+dtamwQSOJO4m+V/hnFpc6FKDr8j5r9EGrPqlSxxfsOUK8w==',key_name='tempest-keypair-1780689397',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aaa3d5f0a7d4426695d83218ccf35a8c',ramdisk_id='',reservation_id='r-5528mj00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1436219902',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:47:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97ea3ba1bb9d4336999c9d5435100f7d',uuid=18c41599-fd0a-44d4-9289-fd92a4b86ca9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "775b74dc-ab9f-4185-b103-d08e272ef6b6", "address": "fa:16:3e:61:ab:f8", "network": {"id": "dbee5f64-d4d8-4830-97de-59ca235212ed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1625669199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa3d5f0a7d4426695d83218ccf35a8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b74dc-ab", "ovs_interfaceid": "775b74dc-ab9f-4185-b103-d08e272ef6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Converting VIF {"id": "775b74dc-ab9f-4185-b103-d08e272ef6b6", "address": "fa:16:3e:61:ab:f8", "network": {"id": "dbee5f64-d4d8-4830-97de-59ca235212ed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1625669199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa3d5f0a7d4426695d83218ccf35a8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b74dc-ab", "ovs_interfaceid": "775b74dc-ab9f-4185-b103-d08e272ef6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:ab:f8,bridge_name='br-int',has_traffic_filtering=True,id=775b74dc-ab9f-4185-b103-d08e272ef6b6,network=Network(dbee5f64-d4d8-4830-97de-59ca235212ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775b74dc-ab') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG os_vif [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:ab:f8,bridge_name='br-int',has_traffic_filtering=True,id=775b74dc-ab9f-4185-b103-d08e272ef6b6,network=Network(dbee5f64-d4d8-4830-97de-59ca235212ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775b74dc-ab') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '44364382-0cca-5525-9088-89472ee757ab', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap775b74dc-ab, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap775b74dc-ab, col_values=(('qos', UUID('fac30a64-820c-499f-9575-b8da38b8c13b')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap775b74dc-ab, col_values=(('external_ids', {'iface-id': '775b74dc-ab9f-4185-b103-d08e272ef6b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:ab:f8', 'vm-uuid': '18c41599-fd0a-44d4-9289-fd92a4b86ca9'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:32 user nova-compute[74996]: INFO os_vif [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:ab:f8,bridge_name='br-int',has_traffic_filtering=True,id=775b74dc-ab9f-4185-b103-d08e272ef6b6,network=Network(dbee5f64-d4d8-4830-97de-59ca235212ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775b74dc-ab')
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:47:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] No VIF found with MAC fa:16:3e:61:ab:f8, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:47:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-3b2dfa9c-5184-4b65-8ab2-50e143e18a71 req-96447705-cfab-48a1-bbf5-3ee3349a0331 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Received event network-vif-plugged-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:47:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3b2dfa9c-5184-4b65-8ab2-50e143e18a71 req-96447705-cfab-48a1-bbf5-3ee3349a0331 service nova] Acquiring lock "effec7f0-1006-4081-91f4-e2d96fd0a87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3b2dfa9c-5184-4b65-8ab2-50e143e18a71 req-96447705-cfab-48a1-bbf5-3ee3349a0331 service nova] Lock "effec7f0-1006-4081-91f4-e2d96fd0a87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3b2dfa9c-5184-4b65-8ab2-50e143e18a71 req-96447705-cfab-48a1-bbf5-3ee3349a0331 service nova] Lock "effec7f0-1006-4081-91f4-e2d96fd0a87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-3b2dfa9c-5184-4b65-8ab2-50e143e18a71 req-96447705-cfab-48a1-bbf5-3ee3349a0331 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] No waiting events found dispatching network-vif-plugged-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:47:33 user nova-compute[74996]: WARNING nova.compute.manager [req-3b2dfa9c-5184-4b65-8ab2-50e143e18a71 req-96447705-cfab-48a1-bbf5-3ee3349a0331 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Received unexpected event network-vif-plugged-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 for instance with vm_state active and task_state None.
Nov 02 01:47:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-3b2dfa9c-5184-4b65-8ab2-50e143e18a71 req-96447705-cfab-48a1-bbf5-3ee3349a0331 service nova] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Received event network-changed-775b74dc-ab9f-4185-b103-d08e272ef6b6 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:47:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-3b2dfa9c-5184-4b65-8ab2-50e143e18a71 req-96447705-cfab-48a1-bbf5-3ee3349a0331 service nova] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Refreshing instance network info cache due to event network-changed-775b74dc-ab9f-4185-b103-d08e272ef6b6. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:47:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3b2dfa9c-5184-4b65-8ab2-50e143e18a71 req-96447705-cfab-48a1-bbf5-3ee3349a0331 service nova] Acquiring lock "refresh_cache-18c41599-fd0a-44d4-9289-fd92a4b86ca9" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:47:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3b2dfa9c-5184-4b65-8ab2-50e143e18a71 req-96447705-cfab-48a1-bbf5-3ee3349a0331 service nova] Acquired lock "refresh_cache-18c41599-fd0a-44d4-9289-fd92a4b86ca9" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:47:33 user nova-compute[74996]: DEBUG nova.network.neutron [req-3b2dfa9c-5184-4b65-8ab2-50e143e18a71 req-96447705-cfab-48a1-bbf5-3ee3349a0331 service nova] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Refreshing network info cache for port 775b74dc-ab9f-4185-b103-d08e272ef6b6 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:47:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:33 user nova-compute[74996]: DEBUG nova.network.neutron [req-3b2dfa9c-5184-4b65-8ab2-50e143e18a71 req-96447705-cfab-48a1-bbf5-3ee3349a0331 service nova] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Updated VIF entry in instance network info cache for port 775b74dc-ab9f-4185-b103-d08e272ef6b6. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:47:33 user nova-compute[74996]: DEBUG nova.network.neutron [req-3b2dfa9c-5184-4b65-8ab2-50e143e18a71 req-96447705-cfab-48a1-bbf5-3ee3349a0331 service nova] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Updating instance_info_cache with network_info: [{"id": "775b74dc-ab9f-4185-b103-d08e272ef6b6", "address": "fa:16:3e:61:ab:f8", "network": {"id": "dbee5f64-d4d8-4830-97de-59ca235212ed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1625669199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa3d5f0a7d4426695d83218ccf35a8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b74dc-ab", "ovs_interfaceid": "775b74dc-ab9f-4185-b103-d08e272ef6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:47:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3b2dfa9c-5184-4b65-8ab2-50e143e18a71 req-96447705-cfab-48a1-bbf5-3ee3349a0331 service nova] Releasing lock "refresh_cache-18c41599-fd0a-44d4-9289-fd92a4b86ca9" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:47:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:34 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:47:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:35 user nova-compute[74996]: DEBUG nova.compute.manager [req-096641cc-33e7-4953-9906-59490e49a9fe req-ddc53b75-d323-4c5a-89ed-86acfbe040b4 service nova] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Received event network-vif-plugged-775b74dc-ab9f-4185-b103-d08e272ef6b6 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:47:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-096641cc-33e7-4953-9906-59490e49a9fe req-ddc53b75-d323-4c5a-89ed-86acfbe040b4 service nova] Acquiring lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-096641cc-33e7-4953-9906-59490e49a9fe req-ddc53b75-d323-4c5a-89ed-86acfbe040b4 service nova] Lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-096641cc-33e7-4953-9906-59490e49a9fe req-ddc53b75-d323-4c5a-89ed-86acfbe040b4 service nova] Lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:35 user nova-compute[74996]: DEBUG nova.compute.manager [req-096641cc-33e7-4953-9906-59490e49a9fe req-ddc53b75-d323-4c5a-89ed-86acfbe040b4 service nova] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] No waiting events found dispatching network-vif-plugged-775b74dc-ab9f-4185-b103-d08e272ef6b6 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:47:35 user nova-compute[74996]: WARNING nova.compute.manager [req-096641cc-33e7-4953-9906-59490e49a9fe req-ddc53b75-d323-4c5a-89ed-86acfbe040b4 service nova] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Received unexpected event network-vif-plugged-775b74dc-ab9f-4185-b103-d08e272ef6b6 for instance with vm_state building and task_state spawning.
Nov 02 01:47:35 user nova-compute[74996]: DEBUG nova.compute.manager [req-096641cc-33e7-4953-9906-59490e49a9fe req-ddc53b75-d323-4c5a-89ed-86acfbe040b4 service nova] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Received event network-vif-plugged-775b74dc-ab9f-4185-b103-d08e272ef6b6 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:47:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-096641cc-33e7-4953-9906-59490e49a9fe req-ddc53b75-d323-4c5a-89ed-86acfbe040b4 service nova] Acquiring lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-096641cc-33e7-4953-9906-59490e49a9fe req-ddc53b75-d323-4c5a-89ed-86acfbe040b4 service nova] Lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-096641cc-33e7-4953-9906-59490e49a9fe req-ddc53b75-d323-4c5a-89ed-86acfbe040b4 service nova] Lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:35 user nova-compute[74996]: DEBUG nova.compute.manager [req-096641cc-33e7-4953-9906-59490e49a9fe req-ddc53b75-d323-4c5a-89ed-86acfbe040b4 service nova] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] No waiting events found dispatching network-vif-plugged-775b74dc-ab9f-4185-b103-d08e272ef6b6 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:47:35 user nova-compute[74996]: WARNING nova.compute.manager [req-096641cc-33e7-4953-9906-59490e49a9fe req-ddc53b75-d323-4c5a-89ed-86acfbe040b4 service nova] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Received unexpected event network-vif-plugged-775b74dc-ab9f-4185-b103-d08e272ef6b6 for instance with vm_state building and task_state spawning.
Nov 02 01:47:36 user nova-compute[74996]: DEBUG nova.compute.manager [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:47:36 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:47:36 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Instance spawned successfully.
Nov 02 01:47:36 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:47:36 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:47:36 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:47:36 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:47:36 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:47:36 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:47:36 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:47:36 user nova-compute[74996]: INFO nova.compute.manager [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Took 6.93 seconds to spawn the instance on the hypervisor.
Nov 02 01:47:36 user nova-compute[74996]: DEBUG nova.compute.manager [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:47:36 user nova-compute[74996]: INFO nova.compute.manager [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Took 7.64 seconds to build instance.
Nov 02 01:47:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-661dd451-0278-4040-9f33-1516b3326d85 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.756s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "03114a20-c464-4ecd-850d-1a29a6ad2584" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "03114a20-c464-4ecd-850d-1a29a6ad2584" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:36 user nova-compute[74996]: DEBUG nova.compute.manager [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:47:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:36 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:47:36 user nova-compute[74996]: INFO nova.compute.claims [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Claim successful on node user
Nov 02 01:47:37 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:47:37 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:47:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:37 user nova-compute[74996]: DEBUG nova.compute.manager [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:47:37 user nova-compute[74996]: DEBUG nova.compute.manager [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:47:37 user nova-compute[74996]: DEBUG nova.network.neutron [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:47:37 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:47:37 user nova-compute[74996]: DEBUG nova.compute.manager [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:47:37 user nova-compute[74996]: DEBUG nova.compute.manager [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:47:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:47:37 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Creating image(s)
Nov 02 01:47:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "/opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "/opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "/opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:37 user nova-compute[74996]: DEBUG nova.policy [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01fc2ea044794374b09741ecaf841ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b862880e0c43ab8f5a4d65f6697955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:47:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.217s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.205s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk 1073741824" returned: 0 in 0.053s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.209s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:38 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:47:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:38 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Cannot resize image /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:47:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:47:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Ensure instance console log exists: /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:47:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:38 user nova-compute[74996]: DEBUG nova.compute.manager [req-ad53e759-24d4-4ccd-9d70-91b9751ae0ca req-54d04bee-f615-44dc-a143-a85f7207867e service nova] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Received event network-changed-b2105173-adeb-478a-abf5-24a32a1922fb {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:47:38 user nova-compute[74996]: DEBUG nova.compute.manager [req-ad53e759-24d4-4ccd-9d70-91b9751ae0ca req-54d04bee-f615-44dc-a143-a85f7207867e service nova] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Refreshing instance network info cache due to event network-changed-b2105173-adeb-478a-abf5-24a32a1922fb. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:47:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ad53e759-24d4-4ccd-9d70-91b9751ae0ca req-54d04bee-f615-44dc-a143-a85f7207867e service nova] Acquiring lock "refresh_cache-1fd1c257-2903-47ce-bd31-a00ba6a8b9df" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:47:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ad53e759-24d4-4ccd-9d70-91b9751ae0ca req-54d04bee-f615-44dc-a143-a85f7207867e service nova] Acquired lock "refresh_cache-1fd1c257-2903-47ce-bd31-a00ba6a8b9df" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:47:38 user nova-compute[74996]: DEBUG nova.network.neutron [req-ad53e759-24d4-4ccd-9d70-91b9751ae0ca req-54d04bee-f615-44dc-a143-a85f7207867e service nova] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Refreshing network info cache for port b2105173-adeb-478a-abf5-24a32a1922fb {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:47:38 user nova-compute[74996]: DEBUG nova.network.neutron [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Successfully created port: 0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.network.neutron [req-ad53e759-24d4-4ccd-9d70-91b9751ae0ca req-54d04bee-f615-44dc-a143-a85f7207867e service nova] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Updated VIF entry in instance network info cache for port b2105173-adeb-478a-abf5-24a32a1922fb. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.network.neutron [req-ad53e759-24d4-4ccd-9d70-91b9751ae0ca req-54d04bee-f615-44dc-a143-a85f7207867e service nova] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Updating instance_info_cache with network_info: [{"id": "b2105173-adeb-478a-abf5-24a32a1922fb", "address": "fa:16:3e:90:44:8b", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2105173-ad", "ovs_interfaceid": "b2105173-adeb-478a-abf5-24a32a1922fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ad53e759-24d4-4ccd-9d70-91b9751ae0ca req-54d04bee-f615-44dc-a143-a85f7207867e service nova] Releasing lock "refresh_cache-1fd1c257-2903-47ce-bd31-a00ba6a8b9df" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.network.neutron [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Successfully updated port: 0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "refresh_cache-03114a20-c464-4ecd-850d-1a29a6ad2584" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquired lock "refresh_cache-03114a20-c464-4ecd-850d-1a29a6ad2584" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.network.neutron [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.network.neutron [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.network.neutron [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Updating instance_info_cache with network_info: [{"id": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "address": "fa:16:3e:a8:7a:d9", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aafb9f8-9e", "ovs_interfaceid": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Releasing lock "refresh_cache-03114a20-c464-4ecd-850d-1a29a6ad2584" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.compute.manager [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Instance network_info: |[{"id": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "address": "fa:16:3e:a8:7a:d9", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aafb9f8-9e", "ovs_interfaceid": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Start _get_guest_xml network_info=[{"id": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "address": "fa:16:3e:a8:7a:d9", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aafb9f8-9e", "ovs_interfaceid": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:47:39 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:47:39 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:47:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-324177429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-324177429',id=34,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGC1ZrO4IZqmeKhScK4Khe/R5fSlhAKeS9WeDuGPVzat9NavqbS4CamBVGSNIH1o7iITOcF+YORdUJpDvHOGjwbrgj1KSxyrnSI6g4MKfqy2Az/ytQiVKtTv0qzQxyiASA==',key_name='tempest-keypair-1560575805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22b862880e0c43ab8f5a4d65f6697955',ramdisk_id='',reservation_id='r-e7r370s7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-701748724',owner_user_name='tempest-AttachVolumeShelveTestJSON-701748724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:47:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01fc2ea044794374b09741ecaf841ba2',uuid=03114a20-c464-4ecd-850d-1a29a6ad2584,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "address": "fa:16:3e:a8:7a:d9", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aafb9f8-9e", "ovs_interfaceid": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Converting VIF {"id": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "address": "fa:16:3e:a8:7a:d9", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aafb9f8-9e", "ovs_interfaceid": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:7a:d9,bridge_name='br-int',has_traffic_filtering=True,id=0aafb9f8-9eec-4e51-a955-fd1aeb4c5246,network=Network(936a0e26-8a02-4c7c-9d24-acbb2f438cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aafb9f8-9e') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.objects.instance [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lazy-loading 'pci_devices' on Instance uuid 03114a20-c464-4ecd-850d-1a29a6ad2584 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:47:39 user nova-compute[74996]:   <uuid>03114a20-c464-4ecd-850d-1a29a6ad2584</uuid>
Nov 02 01:47:39 user nova-compute[74996]:   <name>instance-00000022</name>
Nov 02 01:47:39 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:47:39 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:47:39 user nova-compute[74996]:   <metadata>
Nov 02 01:47:39 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:47:39 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:47:39 user nova-compute[74996]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-324177429</nova:name>
Nov 02 01:47:39 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:47:39</nova:creationTime>
Nov 02 01:47:39 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:47:39 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:47:39 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:47:39 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:47:39 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:47:39 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:47:39 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:47:39 user nova-compute[74996]:       <nova:owner>
Nov 02 01:47:39 user nova-compute[74996]:         <nova:user uuid="01fc2ea044794374b09741ecaf841ba2">tempest-AttachVolumeShelveTestJSON-701748724-project-member</nova:user>
Nov 02 01:47:39 user nova-compute[74996]:         <nova:project uuid="22b862880e0c43ab8f5a4d65f6697955">tempest-AttachVolumeShelveTestJSON-701748724</nova:project>
Nov 02 01:47:39 user nova-compute[74996]:       </nova:owner>
Nov 02 01:47:39 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:47:39 user nova-compute[74996]:       <nova:ports>
Nov 02 01:47:39 user nova-compute[74996]:         <nova:port uuid="0aafb9f8-9eec-4e51-a955-fd1aeb4c5246">
Nov 02 01:47:39 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 01:47:39 user nova-compute[74996]:         </nova:port>
Nov 02 01:47:39 user nova-compute[74996]:       </nova:ports>
Nov 02 01:47:39 user nova-compute[74996]:     </nova:instance>
Nov 02 01:47:39 user nova-compute[74996]:   </metadata>
Nov 02 01:47:39 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:47:39 user nova-compute[74996]:     <system>
Nov 02 01:47:39 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:47:39 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:47:39 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:47:39 user nova-compute[74996]:       <entry name="serial">03114a20-c464-4ecd-850d-1a29a6ad2584</entry>
Nov 02 01:47:39 user nova-compute[74996]:       <entry name="uuid">03114a20-c464-4ecd-850d-1a29a6ad2584</entry>
Nov 02 01:47:39 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:47:39 user nova-compute[74996]:     </system>
Nov 02 01:47:39 user nova-compute[74996]:   </sysinfo>
Nov 02 01:47:39 user nova-compute[74996]:   <os>
Nov 02 01:47:39 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:47:39 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:47:39 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:47:39 user nova-compute[74996]:   </os>
Nov 02 01:47:39 user nova-compute[74996]:   <features>
Nov 02 01:47:39 user nova-compute[74996]:     <acpi/>
Nov 02 01:47:39 user nova-compute[74996]:     <apic/>
Nov 02 01:47:39 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:47:39 user nova-compute[74996]:   </features>
Nov 02 01:47:39 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:47:39 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:47:39 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:47:39 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:47:39 user nova-compute[74996]:   </clock>
Nov 02 01:47:39 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:47:39 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:47:39 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:47:39 user nova-compute[74996]:   </cpu>
Nov 02 01:47:39 user nova-compute[74996]:   <devices>
Nov 02 01:47:39 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:47:39 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:47:39 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk"/>
Nov 02 01:47:39 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:47:39 user nova-compute[74996]:     </disk>
Nov 02 01:47:39 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:47:39 user nova-compute[74996]:       <mac address="fa:16:3e:a8:7a:d9"/>
Nov 02 01:47:39 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:47:39 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:47:39 user nova-compute[74996]:       <target dev="tap0aafb9f8-9e"/>
Nov 02 01:47:39 user nova-compute[74996]:     </interface>
Nov 02 01:47:39 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:47:39 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/console.log" append="off"/>
Nov 02 01:47:39 user nova-compute[74996]:     </serial>
Nov 02 01:47:39 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:47:39 user nova-compute[74996]:     <video>
Nov 02 01:47:39 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:47:39 user nova-compute[74996]:     </video>
Nov 02 01:47:39 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:47:39 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:47:39 user nova-compute[74996]:     </rng>
Nov 02 01:47:39 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:47:39 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:47:39 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:47:39 user nova-compute[74996]:     </memballoon>
Nov 02 01:47:39 user nova-compute[74996]:   </devices>
Nov 02 01:47:39 user nova-compute[74996]: </domain>
Nov 02 01:47:39 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:47:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-324177429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-324177429',id=34,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGC1ZrO4IZqmeKhScK4Khe/R5fSlhAKeS9WeDuGPVzat9NavqbS4CamBVGSNIH1o7iITOcF+YORdUJpDvHOGjwbrgj1KSxyrnSI6g4MKfqy2Az/ytQiVKtTv0qzQxyiASA==',key_name='tempest-keypair-1560575805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22b862880e0c43ab8f5a4d65f6697955',ramdisk_id='',reservation_id='r-e7r370s7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-701748724',owner_user_name='tempest-AttachVolumeShelveTestJSON-701748724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:47:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01fc2ea044794374b09741ecaf841ba2',uuid=03114a20-c464-4ecd-850d-1a29a6ad2584,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "address": "fa:16:3e:a8:7a:d9", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aafb9f8-9e", "ovs_interfaceid": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Converting VIF {"id": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "address": "fa:16:3e:a8:7a:d9", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aafb9f8-9e", "ovs_interfaceid": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:7a:d9,bridge_name='br-int',has_traffic_filtering=True,id=0aafb9f8-9eec-4e51-a955-fd1aeb4c5246,network=Network(936a0e26-8a02-4c7c-9d24-acbb2f438cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aafb9f8-9e') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG os_vif [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:7a:d9,bridge_name='br-int',has_traffic_filtering=True,id=0aafb9f8-9eec-4e51-a955-fd1aeb4c5246,network=Network(936a0e26-8a02-4c7c-9d24-acbb2f438cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aafb9f8-9e') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ccbe9b0-e822-5b34-9113-6dcbfb8f174b', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0aafb9f8-9e, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0aafb9f8-9e, col_values=(('qos', UUID('37fd82f0-e59b-4b47-b806-898e5f4fff53')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0aafb9f8-9e, col_values=(('external_ids', {'iface-id': '0aafb9f8-9eec-4e51-a955-fd1aeb4c5246', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:7a:d9', 'vm-uuid': '03114a20-c464-4ecd-850d-1a29a6ad2584'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:39 user nova-compute[74996]: INFO os_vif [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:7a:d9,bridge_name='br-int',has_traffic_filtering=True,id=0aafb9f8-9eec-4e51-a955-fd1aeb4c5246,network=Network(936a0e26-8a02-4c7c-9d24-acbb2f438cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aafb9f8-9e')
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:47:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] No VIF found with MAC fa:16:3e:a8:7a:d9, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:47:40 user nova-compute[74996]: DEBUG nova.compute.manager [req-d76ec7ae-c0bf-456a-ad02-582b80014546 req-9fcd66c2-e49b-47ba-aa49-f6e9a6e21ecf service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Received event network-changed-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:47:40 user nova-compute[74996]: DEBUG nova.compute.manager [req-d76ec7ae-c0bf-456a-ad02-582b80014546 req-9fcd66c2-e49b-47ba-aa49-f6e9a6e21ecf service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Refreshing instance network info cache due to event network-changed-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:47:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d76ec7ae-c0bf-456a-ad02-582b80014546 req-9fcd66c2-e49b-47ba-aa49-f6e9a6e21ecf service nova] Acquiring lock "refresh_cache-03114a20-c464-4ecd-850d-1a29a6ad2584" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:47:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d76ec7ae-c0bf-456a-ad02-582b80014546 req-9fcd66c2-e49b-47ba-aa49-f6e9a6e21ecf service nova] Acquired lock "refresh_cache-03114a20-c464-4ecd-850d-1a29a6ad2584" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:47:40 user nova-compute[74996]: DEBUG nova.network.neutron [req-d76ec7ae-c0bf-456a-ad02-582b80014546 req-9fcd66c2-e49b-47ba-aa49-f6e9a6e21ecf service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Refreshing network info cache for port 0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:47:41 user nova-compute[74996]: DEBUG nova.network.neutron [req-d76ec7ae-c0bf-456a-ad02-582b80014546 req-9fcd66c2-e49b-47ba-aa49-f6e9a6e21ecf service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Updated VIF entry in instance network info cache for port 0aafb9f8-9eec-4e51-a955-fd1aeb4c5246. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:47:41 user nova-compute[74996]: DEBUG nova.network.neutron [req-d76ec7ae-c0bf-456a-ad02-582b80014546 req-9fcd66c2-e49b-47ba-aa49-f6e9a6e21ecf service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Updating instance_info_cache with network_info: [{"id": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "address": "fa:16:3e:a8:7a:d9", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aafb9f8-9e", "ovs_interfaceid": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:47:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d76ec7ae-c0bf-456a-ad02-582b80014546 req-9fcd66c2-e49b-47ba-aa49-f6e9a6e21ecf service nova] Releasing lock "refresh_cache-03114a20-c464-4ecd-850d-1a29a6ad2584" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:47:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:41 user nova-compute[74996]: DEBUG nova.compute.manager [req-2e7795db-4e39-407c-a0d9-0facfc144e30 req-fde66511-cc52-4823-8afc-204e04135394 service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Received event network-vif-plugged-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:47:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2e7795db-4e39-407c-a0d9-0facfc144e30 req-fde66511-cc52-4823-8afc-204e04135394 service nova] Acquiring lock "03114a20-c464-4ecd-850d-1a29a6ad2584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2e7795db-4e39-407c-a0d9-0facfc144e30 req-fde66511-cc52-4823-8afc-204e04135394 service nova] Lock "03114a20-c464-4ecd-850d-1a29a6ad2584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2e7795db-4e39-407c-a0d9-0facfc144e30 req-fde66511-cc52-4823-8afc-204e04135394 service nova] Lock "03114a20-c464-4ecd-850d-1a29a6ad2584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:41 user nova-compute[74996]: DEBUG nova.compute.manager [req-2e7795db-4e39-407c-a0d9-0facfc144e30 req-fde66511-cc52-4823-8afc-204e04135394 service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] No waiting events found dispatching network-vif-plugged-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:47:41 user nova-compute[74996]: WARNING nova.compute.manager [req-2e7795db-4e39-407c-a0d9-0facfc144e30 req-fde66511-cc52-4823-8afc-204e04135394 service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Received unexpected event network-vif-plugged-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 for instance with vm_state building and task_state spawning.
Nov 02 01:47:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:43 user nova-compute[74996]: DEBUG nova.compute.manager [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:47:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:47:43 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Instance spawned successfully.
Nov 02 01:47:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:47:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:47:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:47:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:47:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:47:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:47:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:47:43 user nova-compute[74996]: INFO nova.compute.manager [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Took 6.16 seconds to spawn the instance on the hypervisor.
Nov 02 01:47:43 user nova-compute[74996]: DEBUG nova.compute.manager [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:47:43 user nova-compute[74996]: INFO nova.compute.manager [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Took 6.89 seconds to build instance.
Nov 02 01:47:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bb3a6af9-b363-482b-ab63-eeb1f4a83e1e tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "03114a20-c464-4ecd-850d-1a29a6ad2584" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.006s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-c68377c7-0367-4814-af91-64ef29ca1e6b req-aa028b45-fc41-404d-b592-e6fc8a0e56c6 service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Received event network-vif-plugged-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:47:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c68377c7-0367-4814-af91-64ef29ca1e6b req-aa028b45-fc41-404d-b592-e6fc8a0e56c6 service nova] Acquiring lock "03114a20-c464-4ecd-850d-1a29a6ad2584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c68377c7-0367-4814-af91-64ef29ca1e6b req-aa028b45-fc41-404d-b592-e6fc8a0e56c6 service nova] Lock "03114a20-c464-4ecd-850d-1a29a6ad2584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c68377c7-0367-4814-af91-64ef29ca1e6b req-aa028b45-fc41-404d-b592-e6fc8a0e56c6 service nova] Lock "03114a20-c464-4ecd-850d-1a29a6ad2584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-c68377c7-0367-4814-af91-64ef29ca1e6b req-aa028b45-fc41-404d-b592-e6fc8a0e56c6 service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] No waiting events found dispatching network-vif-plugged-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:47:43 user nova-compute[74996]: WARNING nova.compute.manager [req-c68377c7-0367-4814-af91-64ef29ca1e6b req-aa028b45-fc41-404d-b592-e6fc8a0e56c6 service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Received unexpected event network-vif-plugged-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 for instance with vm_state active and task_state None.
Nov 02 01:47:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:45 user nova-compute[74996]: DEBUG nova.objects.instance [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lazy-loading 'flavor' on Instance uuid 1fd1c257-2903-47ce-bd31-a00ba6a8b9df {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:47:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:45 user nova-compute[74996]: INFO nova.compute.manager [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Attaching volume 6c576699-0498-40b1-8736-0a5b8e654aa5 to /dev/vdb
Nov 02 01:47:45 user nova-compute[74996]: DEBUG os_brick.utils [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:47:45 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:45 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:45 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a97fefa-37a1-47ea-9fe0-366f4e65678b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:45 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:45 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:45 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a7c239-28be-49ec-ba13-55727798474d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:45 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:45 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:45 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5420c205-a0fe-4467-83fe-9de248d92e48]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:45 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ce9552-7afe-4a3e-b8d0-5889b3340464]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:45 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:47:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:47:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:47:46 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:47:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a81f161-0b2f-44f1-960b-167b1b6c06f7]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:47:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:47:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:47:46 user nova-compute[74996]: DEBUG os_brick.utils [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:47:46 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Updating existing volume attachment record: 49fe0c64-735c-4389-a3c7-ee6928e525da {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:47:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-de7aed36-25c0-4c21-9f7f-2aa3b762f533 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Acquiring lock "f0de5980-334b-4654-8b1a-88c4c861aa49" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-de7aed36-25c0-4c21-9f7f-2aa3b762f533 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-de7aed36-25c0-4c21-9f7f-2aa3b762f533 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Acquiring lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-de7aed36-25c0-4c21-9f7f-2aa3b762f533 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-de7aed36-25c0-4c21-9f7f-2aa3b762f533 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:50 user nova-compute[74996]: INFO nova.compute.manager [None req-de7aed36-25c0-4c21-9f7f-2aa3b762f533 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Terminating instance
Nov 02 01:47:50 user nova-compute[74996]: DEBUG nova.compute.manager [None req-de7aed36-25c0-4c21-9f7f-2aa3b762f533 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:47:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-4f265a06-b20e-4560-96fe-1965c5421d88 req-1cf0e2b2-caef-4963-9050-4a12ecb03f31 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Received event network-vif-unplugged-a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:47:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4f265a06-b20e-4560-96fe-1965c5421d88 req-1cf0e2b2-caef-4963-9050-4a12ecb03f31 service nova] Acquiring lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4f265a06-b20e-4560-96fe-1965c5421d88 req-1cf0e2b2-caef-4963-9050-4a12ecb03f31 service nova] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4f265a06-b20e-4560-96fe-1965c5421d88 req-1cf0e2b2-caef-4963-9050-4a12ecb03f31 service nova] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-4f265a06-b20e-4560-96fe-1965c5421d88 req-1cf0e2b2-caef-4963-9050-4a12ecb03f31 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] No waiting events found dispatching network-vif-unplugged-a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:47:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-4f265a06-b20e-4560-96fe-1965c5421d88 req-1cf0e2b2-caef-4963-9050-4a12ecb03f31 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Received event network-vif-unplugged-a8fe6401-b45e-4c64-b975-963eeecc7516 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:47:51 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Instance destroyed successfully.
Nov 02 01:47:51 user nova-compute[74996]: DEBUG nova.objects.instance [None req-de7aed36-25c0-4c21-9f7f-2aa3b762f533 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lazy-loading 'resources' on Instance uuid f0de5980-334b-4654-8b1a-88c4c861aa49 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:47:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-de7aed36-25c0-4c21-9f7f-2aa3b762f533 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1625581851',display_name='tempest-ServerStableDeviceRescueTest-server-1625581851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1625581851',id=23,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEK8Sx58tlmlBIUf+BUgUFMWnLbDRHHFCCjwrW+5A7V6+CJXFa4iqA+tn8c5R1h1LqApc/K3DXH7VI97JPeKjgNFqdRaZxPpdxRt/kUhiGhAn5AGwQVIOmuoVwNFfaET8w==',key_name='tempest-keypair-2039863911',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:44:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9cafad1855f4b3b98cba6bb24f7562b',ramdisk_id='',reservation_id='r-s6tn81gr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1201179668',owner_user_name='tempest-ServerStableDeviceRescueTest-1201179668-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:46:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b023d5c4fe1e45a6a4594cdd303a352f',uuid=f0de5980-334b-4654-8b1a-88c4c861aa49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8fe6401-b45e-4c64-b975-963eeecc7516", "address": "fa:16:3e:02:4b:04", "network": {"id": "7de1ec81-4bf0-4099-a317-52e3c4b64f4e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-840004831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cafad1855f4b3b98cba6bb24f7562b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8fe6401-b4", "ovs_interfaceid": "a8fe6401-b45e-4c64-b975-963eeecc7516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:47:51 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-de7aed36-25c0-4c21-9f7f-2aa3b762f533 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Converting VIF {"id": "a8fe6401-b45e-4c64-b975-963eeecc7516", "address": "fa:16:3e:02:4b:04", "network": {"id": "7de1ec81-4bf0-4099-a317-52e3c4b64f4e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-840004831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cafad1855f4b3b98cba6bb24f7562b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8fe6401-b4", "ovs_interfaceid": "a8fe6401-b45e-4c64-b975-963eeecc7516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:47:51 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-de7aed36-25c0-4c21-9f7f-2aa3b762f533 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:4b:04,bridge_name='br-int',has_traffic_filtering=True,id=a8fe6401-b45e-4c64-b975-963eeecc7516,network=Network(7de1ec81-4bf0-4099-a317-52e3c4b64f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8fe6401-b4') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:47:51 user nova-compute[74996]: DEBUG os_vif [None req-de7aed36-25c0-4c21-9f7f-2aa3b762f533 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:4b:04,bridge_name='br-int',has_traffic_filtering=True,id=a8fe6401-b45e-4c64-b975-963eeecc7516,network=Network(7de1ec81-4bf0-4099-a317-52e3c4b64f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8fe6401-b4') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:47:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8fe6401-b4, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:47:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98d29ed1-2d4b-41f3-8b1f-7d9eac0b430b) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:47:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:51 user nova-compute[74996]: INFO os_vif [None req-de7aed36-25c0-4c21-9f7f-2aa3b762f533 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:4b:04,bridge_name='br-int',has_traffic_filtering=True,id=a8fe6401-b45e-4c64-b975-963eeecc7516,network=Network(7de1ec81-4bf0-4099-a317-52e3c4b64f4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8fe6401-b4')
Nov 02 01:47:51 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-de7aed36-25c0-4c21-9f7f-2aa3b762f533 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Deleting instance files /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49_del
Nov 02 01:47:51 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-de7aed36-25c0-4c21-9f7f-2aa3b762f533 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Deletion of /opt/stack/data/nova/instances/f0de5980-334b-4654-8b1a-88c4c861aa49_del complete
Nov 02 01:47:51 user nova-compute[74996]: INFO nova.compute.manager [None req-de7aed36-25c0-4c21-9f7f-2aa3b762f533 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 02 01:47:51 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-de7aed36-25c0-4c21-9f7f-2aa3b762f533 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:47:51 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:47:51 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:47:52 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:47:52 user nova-compute[74996]: DEBUG nova.compute.manager [req-017d0947-060d-47d9-b884-c1249c9e1069 req-307abad0-e41b-41ae-8df9-77f792ae0747 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Received event network-vif-deleted-a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:47:52 user nova-compute[74996]: INFO nova.compute.manager [req-017d0947-060d-47d9-b884-c1249c9e1069 req-307abad0-e41b-41ae-8df9-77f792ae0747 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Neutron deleted interface a8fe6401-b45e-4c64-b975-963eeecc7516; detaching it from the instance and deleting it from the info cache
Nov 02 01:47:52 user nova-compute[74996]: DEBUG nova.network.neutron [req-017d0947-060d-47d9-b884-c1249c9e1069 req-307abad0-e41b-41ae-8df9-77f792ae0747 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:47:52 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Took 0.95 seconds to deallocate network for instance.
Nov 02 01:47:52 user nova-compute[74996]: DEBUG nova.compute.manager [req-017d0947-060d-47d9-b884-c1249c9e1069 req-307abad0-e41b-41ae-8df9-77f792ae0747 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Detach interface failed, port_id=a8fe6401-b45e-4c64-b975-963eeecc7516, reason: Instance f0de5980-334b-4654-8b1a-88c4c861aa49 could not be found. {{(pid=74996) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 01:47:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-de7aed36-25c0-4c21-9f7f-2aa3b762f533 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-de7aed36-25c0-4c21-9f7f-2aa3b762f533 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:53 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-de7aed36-25c0-4c21-9f7f-2aa3b762f533 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:47:53 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-de7aed36-25c0-4c21-9f7f-2aa3b762f533 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:47:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-de7aed36-25c0-4c21-9f7f-2aa3b762f533 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.302s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:53 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-de7aed36-25c0-4c21-9f7f-2aa3b762f533 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Deleted allocations for instance f0de5980-334b-4654-8b1a-88c4c861aa49
Nov 02 01:47:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-de7aed36-25c0-4c21-9f7f-2aa3b762f533 tempest-ServerStableDeviceRescueTest-1201179668 tempest-ServerStableDeviceRescueTest-1201179668-project-member] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.375s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:53 user nova-compute[74996]: DEBUG nova.compute.manager [req-327f0885-ec89-4629-8618-b6093df981ed req-6ee8dfdf-11e7-41f2-88d5-334c3ae6d857 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Received event network-vif-plugged-a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:47:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-327f0885-ec89-4629-8618-b6093df981ed req-6ee8dfdf-11e7-41f2-88d5-334c3ae6d857 service nova] Acquiring lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-327f0885-ec89-4629-8618-b6093df981ed req-6ee8dfdf-11e7-41f2-88d5-334c3ae6d857 service nova] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-327f0885-ec89-4629-8618-b6093df981ed req-6ee8dfdf-11e7-41f2-88d5-334c3ae6d857 service nova] Lock "f0de5980-334b-4654-8b1a-88c4c861aa49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:53 user nova-compute[74996]: DEBUG nova.compute.manager [req-327f0885-ec89-4629-8618-b6093df981ed req-6ee8dfdf-11e7-41f2-88d5-334c3ae6d857 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] No waiting events found dispatching network-vif-plugged-a8fe6401-b45e-4c64-b975-963eeecc7516 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:47:53 user nova-compute[74996]: WARNING nova.compute.manager [req-327f0885-ec89-4629-8618-b6093df981ed req-6ee8dfdf-11e7-41f2-88d5-334c3ae6d857 service nova] [instance: f0de5980-334b-4654-8b1a-88c4c861aa49] Received unexpected event network-vif-plugged-a8fe6401-b45e-4c64-b975-963eeecc7516 for instance with vm_state deleted and task_state None.
Nov 02 01:47:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "c85f24f9-3441-4825-80a0-386d69727605" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "c85f24f9-3441-4825-80a0-386d69727605" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG nova.compute.manager [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:47:56 user nova-compute[74996]: INFO nova.compute.claims [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Claim successful on node user
Nov 02 01:47:56 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.306s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG nova.compute.manager [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG nova.compute.manager [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG nova.network.neutron [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:47:56 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:47:56 user nova-compute[74996]: DEBUG nova.compute.manager [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG nova.policy [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be6bf504c3a649898e8c83399f6fee8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31965b482eb243a69112a49bf1302779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:47:56 user nova-compute[74996]: INFO nova.virt.block_device [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Booting with volume f5a26f9c-f371-4a37-990c-eadd5a9bcfae at /dev/vda
Nov 02 01:47:56 user nova-compute[74996]: DEBUG os_brick.utils [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[41842403-b6a8-4eba-9b8b-32f486b839f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9444200d-70bd-4292-b30a-44b0e4be1e57]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e8216d-c3cf-4dd9-a0ba-de39f86b0d40]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76ee7d5-3d1b-4d34-bd5a-4e45f50c8822]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:47:56 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:47:56 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a9dcfd-6195-4875-b8d7-4f717c9b2fa9]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG os_brick.utils [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Updating existing volume attachment record: 272685dd-6e63-4bad-bc3f-f04f3bfe10c3 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:47:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:57 user nova-compute[74996]: DEBUG nova.network.neutron [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Successfully created port: 012d4eb1-16b8-4820-b5b1-dc84b66435c1 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:47:58 user nova-compute[74996]: DEBUG nova.network.neutron [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Successfully updated port: 012d4eb1-16b8-4820-b5b1-dc84b66435c1 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:47:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "refresh_cache-c85f24f9-3441-4825-80a0-386d69727605" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:47:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquired lock "refresh_cache-c85f24f9-3441-4825-80a0-386d69727605" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:47:58 user nova-compute[74996]: DEBUG nova.network.neutron [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:47:58 user nova-compute[74996]: DEBUG nova.compute.manager [req-0595c3de-8c89-4e1d-a85f-c4b33c0ba531 req-7ef714b1-294a-4068-a692-806e57da8b80 service nova] [instance: c85f24f9-3441-4825-80a0-386d69727605] Received event network-changed-012d4eb1-16b8-4820-b5b1-dc84b66435c1 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:47:58 user nova-compute[74996]: DEBUG nova.compute.manager [req-0595c3de-8c89-4e1d-a85f-c4b33c0ba531 req-7ef714b1-294a-4068-a692-806e57da8b80 service nova] [instance: c85f24f9-3441-4825-80a0-386d69727605] Refreshing instance network info cache due to event network-changed-012d4eb1-16b8-4820-b5b1-dc84b66435c1. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:47:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0595c3de-8c89-4e1d-a85f-c4b33c0ba531 req-7ef714b1-294a-4068-a692-806e57da8b80 service nova] Acquiring lock "refresh_cache-c85f24f9-3441-4825-80a0-386d69727605" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:47:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:47:58 user nova-compute[74996]: DEBUG nova.network.neutron [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:47:58 user nova-compute[74996]: DEBUG nova.network.neutron [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Updating instance_info_cache with network_info: [{"id": "012d4eb1-16b8-4820-b5b1-dc84b66435c1", "address": "fa:16:3e:5d:f1:5f", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d4eb1-16", "ovs_interfaceid": "012d4eb1-16b8-4820-b5b1-dc84b66435c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:47:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Releasing lock "refresh_cache-c85f24f9-3441-4825-80a0-386d69727605" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:47:58 user nova-compute[74996]: DEBUG nova.compute.manager [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Instance network_info: |[{"id": "012d4eb1-16b8-4820-b5b1-dc84b66435c1", "address": "fa:16:3e:5d:f1:5f", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d4eb1-16", "ovs_interfaceid": "012d4eb1-16b8-4820-b5b1-dc84b66435c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:47:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0595c3de-8c89-4e1d-a85f-c4b33c0ba531 req-7ef714b1-294a-4068-a692-806e57da8b80 service nova] Acquired lock "refresh_cache-c85f24f9-3441-4825-80a0-386d69727605" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:47:58 user nova-compute[74996]: DEBUG nova.network.neutron [req-0595c3de-8c89-4e1d-a85f-c4b33c0ba531 req-7ef714b1-294a-4068-a692-806e57da8b80 service nova] [instance: c85f24f9-3441-4825-80a0-386d69727605] Refreshing network info cache for port 012d4eb1-16b8-4820-b5b1-dc84b66435c1 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:47:59 user nova-compute[74996]: DEBUG nova.network.neutron [req-0595c3de-8c89-4e1d-a85f-c4b33c0ba531 req-7ef714b1-294a-4068-a692-806e57da8b80 service nova] [instance: c85f24f9-3441-4825-80a0-386d69727605] Updated VIF entry in instance network info cache for port 012d4eb1-16b8-4820-b5b1-dc84b66435c1. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:47:59 user nova-compute[74996]: DEBUG nova.network.neutron [req-0595c3de-8c89-4e1d-a85f-c4b33c0ba531 req-7ef714b1-294a-4068-a692-806e57da8b80 service nova] [instance: c85f24f9-3441-4825-80a0-386d69727605] Updating instance_info_cache with network_info: [{"id": "012d4eb1-16b8-4820-b5b1-dc84b66435c1", "address": "fa:16:3e:5d:f1:5f", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d4eb1-16", "ovs_interfaceid": "012d4eb1-16b8-4820-b5b1-dc84b66435c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:47:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0595c3de-8c89-4e1d-a85f-c4b33c0ba531 req-7ef714b1-294a-4068-a692-806e57da8b80 service nova] Releasing lock "refresh_cache-c85f24f9-3441-4825-80a0-386d69727605" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:48:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcDXGVrB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:48:06 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:48:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:48:06 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:48:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:48:06 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec02c7b8-47ec-4caf-be6a-092ae8ac34bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:48:06 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafa434c-1b26-4151-80de-f84c24c34a87]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5] added
Nov 02 01:48:06 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a90708-442c-4e7a-82ee-9d452d3efc7a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0f39d8-c90f-4b2e-a794-ba828ca751af]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lcDXGVrB {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lcDXGVrB" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e6eb40-0bae-4eb6-a9ad-faad6097e955]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lcDXGVrB'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d30374-2b9a-4b79-a270-7f96a322a811]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cdc644-e102-415a-8721-7e74ad980406]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:48:06 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:48:06 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec55f38-e4aa-4bab-85f4-f3447819ce7b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5, portal: 172.16.0.220,3260]
Nov 02 01:48:06 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5, portal: 172.16.0.220,3260] successful.
Nov 02 01:48:06 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9db4620-bfbd-4221-b3cc-b5350d4fe4d5]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3cca2a-99ac-415e-837b-01c34e74e0ef]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:48:06 user nova-compute[74996]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 (non-flash)
Nov 02 01:48:06 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:48:06 user nova-compute[74996]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 (non-flash)
Nov 02 01:48:06 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[95af729c-9a4a-43a4-ac47-0d9fc06f1cb6]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcDXGVrB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:48:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:07 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:48:07 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23839333266353963', 'path': '/dev/sdc'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:48:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839333266353963', 'path': '/dev/sdc'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:48:07 user nova-compute[74996]: DEBUG nova.objects.instance [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lazy-loading 'flavor' on Instance uuid 1fd1c257-2903-47ce-bd31-a00ba6a8b9df {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:48:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 01:48:07 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:48:07 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 01:48:07 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:48:07 user nova-compute[74996]:   <serial>6c576699-0498-40b1-8736-0a5b8e654aa5</serial>
Nov 02 01:48:07 user nova-compute[74996]: </disk>
Nov 02 01:48:07 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 01:48:08 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:48:08 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:48:08 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] No VIF found with MAC fa:16:3e:90:44:8b, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:48:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-922b3e45-5c7b-488a-8286-4a99ce0e9beb tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.515s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:48:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:48:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:48:08 user nova-compute[74996]: INFO nova.compute.manager [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Detaching volume 6c576699-0498-40b1-8736-0a5b8e654aa5
Nov 02 01:48:09 user nova-compute[74996]: INFO nova.virt.block_device [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Attempting to driver detach volume 6c576699-0498-40b1-8736-0a5b8e654aa5 from mountpoint /dev/vdb
Nov 02 01:48:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Attempting to detach device vdb from instance 1fd1c257-2903-47ce-bd31-a00ba6a8b9df from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 01:48:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 01:48:09 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:48:09 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 01:48:09 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:48:09 user nova-compute[74996]:   <serial>6c576699-0498-40b1-8736-0a5b8e654aa5</serial>
Nov 02 01:48:09 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 01:48:09 user nova-compute[74996]: </disk>
Nov 02 01:48:09 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:48:09 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Successfully detached device vdb from instance 1fd1c257-2903-47ce-bd31-a00ba6a8b9df from the persistent domain config.
Nov 02 01:48:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1fd1c257-2903-47ce-bd31-a00ba6a8b9df from the live domain config. {{(pid=74996) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 01:48:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 01:48:09 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:48:09 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 01:48:09 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:48:09 user nova-compute[74996]:   <serial>6c576699-0498-40b1-8736-0a5b8e654aa5</serial>
Nov 02 01:48:09 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 01:48:09 user nova-compute[74996]: </disk>
Nov 02 01:48:09 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:48:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1fd1c257-2903-47ce-bd31-a00ba6a8b9df {{(pid=74996) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 01:48:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG nova.compute.manager [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:48:16 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Creating image(s)
Nov 02 01:48:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Did not create local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Ensure instance console log exists: /opt/stack/data/nova/instances/c85f24f9-3441-4825-80a0-386d69727605/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Start _get_guest_xml network_info=[{"id": "012d4eb1-16b8-4820-b5b1-dc84b66435c1", "address": "fa:16:3e:5d:f1:5f", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d4eb1-16", "ovs_interfaceid": "012d4eb1-16b8-4820-b5b1-dc84b66435c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '272685dd-6e63-4bad-bc3f-f04f3bfe10c3', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zpiYoRgf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c85f24f9-3441-4825-80a0-386d69727605', 'attached_at': '', 'detached_at': '', 'volume_id': 'f5a26f9c-f371-4a37-990c-eadd5a9bcfae', 'serial': 'f5a26f9c-f371-4a37-990c-eadd5a9bcfae'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:48:16 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:48:16 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:48:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zpiYoRgf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:48:16 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:48:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:48:16 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:48:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:48:16 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b60e60b-fe27-4682-b3d7-bc760db862c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:48:16 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef7edbe-685f-4891-92e9-bc28fd898102]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae] added
Nov 02 01:48:16 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[05204afb-6c2d-48ad-bff4-1b692169655e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99651c3-400f-4fba-96c8-df52f9749873]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zpiYoRgf {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zpiYoRgf" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f6a16e-536a-4ac7-a9a2-64abda9568f5]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zpiYoRgf'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ddf6a9-0c07-4826-99b5-9d84ee07e9b5]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8b4972-b75a-41bc-8db5-cf6fa4b84d69]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:48:16 user nova-compute[74996]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 (non-flash)
Nov 02 01:48:16 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:48:16 user nova-compute[74996]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 (non-flash)
Nov 02 01:48:16 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9f3913-ced9-4f6b-a890-7187b71f498d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae, portal: 172.16.0.220,3260]
Nov 02 01:48:16 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae, portal: 172.16.0.220,3260] successful.
Nov 02 01:48:16 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c20d98-d37c-44ad-ae54-4002624c08ac]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57baf35-a8cf-482d-a5d8-90b11b470afa]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:48:16 user nova-compute[74996]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 (non-flash)
Nov 02 01:48:16 user nova-compute[74996]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:48:16 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:48:16 user nova-compute[74996]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 (non-flash)
Nov 02 01:48:16 user nova-compute[74996]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:48:16 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbef37ad-e30e-4e5f-ad00-129935c4e93b]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:48:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zpiYoRgf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:48:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:48:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23031336434663264', 'path': '/dev/sdd'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:48:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031336434663264', 'path': '/dev/sdd'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:48:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:47:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2013968075',display_name='tempest-TestVolumeBootPattern-server-2013968075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2013968075',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqKsx295qdP4lg7887w79wguzwBudaKLS1CaKDMdZBRiyydUejeP/bphRv12kudSVdoUpRoo+kfCoJgBSoxWJoJnZVJJAUy53PGnOOqIVwETBw7ua4uyU/hdtrnp6uX6w==',key_name='tempest-TestVolumeBootPattern-1607904644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31965b482eb243a69112a49bf1302779',ramdisk_id='',reservation_id='r-fadte35w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-216720976',owner_user_name='tempest-TestVolumeBootPattern-216720976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:47:57Z,user_data=None,user_id='be6bf504c3a649898e8c83399f6fee8e',uuid=c85f24f9-3441-4825-80a0-386d69727605,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "012d4eb1-16b8-4820-b5b1-dc84b66435c1", "address": "fa:16:3e:5d:f1:5f", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d4eb1-16", "ovs_interfaceid": "012d4eb1-16b8-4820-b5b1-dc84b66435c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:48:17 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converting VIF {"id": "012d4eb1-16b8-4820-b5b1-dc84b66435c1", "address": "fa:16:3e:5d:f1:5f", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d4eb1-16", "ovs_interfaceid": "012d4eb1-16b8-4820-b5b1-dc84b66435c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:48:17 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:f1:5f,bridge_name='br-int',has_traffic_filtering=True,id=012d4eb1-16b8-4820-b5b1-dc84b66435c1,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012d4eb1-16') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:48:17 user nova-compute[74996]: DEBUG nova.objects.instance [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lazy-loading 'pci_devices' on Instance uuid c85f24f9-3441-4825-80a0-386d69727605 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:48:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:48:17 user nova-compute[74996]:   <uuid>c85f24f9-3441-4825-80a0-386d69727605</uuid>
Nov 02 01:48:17 user nova-compute[74996]:   <name>instance-00000023</name>
Nov 02 01:48:17 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:48:17 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:48:17 user nova-compute[74996]:   <metadata>
Nov 02 01:48:17 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:48:17 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:48:17 user nova-compute[74996]:       <nova:name>tempest-TestVolumeBootPattern-server-2013968075</nova:name>
Nov 02 01:48:17 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:48:16</nova:creationTime>
Nov 02 01:48:17 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:48:17 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:48:17 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:48:17 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:48:17 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:48:17 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:48:17 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:48:17 user nova-compute[74996]:       <nova:owner>
Nov 02 01:48:17 user nova-compute[74996]:         <nova:user uuid="be6bf504c3a649898e8c83399f6fee8e">tempest-TestVolumeBootPattern-216720976-project-member</nova:user>
Nov 02 01:48:17 user nova-compute[74996]:         <nova:project uuid="31965b482eb243a69112a49bf1302779">tempest-TestVolumeBootPattern-216720976</nova:project>
Nov 02 01:48:17 user nova-compute[74996]:       </nova:owner>
Nov 02 01:48:17 user nova-compute[74996]:       <nova:ports>
Nov 02 01:48:17 user nova-compute[74996]:         <nova:port uuid="012d4eb1-16b8-4820-b5b1-dc84b66435c1">
Nov 02 01:48:17 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 01:48:17 user nova-compute[74996]:         </nova:port>
Nov 02 01:48:17 user nova-compute[74996]:       </nova:ports>
Nov 02 01:48:17 user nova-compute[74996]:     </nova:instance>
Nov 02 01:48:17 user nova-compute[74996]:   </metadata>
Nov 02 01:48:17 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:48:17 user nova-compute[74996]:     <system>
Nov 02 01:48:17 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:48:17 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:48:17 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:48:17 user nova-compute[74996]:       <entry name="serial">c85f24f9-3441-4825-80a0-386d69727605</entry>
Nov 02 01:48:17 user nova-compute[74996]:       <entry name="uuid">c85f24f9-3441-4825-80a0-386d69727605</entry>
Nov 02 01:48:17 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:48:17 user nova-compute[74996]:     </system>
Nov 02 01:48:17 user nova-compute[74996]:   </sysinfo>
Nov 02 01:48:17 user nova-compute[74996]:   <os>
Nov 02 01:48:17 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:48:17 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:48:17 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:48:17 user nova-compute[74996]:   </os>
Nov 02 01:48:17 user nova-compute[74996]:   <features>
Nov 02 01:48:17 user nova-compute[74996]:     <acpi/>
Nov 02 01:48:17 user nova-compute[74996]:     <apic/>
Nov 02 01:48:17 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:48:17 user nova-compute[74996]:   </features>
Nov 02 01:48:17 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:48:17 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:48:17 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:48:17 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:48:17 user nova-compute[74996]:   </clock>
Nov 02 01:48:17 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:48:17 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:48:17 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:48:17 user nova-compute[74996]:   </cpu>
Nov 02 01:48:17 user nova-compute[74996]:   <devices>
Nov 02 01:48:17 user nova-compute[74996]:     <disk type="block" device="disk">
Nov 02 01:48:17 user nova-compute[74996]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:48:17 user nova-compute[74996]:       <source dev="/dev/sdd"/>
Nov 02 01:48:17 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:48:17 user nova-compute[74996]:       <serial>f5a26f9c-f371-4a37-990c-eadd5a9bcfae</serial>
Nov 02 01:48:17 user nova-compute[74996]:     </disk>
Nov 02 01:48:17 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:48:17 user nova-compute[74996]:       <mac address="fa:16:3e:5d:f1:5f"/>
Nov 02 01:48:17 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:48:17 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:48:17 user nova-compute[74996]:       <target dev="tap012d4eb1-16"/>
Nov 02 01:48:17 user nova-compute[74996]:     </interface>
Nov 02 01:48:17 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:48:17 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/c85f24f9-3441-4825-80a0-386d69727605/console.log" append="off"/>
Nov 02 01:48:17 user nova-compute[74996]:     </serial>
Nov 02 01:48:17 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:48:17 user nova-compute[74996]:     <video>
Nov 02 01:48:17 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:48:17 user nova-compute[74996]:     </video>
Nov 02 01:48:17 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:48:17 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:48:17 user nova-compute[74996]:     </rng>
Nov 02 01:48:17 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:48:17 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:48:17 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:48:17 user nova-compute[74996]:     </memballoon>
Nov 02 01:48:17 user nova-compute[74996]:   </devices>
Nov 02 01:48:17 user nova-compute[74996]: </domain>
Nov 02 01:48:17 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:48:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:47:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2013968075',display_name='tempest-TestVolumeBootPattern-server-2013968075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2013968075',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqKsx295qdP4lg7887w79wguzwBudaKLS1CaKDMdZBRiyydUejeP/bphRv12kudSVdoUpRoo+kfCoJgBSoxWJoJnZVJJAUy53PGnOOqIVwETBw7ua4uyU/hdtrnp6uX6w==',key_name='tempest-TestVolumeBootPattern-1607904644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31965b482eb243a69112a49bf1302779',ramdisk_id='',reservation_id='r-fadte35w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-216720976',owner_user_name='tempest-TestVolumeBootPattern-216720976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:47:57Z,user_data=None,user_id='be6bf504c3a649898e8c83399f6fee8e',uuid=c85f24f9-3441-4825-80a0-386d69727605,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "012d4eb1-16b8-4820-b5b1-dc84b66435c1", "address": "fa:16:3e:5d:f1:5f", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d4eb1-16", "ovs_interfaceid": "012d4eb1-16b8-4820-b5b1-dc84b66435c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:48:17 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converting VIF {"id": "012d4eb1-16b8-4820-b5b1-dc84b66435c1", "address": "fa:16:3e:5d:f1:5f", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d4eb1-16", "ovs_interfaceid": "012d4eb1-16b8-4820-b5b1-dc84b66435c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:48:17 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:f1:5f,bridge_name='br-int',has_traffic_filtering=True,id=012d4eb1-16b8-4820-b5b1-dc84b66435c1,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012d4eb1-16') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:48:17 user nova-compute[74996]: DEBUG os_vif [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:f1:5f,bridge_name='br-int',has_traffic_filtering=True,id=012d4eb1-16b8-4820-b5b1-dc84b66435c1,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012d4eb1-16') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:48:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:48:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:48:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b9eb7c6-e6f5-5439-b01a-06e9cc6d9a26', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:48:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap012d4eb1-16, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:48:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap012d4eb1-16, col_values=(('qos', UUID('e32bc4a8-9d5f-466e-81d4-875273ef803f')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:48:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap012d4eb1-16, col_values=(('external_ids', {'iface-id': '012d4eb1-16b8-4820-b5b1-dc84b66435c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:f1:5f', 'vm-uuid': 'c85f24f9-3441-4825-80a0-386d69727605'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:48:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:48:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:17 user nova-compute[74996]: INFO os_vif [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:f1:5f,bridge_name='br-int',has_traffic_filtering=True,id=012d4eb1-16b8-4820-b5b1-dc84b66435c1,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012d4eb1-16')
Nov 02 01:48:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:48:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] No VIF found with MAC fa:16:3e:5d:f1:5f, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:48:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:19 user nova-compute[74996]: DEBUG nova.compute.manager [req-a24f328a-6841-4c46-bd53-050b053facb4 req-146ef9ef-ebce-4c63-af13-a213e5f8c0b3 service nova] [instance: c85f24f9-3441-4825-80a0-386d69727605] Received event network-vif-plugged-012d4eb1-16b8-4820-b5b1-dc84b66435c1 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:48:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a24f328a-6841-4c46-bd53-050b053facb4 req-146ef9ef-ebce-4c63-af13-a213e5f8c0b3 service nova] Acquiring lock "c85f24f9-3441-4825-80a0-386d69727605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:48:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a24f328a-6841-4c46-bd53-050b053facb4 req-146ef9ef-ebce-4c63-af13-a213e5f8c0b3 service nova] Lock "c85f24f9-3441-4825-80a0-386d69727605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:48:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a24f328a-6841-4c46-bd53-050b053facb4 req-146ef9ef-ebce-4c63-af13-a213e5f8c0b3 service nova] Lock "c85f24f9-3441-4825-80a0-386d69727605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:48:19 user nova-compute[74996]: DEBUG nova.compute.manager [req-a24f328a-6841-4c46-bd53-050b053facb4 req-146ef9ef-ebce-4c63-af13-a213e5f8c0b3 service nova] [instance: c85f24f9-3441-4825-80a0-386d69727605] No waiting events found dispatching network-vif-plugged-012d4eb1-16b8-4820-b5b1-dc84b66435c1 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:48:19 user nova-compute[74996]: WARNING nova.compute.manager [req-a24f328a-6841-4c46-bd53-050b053facb4 req-146ef9ef-ebce-4c63-af13-a213e5f8c0b3 service nova] [instance: c85f24f9-3441-4825-80a0-386d69727605] Received unexpected event network-vif-plugged-012d4eb1-16b8-4820-b5b1-dc84b66435c1 for instance with vm_state building and task_state spawning.
Nov 02 01:48:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:20 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:48:20 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:48:21 user nova-compute[74996]: DEBUG nova.compute.manager [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:48:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:48:21 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: c85f24f9-3441-4825-80a0-386d69727605] Instance spawned successfully.
Nov 02 01:48:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:48:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:48:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:48:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:48:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:48:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:48:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:48:21 user nova-compute[74996]: INFO nova.compute.manager [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 02 01:48:21 user nova-compute[74996]: DEBUG nova.compute.manager [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:48:21 user nova-compute[74996]: DEBUG nova.compute.manager [req-1b2ba339-2b8e-41a1-85eb-a11740760a38 req-bf91dd25-b555-4492-929a-35c0d45305f8 service nova] [instance: c85f24f9-3441-4825-80a0-386d69727605] Received event network-vif-plugged-012d4eb1-16b8-4820-b5b1-dc84b66435c1 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:48:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1b2ba339-2b8e-41a1-85eb-a11740760a38 req-bf91dd25-b555-4492-929a-35c0d45305f8 service nova] Acquiring lock "c85f24f9-3441-4825-80a0-386d69727605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:48:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1b2ba339-2b8e-41a1-85eb-a11740760a38 req-bf91dd25-b555-4492-929a-35c0d45305f8 service nova] Lock "c85f24f9-3441-4825-80a0-386d69727605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:48:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1b2ba339-2b8e-41a1-85eb-a11740760a38 req-bf91dd25-b555-4492-929a-35c0d45305f8 service nova] Lock "c85f24f9-3441-4825-80a0-386d69727605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:48:21 user nova-compute[74996]: DEBUG nova.compute.manager [req-1b2ba339-2b8e-41a1-85eb-a11740760a38 req-bf91dd25-b555-4492-929a-35c0d45305f8 service nova] [instance: c85f24f9-3441-4825-80a0-386d69727605] No waiting events found dispatching network-vif-plugged-012d4eb1-16b8-4820-b5b1-dc84b66435c1 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:48:21 user nova-compute[74996]: WARNING nova.compute.manager [req-1b2ba339-2b8e-41a1-85eb-a11740760a38 req-bf91dd25-b555-4492-929a-35c0d45305f8 service nova] [instance: c85f24f9-3441-4825-80a0-386d69727605] Received unexpected event network-vif-plugged-012d4eb1-16b8-4820-b5b1-dc84b66435c1 for instance with vm_state building and task_state spawning.
Nov 02 01:48:21 user nova-compute[74996]: INFO nova.compute.manager [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Took 25.47 seconds to build instance.
Nov 02 01:48:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-aca91570-4df6-46ca-ab5b-60e5908b19a8 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "c85f24f9-3441-4825-80a0-386d69727605" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.596s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:48:22 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:48:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:48:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:48:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:48:22 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:48:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:48:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:48:22 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd1c257-2903-47ce-bd31-a00ba6a8b9df/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd1c257-2903-47ce-bd31-a00ba6a8b9df/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd1c257-2903-47ce-bd31-a00ba6a8b9df/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fd1c257-2903-47ce-bd31-a00ba6a8b9df/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c41599-fd0a-44d4-9289-fd92a4b86ca9/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c41599-fd0a-44d4-9289-fd92a4b86ca9/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c41599-fd0a-44d4-9289-fd92a4b86ca9/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c41599-fd0a-44d4-9289-fd92a4b86ca9/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:25 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:48:25 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:48:25 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=7876MB free_disk=25.17340850830078GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:48:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:48:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:48:25 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 1fd1c257-2903-47ce-bd31-a00ba6a8b9df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:48:25 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance e38704a7-f8a0-482c-bd51-26a90d37b71d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:48:25 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7c53e6cc-cf69-485d-b24f-5e113dae0e5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:48:25 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance effec7f0-1006-4081-91f4-e2d96fd0a87a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:48:25 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 18c41599-fd0a-44d4-9289-fd92a4b86ca9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:48:25 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 03114a20-c464-4ecd-850d-1a29a6ad2584 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:48:25 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance c85f24f9-3441-4825-80a0-386d69727605 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:48:25 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:48:25 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:48:25 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:48:25 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:48:25 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:48:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.482s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:48:27 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:48:27 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:48:27 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Rebuilding the list of instances to heal {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 01:48:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-1fd1c257-2903-47ce-bd31-a00ba6a8b9df" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:48:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-1fd1c257-2903-47ce-bd31-a00ba6a8b9df" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:48:27 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 01:48:27 user nova-compute[74996]: DEBUG nova.objects.instance [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lazy-loading 'info_cache' on Instance uuid 1fd1c257-2903-47ce-bd31-a00ba6a8b9df {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:48:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:28 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Updating instance_info_cache with network_info: [{"id": "b2105173-adeb-478a-abf5-24a32a1922fb", "address": "fa:16:3e:90:44:8b", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2105173-ad", "ovs_interfaceid": "b2105173-adeb-478a-abf5-24a32a1922fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:48:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-1fd1c257-2903-47ce-bd31-a00ba6a8b9df" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:48:28 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 01:48:28 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:48:28 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:48:28 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:48:28 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:48:28 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:48:29 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1fd1c257-2903-47ce-bd31-a00ba6a8b9df is timed out.
Nov 02 01:48:29 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Successfully detached device vdb from instance 1fd1c257-2903-47ce-bd31-a00ba6a8b9df from the live domain config.
Nov 02 01:48:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcDXGVrB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:48:29 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:48:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c54225-f858-46c6-b685-6eab404f62e0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:48:29 user nova-compute[74996]: No targets found.
Nov 02 01:48:29 user nova-compute[74996]: iSNS:
Nov 02 01:48:29 user nova-compute[74996]: No targets found.
Nov 02 01:48:29 user nova-compute[74996]: STATIC:
Nov 02 01:48:29 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5
Nov 02 01:48:29 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:48:29 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:48:29 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae
Nov 02 01:48:29 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:48:29 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:48:29 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494
Nov 02 01:48:29 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:48:29 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:48:29 user nova-compute[74996]: FIRMWARE:
Nov 02 01:48:29 user nova-compute[74996]: No targets found.
Nov 02 01:48:29 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:48:29 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:48:29 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff192a4-6253-44ab-a573-0885e9071e54]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49d980b-6686-4b04-b792-5972d952261b]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:48:29 user nova-compute[74996]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 (non-flash)
Nov 02 01:48:29 user nova-compute[74996]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:48:29 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:48:29 user nova-compute[74996]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 (non-flash)
Nov 02 01:48:29 user nova-compute[74996]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:48:29 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830c7072e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5'): ({'sdc'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Removing single pathed devices sdc {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d929c464-e6f1-4a41-bfb8-e89860ea4b33]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69abae1-e8e2-4ee0-a956-07db110173a4]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Flushing IO for device /dev/sdc {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfaa81f-4d0f-4927-bb11-ea25fdec6cc0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac56020e-f2d0-4d91-8a24-b4d411e47472]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f774aa2c-d55a-4ec5-84d2-f524af12f03d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be2d801-6448-4702-8dba-5cafdec328c7]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5, portal: 172.16.0.220,3260]
Nov 02 01:48:29 user nova-compute[74996]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5, portal: 172.16.0.220,3260] successful.
Nov 02 01:48:29 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c576699-0498-40b1-8736-0a5b8e654aa5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03986ad-d8a2-4871-8604-4bb935195726]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] <== disconnect_volume: return (281ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:48:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:48:30 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:48:30 user nova-compute[74996]: DEBUG nova.objects.instance [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lazy-loading 'flavor' on Instance uuid 1fd1c257-2903-47ce-bd31-a00ba6a8b9df {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:48:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8b26187e-ea08-4c47-8f8d-4f11d763245b tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.788s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:48:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:48:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 01:48:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:48:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:48:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:48:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:49 user nova-compute[74996]: INFO nova.compute.manager [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Rescuing
Nov 02 01:48:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "refresh_cache-7c53e6cc-cf69-485d-b24f-5e113dae0e5d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:48:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquired lock "refresh_cache-7c53e6cc-cf69-485d-b24f-5e113dae0e5d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:48:49 user nova-compute[74996]: DEBUG nova.network.neutron [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:48:49 user nova-compute[74996]: DEBUG nova.network.neutron [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Updating instance_info_cache with network_info: [{"id": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "address": "fa:16:3e:9b:c8:b7", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391c1ab0-6a", "ovs_interfaceid": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:48:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Releasing lock "refresh_cache-7c53e6cc-cf69-485d-b24f-5e113dae0e5d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:48:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:49 user nova-compute[74996]: DEBUG nova.compute.manager [req-287b58a2-8a50-4866-ade6-083ee8d28220 req-b272aec1-4c63-46cc-b71e-ddda1fb5abc3 service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Received event network-vif-unplugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:48:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-287b58a2-8a50-4866-ade6-083ee8d28220 req-b272aec1-4c63-46cc-b71e-ddda1fb5abc3 service nova] Acquiring lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:48:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-287b58a2-8a50-4866-ade6-083ee8d28220 req-b272aec1-4c63-46cc-b71e-ddda1fb5abc3 service nova] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:48:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-287b58a2-8a50-4866-ade6-083ee8d28220 req-b272aec1-4c63-46cc-b71e-ddda1fb5abc3 service nova] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:48:49 user nova-compute[74996]: DEBUG nova.compute.manager [req-287b58a2-8a50-4866-ade6-083ee8d28220 req-b272aec1-4c63-46cc-b71e-ddda1fb5abc3 service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] No waiting events found dispatching network-vif-unplugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:48:49 user nova-compute[74996]: WARNING nova.compute.manager [req-287b58a2-8a50-4866-ade6-083ee8d28220 req-b272aec1-4c63-46cc-b71e-ddda1fb5abc3 service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Received unexpected event network-vif-unplugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a for instance with vm_state active and task_state rescuing.
Nov 02 01:48:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:50 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Instance destroyed successfully.
Nov 02 01:48:50 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Attempting rescue
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74996) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Instance directory exists: not creating {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 01:48:50 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Creating image(s)
Nov 02 01:48:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "/opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "/opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.objects.instance [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7c53e6cc-cf69-485d-b24f-5e113dae0e5d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.185s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue" returned: 0 in 0.053s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.objects.instance [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lazy-loading 'migration_context' on Instance uuid 7c53e6cc-cf69-485d-b24f-5e113dae0e5d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.objects.base [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Object Instance<7c53e6cc-cf69-485d-b24f-5e113dae0e5d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Start _get_guest_xml network_info=[{"id": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "address": "fa:16:3e:9b:c8:b7", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "vif_mac": "fa:16:3e:9b:c8:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391c1ab0-6a", "ovs_interfaceid": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.objects.instance [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lazy-loading 'resources' on Instance uuid 7c53e6cc-cf69-485d-b24f-5e113dae0e5d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.objects.base [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Object Instance<7c53e6cc-cf69-485d-b24f-5e113dae0e5d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.objects.instance [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lazy-loading 'numa_topology' on Instance uuid 7c53e6cc-cf69-485d-b24f-5e113dae0e5d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.objects.base [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Object Instance<7c53e6cc-cf69-485d-b24f-5e113dae0e5d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:48:50 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:48:50 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.objects.instance [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7c53e6cc-cf69-485d-b24f-5e113dae0e5d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.objects.base [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Object Instance<7c53e6cc-cf69-485d-b24f-5e113dae0e5d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1398759994',display_name='tempest-ServerRescueNegativeTestJSON-server-1398759994',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1398759994',id=32,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:47:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d89083c24ba475f9159a80fddfe9159',ramdisk_id='',reservation_id='r-5l3af2z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1433266011',owner_user_name='tempest-ServerRescueNegativeTestJSON-1433266011-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:47:07Z,user_data=None,user_id='87e5cf8786fe44b5a5305f3be11d64c2',uuid=7c53e6cc-cf69-485d-b24f-5e113dae0e5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "address": "fa:16:3e:9b:c8:b7", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "vif_mac": "fa:16:3e:9b:c8:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391c1ab0-6a", "ovs_interfaceid": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Converting VIF {"id": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "address": "fa:16:3e:9b:c8:b7", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "vif_mac": "fa:16:3e:9b:c8:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391c1ab0-6a", "ovs_interfaceid": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:c8:b7,bridge_name='br-int',has_traffic_filtering=True,id=391c1ab0-6a16-4d16-894f-a061aac3fc6a,network=Network(81a443a7-0a10-4c81-9903-853291c58596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391c1ab0-6a') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.objects.instance [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c53e6cc-cf69-485d-b24f-5e113dae0e5d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.objects.base [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Object Instance<7c53e6cc-cf69-485d-b24f-5e113dae0e5d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:48:50 user nova-compute[74996]:   <uuid>7c53e6cc-cf69-485d-b24f-5e113dae0e5d</uuid>
Nov 02 01:48:50 user nova-compute[74996]:   <name>instance-00000020</name>
Nov 02 01:48:50 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:48:50 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:48:50 user nova-compute[74996]:   <metadata>
Nov 02 01:48:50 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:48:50 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:48:50 user nova-compute[74996]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1398759994</nova:name>
Nov 02 01:48:50 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:48:50</nova:creationTime>
Nov 02 01:48:50 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:48:50 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:48:50 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:48:50 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:48:50 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:48:50 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:48:50 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:48:50 user nova-compute[74996]:       <nova:owner>
Nov 02 01:48:50 user nova-compute[74996]:         <nova:user uuid="87e5cf8786fe44b5a5305f3be11d64c2">tempest-ServerRescueNegativeTestJSON-1433266011-project-member</nova:user>
Nov 02 01:48:50 user nova-compute[74996]:         <nova:project uuid="6d89083c24ba475f9159a80fddfe9159">tempest-ServerRescueNegativeTestJSON-1433266011</nova:project>
Nov 02 01:48:50 user nova-compute[74996]:       </nova:owner>
Nov 02 01:48:50 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:48:50 user nova-compute[74996]:       <nova:ports>
Nov 02 01:48:50 user nova-compute[74996]:         <nova:port uuid="391c1ab0-6a16-4d16-894f-a061aac3fc6a">
Nov 02 01:48:50 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 02 01:48:50 user nova-compute[74996]:         </nova:port>
Nov 02 01:48:50 user nova-compute[74996]:       </nova:ports>
Nov 02 01:48:50 user nova-compute[74996]:     </nova:instance>
Nov 02 01:48:50 user nova-compute[74996]:   </metadata>
Nov 02 01:48:50 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:48:50 user nova-compute[74996]:     <system>
Nov 02 01:48:50 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:48:50 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:48:50 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:48:50 user nova-compute[74996]:       <entry name="serial">7c53e6cc-cf69-485d-b24f-5e113dae0e5d</entry>
Nov 02 01:48:50 user nova-compute[74996]:       <entry name="uuid">7c53e6cc-cf69-485d-b24f-5e113dae0e5d</entry>
Nov 02 01:48:50 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:48:50 user nova-compute[74996]:     </system>
Nov 02 01:48:50 user nova-compute[74996]:   </sysinfo>
Nov 02 01:48:50 user nova-compute[74996]:   <os>
Nov 02 01:48:50 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:48:50 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:48:50 user nova-compute[74996]:   </os>
Nov 02 01:48:50 user nova-compute[74996]:   <features>
Nov 02 01:48:50 user nova-compute[74996]:     <acpi/>
Nov 02 01:48:50 user nova-compute[74996]:     <apic/>
Nov 02 01:48:50 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:48:50 user nova-compute[74996]:   </features>
Nov 02 01:48:50 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:48:50 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:48:50 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:48:50 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:48:50 user nova-compute[74996]:   </clock>
Nov 02 01:48:50 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:48:50 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:48:50 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:48:50 user nova-compute[74996]:   </cpu>
Nov 02 01:48:50 user nova-compute[74996]:   <devices>
Nov 02 01:48:50 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:48:50 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:48:50 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue"/>
Nov 02 01:48:50 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:48:50 user nova-compute[74996]:     </disk>
Nov 02 01:48:50 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:48:50 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:48:50 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk"/>
Nov 02 01:48:50 user nova-compute[74996]:       <target dev="vdb" bus="virtio"/>
Nov 02 01:48:50 user nova-compute[74996]:     </disk>
Nov 02 01:48:50 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:48:50 user nova-compute[74996]:       <mac address="fa:16:3e:9b:c8:b7"/>
Nov 02 01:48:50 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:48:50 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:48:50 user nova-compute[74996]:       <target dev="tap391c1ab0-6a"/>
Nov 02 01:48:50 user nova-compute[74996]:     </interface>
Nov 02 01:48:50 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:48:50 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/console.log" append="off"/>
Nov 02 01:48:50 user nova-compute[74996]:     </serial>
Nov 02 01:48:50 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:48:50 user nova-compute[74996]:     <video>
Nov 02 01:48:50 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:48:50 user nova-compute[74996]:     </video>
Nov 02 01:48:50 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:48:50 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:48:50 user nova-compute[74996]:     </rng>
Nov 02 01:48:50 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:48:50 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:48:50 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:48:50 user nova-compute[74996]:     </memballoon>
Nov 02 01:48:50 user nova-compute[74996]:   </devices>
Nov 02 01:48:50 user nova-compute[74996]: </domain>
Nov 02 01:48:50 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:48:50 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Instance destroyed successfully.
Nov 02 01:48:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:48:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] No VIF found with MAC fa:16:3e:9b:c8:b7, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:48:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Received event network-vif-plugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:48:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] Acquiring lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:48:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:48:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:48:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] No waiting events found dispatching network-vif-plugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:48:51 user nova-compute[74996]: WARNING nova.compute.manager [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Received unexpected event network-vif-plugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a for instance with vm_state active and task_state rescuing.
Nov 02 01:48:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Received event network-vif-plugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:48:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] Acquiring lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:48:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:48:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:48:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] No waiting events found dispatching network-vif-plugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:48:51 user nova-compute[74996]: WARNING nova.compute.manager [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Received unexpected event network-vif-plugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a for instance with vm_state active and task_state rescuing.
Nov 02 01:48:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Received event network-vif-plugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:48:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] Acquiring lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:48:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:48:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:48:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] No waiting events found dispatching network-vif-plugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:48:51 user nova-compute[74996]: WARNING nova.compute.manager [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Received unexpected event network-vif-plugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a for instance with vm_state active and task_state rescuing.
Nov 02 01:48:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Received event network-vif-unplugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:48:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] Acquiring lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:48:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:48:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:48:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] No waiting events found dispatching network-vif-unplugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:48:51 user nova-compute[74996]: WARNING nova.compute.manager [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Received unexpected event network-vif-unplugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a for instance with vm_state active and task_state rescuing.
Nov 02 01:48:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Received event network-vif-plugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:48:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] Acquiring lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:48:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:48:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:48:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] No waiting events found dispatching network-vif-plugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:48:51 user nova-compute[74996]: WARNING nova.compute.manager [req-7e552790-0815-42ed-9582-16f9a5554801 req-60916aa0-b6be-4f6b-9153-3fdfa5a94713 service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Received unexpected event network-vif-plugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a for instance with vm_state active and task_state rescuing.
Nov 02 01:48:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:53 user nova-compute[74996]: DEBUG nova.compute.manager [req-57e898ec-7ce4-411a-83ed-8aa71f6eb556 req-2da87c4c-6273-460e-9ec7-02239f17a4e0 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Received event network-changed-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:48:53 user nova-compute[74996]: DEBUG nova.compute.manager [req-57e898ec-7ce4-411a-83ed-8aa71f6eb556 req-2da87c4c-6273-460e-9ec7-02239f17a4e0 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Refreshing instance network info cache due to event network-changed-8cf50e3d-3da4-48fc-9cc9-bfe88441b531. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:48:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-57e898ec-7ce4-411a-83ed-8aa71f6eb556 req-2da87c4c-6273-460e-9ec7-02239f17a4e0 service nova] Acquiring lock "refresh_cache-effec7f0-1006-4081-91f4-e2d96fd0a87a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:48:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-57e898ec-7ce4-411a-83ed-8aa71f6eb556 req-2da87c4c-6273-460e-9ec7-02239f17a4e0 service nova] Acquired lock "refresh_cache-effec7f0-1006-4081-91f4-e2d96fd0a87a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:48:53 user nova-compute[74996]: DEBUG nova.network.neutron [req-57e898ec-7ce4-411a-83ed-8aa71f6eb556 req-2da87c4c-6273-460e-9ec7-02239f17a4e0 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Refreshing network info cache for port 8cf50e3d-3da4-48fc-9cc9-bfe88441b531 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:48:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Acquiring lock "effec7f0-1006-4081-91f4-e2d96fd0a87a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:48:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "effec7f0-1006-4081-91f4-e2d96fd0a87a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:48:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Acquiring lock "effec7f0-1006-4081-91f4-e2d96fd0a87a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:48:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "effec7f0-1006-4081-91f4-e2d96fd0a87a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:48:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "effec7f0-1006-4081-91f4-e2d96fd0a87a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:48:53 user nova-compute[74996]: INFO nova.compute.manager [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Terminating instance
Nov 02 01:48:53 user nova-compute[74996]: DEBUG nova.compute.manager [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:48:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:53 user nova-compute[74996]: DEBUG nova.compute.manager [req-bed1c3d4-8815-420b-bf57-b2c9db0ee1d6 req-32ddef0b-eba9-4ee0-8ec2-b6c23383080b service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Received event network-vif-plugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:48:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-bed1c3d4-8815-420b-bf57-b2c9db0ee1d6 req-32ddef0b-eba9-4ee0-8ec2-b6c23383080b service nova] Acquiring lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:48:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-bed1c3d4-8815-420b-bf57-b2c9db0ee1d6 req-32ddef0b-eba9-4ee0-8ec2-b6c23383080b service nova] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:48:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-bed1c3d4-8815-420b-bf57-b2c9db0ee1d6 req-32ddef0b-eba9-4ee0-8ec2-b6c23383080b service nova] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:48:53 user nova-compute[74996]: DEBUG nova.compute.manager [req-bed1c3d4-8815-420b-bf57-b2c9db0ee1d6 req-32ddef0b-eba9-4ee0-8ec2-b6c23383080b service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] No waiting events found dispatching network-vif-plugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:48:53 user nova-compute[74996]: WARNING nova.compute.manager [req-bed1c3d4-8815-420b-bf57-b2c9db0ee1d6 req-32ddef0b-eba9-4ee0-8ec2-b6c23383080b service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Received unexpected event network-vif-plugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a for instance with vm_state active and task_state rescuing.
Nov 02 01:48:53 user nova-compute[74996]: DEBUG nova.compute.manager [req-bed1c3d4-8815-420b-bf57-b2c9db0ee1d6 req-32ddef0b-eba9-4ee0-8ec2-b6c23383080b service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Received event network-vif-plugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:48:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-bed1c3d4-8815-420b-bf57-b2c9db0ee1d6 req-32ddef0b-eba9-4ee0-8ec2-b6c23383080b service nova] Acquiring lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:48:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-bed1c3d4-8815-420b-bf57-b2c9db0ee1d6 req-32ddef0b-eba9-4ee0-8ec2-b6c23383080b service nova] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:48:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-bed1c3d4-8815-420b-bf57-b2c9db0ee1d6 req-32ddef0b-eba9-4ee0-8ec2-b6c23383080b service nova] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:48:53 user nova-compute[74996]: DEBUG nova.compute.manager [req-bed1c3d4-8815-420b-bf57-b2c9db0ee1d6 req-32ddef0b-eba9-4ee0-8ec2-b6c23383080b service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] No waiting events found dispatching network-vif-plugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:48:53 user nova-compute[74996]: WARNING nova.compute.manager [req-bed1c3d4-8815-420b-bf57-b2c9db0ee1d6 req-32ddef0b-eba9-4ee0-8ec2-b6c23383080b service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Received unexpected event network-vif-plugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a for instance with vm_state active and task_state rescuing.
Nov 02 01:48:54 user nova-compute[74996]: DEBUG nova.network.neutron [req-57e898ec-7ce4-411a-83ed-8aa71f6eb556 req-2da87c4c-6273-460e-9ec7-02239f17a4e0 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Updated VIF entry in instance network info cache for port 8cf50e3d-3da4-48fc-9cc9-bfe88441b531. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG nova.network.neutron [req-57e898ec-7ce4-411a-83ed-8aa71f6eb556 req-2da87c4c-6273-460e-9ec7-02239f17a4e0 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Updating instance_info_cache with network_info: [{"id": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "address": "fa:16:3e:56:0b:6b", "network": {"id": "b3014958-040c-44b4-94cc-1099e8fe3750", "bridge": "br-int", "label": "tempest-TestShelveInstance-1407890304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca87a25a8b244b7989ea459300036d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf50e3d-3d", "ovs_interfaceid": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-57e898ec-7ce4-411a-83ed-8aa71f6eb556 req-2da87c4c-6273-460e-9ec7-02239f17a4e0 service nova] Releasing lock "refresh_cache-effec7f0-1006-4081-91f4-e2d96fd0a87a" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG nova.compute.manager [None req-55c73e7d-faa8-4ca2-8bd0-56d9586bd0dc tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:48:54 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Instance destroyed successfully.
Nov 02 01:48:54 user nova-compute[74996]: DEBUG nova.objects.instance [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lazy-loading 'resources' on Instance uuid effec7f0-1006-4081-91f4-e2d96fd0a87a {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T01:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1689709328',display_name='tempest-TestShelveInstance-server-1689709328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1689709328',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaTyRcwo/6qh2VUUUZQ7imznM0w+FhHVOMS4herOMA8kinuWHPKCco0BceOOJ4BPGCiEDQ5X04+2lK+/NaW63fmgUUQ8Q7OZ2TCFIlqp/8mjZzYpCt3Sstoj3ztaAlirQ==',key_name='tempest-TestShelveInstance-1132842490',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:47:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca87a25a8b244b7989ea459300036d8d',ramdisk_id='',reservation_id='r-tfi2zjgk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-457210861',owner_user_name='tempest-TestShelveInstance-457210861-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:47:33Z,user_data=None,user_id='670f527ebd064a39a3d19edffd8393f3',uuid=effec7f0-1006-4081-91f4-e2d96fd0a87a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "address": "fa:16:3e:56:0b:6b", "network": {"id": "b3014958-040c-44b4-94cc-1099e8fe3750", "bridge": "br-int", "label": "tempest-TestShelveInstance-1407890304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca87a25a8b244b7989ea459300036d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf50e3d-3d", "ovs_interfaceid": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Converting VIF {"id": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "address": "fa:16:3e:56:0b:6b", "network": {"id": "b3014958-040c-44b4-94cc-1099e8fe3750", "bridge": "br-int", "label": "tempest-TestShelveInstance-1407890304-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca87a25a8b244b7989ea459300036d8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cf50e3d-3d", "ovs_interfaceid": "8cf50e3d-3da4-48fc-9cc9-bfe88441b531", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=8cf50e3d-3da4-48fc-9cc9-bfe88441b531,network=Network(b3014958-040c-44b4-94cc-1099e8fe3750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cf50e3d-3d') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG os_vif [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=8cf50e3d-3da4-48fc-9cc9-bfe88441b531,network=Network(b3014958-040c-44b4-94cc-1099e8fe3750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cf50e3d-3d') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8cf50e3d-3d, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd661feb-e2d6-42d7-866b-3908442768c3) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:48:54 user nova-compute[74996]: INFO os_vif [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:0b:6b,bridge_name='br-int',has_traffic_filtering=True,id=8cf50e3d-3da4-48fc-9cc9-bfe88441b531,network=Network(b3014958-040c-44b4-94cc-1099e8fe3750),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cf50e3d-3d')
Nov 02 01:48:54 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VOtcoRsW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:48:54 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:48:54 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4478e2dc-8b9b-45a9-8c19-6887c9e4e0e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:48:54 user nova-compute[74996]: No targets found.
Nov 02 01:48:54 user nova-compute[74996]: iSNS:
Nov 02 01:48:54 user nova-compute[74996]: No targets found.
Nov 02 01:48:54 user nova-compute[74996]: STATIC:
Nov 02 01:48:54 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae
Nov 02 01:48:54 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:48:54 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:48:54 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494
Nov 02 01:48:54 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:48:54 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:48:54 user nova-compute[74996]: FIRMWARE:
Nov 02 01:48:54 user nova-compute[74996]: No targets found.
Nov 02 01:48:54 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:48:54 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:48:54 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4d9063-a800-4134-91a1-79ea9e7190bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5900f2f7-b7c4-4150-9d10-ab6bf18db765]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:48:54 user nova-compute[74996]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:48:54 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 (non-flash)
Nov 02 01:48:54 user nova-compute[74996]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:48:54 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e86ffc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494'): ({'sdb'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Removing single pathed devices sdb {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e4e7a2-814d-4557-94c4-6fb5813648f3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ac1715-4440-4824-b26c-7de0e4c2a655]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Flushing IO for device /dev/sdb {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff77908-7e9b-42bc-a6a6-486f2cece1e8]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e3235d-3991-48b5-9dc1-a5495d1f529c]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8efc86-2b7a-483f-ba2b-0a2698ba986c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:48:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:55 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:55 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece26ba4-a256-453b-998c-ab6e20bb0c1b]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:55 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494, portal: 172.16.0.220,3260]
Nov 02 01:48:55 user nova-compute[74996]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494, portal: 172.16.0.220,3260] successful.
Nov 02 01:48:55 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:48:55 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:48:55 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b222ba0-7f5f-4d31-acb2-79257672c494 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:48:55 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27e902f-f99c-49e4-a642-897bf1b2818f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:48:55 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:48:55 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:48:55 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] <== disconnect_volume: return (361ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:48:55 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:48:55 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Deleting instance files /opt/stack/data/nova/instances/effec7f0-1006-4081-91f4-e2d96fd0a87a_del
Nov 02 01:48:55 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Deletion of /opt/stack/data/nova/instances/effec7f0-1006-4081-91f4-e2d96fd0a87a_del complete
Nov 02 01:48:55 user nova-compute[74996]: INFO nova.compute.manager [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Took 1.58 seconds to destroy the instance on the hypervisor.
Nov 02 01:48:55 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:48:55 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:48:55 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:48:56 user nova-compute[74996]: DEBUG nova.compute.manager [req-cb1457d9-39fa-4fc4-ad26-cac1284b55f2 req-a65069b7-26db-4389-8d15-62c04d9b1973 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Received event network-vif-unplugged-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:48:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cb1457d9-39fa-4fc4-ad26-cac1284b55f2 req-a65069b7-26db-4389-8d15-62c04d9b1973 service nova] Acquiring lock "effec7f0-1006-4081-91f4-e2d96fd0a87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:48:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cb1457d9-39fa-4fc4-ad26-cac1284b55f2 req-a65069b7-26db-4389-8d15-62c04d9b1973 service nova] Lock "effec7f0-1006-4081-91f4-e2d96fd0a87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:48:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cb1457d9-39fa-4fc4-ad26-cac1284b55f2 req-a65069b7-26db-4389-8d15-62c04d9b1973 service nova] Lock "effec7f0-1006-4081-91f4-e2d96fd0a87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:48:56 user nova-compute[74996]: DEBUG nova.compute.manager [req-cb1457d9-39fa-4fc4-ad26-cac1284b55f2 req-a65069b7-26db-4389-8d15-62c04d9b1973 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] No waiting events found dispatching network-vif-unplugged-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:48:56 user nova-compute[74996]: DEBUG nova.compute.manager [req-cb1457d9-39fa-4fc4-ad26-cac1284b55f2 req-a65069b7-26db-4389-8d15-62c04d9b1973 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Received event network-vif-unplugged-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:48:56 user nova-compute[74996]: DEBUG nova.compute.manager [req-cb1457d9-39fa-4fc4-ad26-cac1284b55f2 req-a65069b7-26db-4389-8d15-62c04d9b1973 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Received event network-vif-plugged-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:48:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cb1457d9-39fa-4fc4-ad26-cac1284b55f2 req-a65069b7-26db-4389-8d15-62c04d9b1973 service nova] Acquiring lock "effec7f0-1006-4081-91f4-e2d96fd0a87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:48:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cb1457d9-39fa-4fc4-ad26-cac1284b55f2 req-a65069b7-26db-4389-8d15-62c04d9b1973 service nova] Lock "effec7f0-1006-4081-91f4-e2d96fd0a87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:48:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cb1457d9-39fa-4fc4-ad26-cac1284b55f2 req-a65069b7-26db-4389-8d15-62c04d9b1973 service nova] Lock "effec7f0-1006-4081-91f4-e2d96fd0a87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:48:56 user nova-compute[74996]: DEBUG nova.compute.manager [req-cb1457d9-39fa-4fc4-ad26-cac1284b55f2 req-a65069b7-26db-4389-8d15-62c04d9b1973 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] No waiting events found dispatching network-vif-plugged-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:48:56 user nova-compute[74996]: WARNING nova.compute.manager [req-cb1457d9-39fa-4fc4-ad26-cac1284b55f2 req-a65069b7-26db-4389-8d15-62c04d9b1973 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Received unexpected event network-vif-plugged-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 for instance with vm_state active and task_state deleting.
Nov 02 01:48:56 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:48:56 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Took 0.87 seconds to deallocate network for instance.
Nov 02 01:48:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:57 user nova-compute[74996]: INFO nova.compute.manager [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Took 0.96 seconds to detach 1 volumes for instance.
Nov 02 01:48:57 user nova-compute[74996]: DEBUG nova.compute.manager [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Deleting volume: 5b222ba0-7f5f-4d31-acb2-79257672c494 {{(pid=74996) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 02 01:48:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:48:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:48:57 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:48:57 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:48:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:48:57 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Deleted allocations for instance effec7f0-1006-4081-91f4-e2d96fd0a87a
Nov 02 01:48:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6bea4452-bd45-4278-8894-a42b10fa8b96 tempest-TestShelveInstance-457210861 tempest-TestShelveInstance-457210861-project-member] Lock "effec7f0-1006-4081-91f4-e2d96fd0a87a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.054s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:48:58 user nova-compute[74996]: DEBUG nova.compute.manager [req-ccdb2801-cc43-4f1b-9493-6cca746d2168 req-b739001e-bdcf-4244-b4a0-a0c039642121 service nova] [instance: effec7f0-1006-4081-91f4-e2d96fd0a87a] Received event network-vif-deleted-8cf50e3d-3da4-48fc-9cc9-bfe88441b531 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:48:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-77ecad9c-d769-4678-97e8-16699ce591da tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:48:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-77ecad9c-d769-4678-97e8-16699ce591da tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:48:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-77ecad9c-d769-4678-97e8-16699ce591da tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:48:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-77ecad9c-d769-4678-97e8-16699ce591da tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:48:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-77ecad9c-d769-4678-97e8-16699ce591da tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:48:59 user nova-compute[74996]: INFO nova.compute.manager [None req-77ecad9c-d769-4678-97e8-16699ce591da tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Terminating instance
Nov 02 01:48:59 user nova-compute[74996]: DEBUG nova.compute.manager [None req-77ecad9c-d769-4678-97e8-16699ce591da tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:48:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:48:59 user nova-compute[74996]: DEBUG nova.compute.manager [req-d0ffa570-dfba-43c6-b80c-1cb48ae019aa req-91428244-97b3-4bed-8043-6d6a211cc202 service nova] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Received event network-vif-unplugged-b2105173-adeb-478a-abf5-24a32a1922fb {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:48:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d0ffa570-dfba-43c6-b80c-1cb48ae019aa req-91428244-97b3-4bed-8043-6d6a211cc202 service nova] Acquiring lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:48:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d0ffa570-dfba-43c6-b80c-1cb48ae019aa req-91428244-97b3-4bed-8043-6d6a211cc202 service nova] Lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:48:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d0ffa570-dfba-43c6-b80c-1cb48ae019aa req-91428244-97b3-4bed-8043-6d6a211cc202 service nova] Lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:48:59 user nova-compute[74996]: DEBUG nova.compute.manager [req-d0ffa570-dfba-43c6-b80c-1cb48ae019aa req-91428244-97b3-4bed-8043-6d6a211cc202 service nova] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] No waiting events found dispatching network-vif-unplugged-b2105173-adeb-478a-abf5-24a32a1922fb {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:48:59 user nova-compute[74996]: DEBUG nova.compute.manager [req-d0ffa570-dfba-43c6-b80c-1cb48ae019aa req-91428244-97b3-4bed-8043-6d6a211cc202 service nova] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Received event network-vif-unplugged-b2105173-adeb-478a-abf5-24a32a1922fb for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:49:00 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Instance destroyed successfully.
Nov 02 01:49:00 user nova-compute[74996]: DEBUG nova.objects.instance [None req-77ecad9c-d769-4678-97e8-16699ce591da tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lazy-loading 'resources' on Instance uuid 1fd1c257-2903-47ce-bd31-a00ba6a8b9df {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:49:00 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-77ecad9c-d769-4678-97e8-16699ce591da tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:45:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-492951611',display_name='tempest-AttachVolumeNegativeTest-server-492951611',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-492951611',id=30,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzLXv6dZduFFX76MvEeDq6D3AwnICQsD5RiGuawtXhQxA6q8rUs83WtToJ8Lq1QKf+SJUdDnWOw7LdEgzG9a2SxRsnYoNrcEXcKUCKIwwVnm0fewuVkCW3xMyDqR0v2jw==',key_name='tempest-keypair-1898707231',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:45:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b6b2c4a38374459b73fa76b8dde9db4',ramdisk_id='',reservation_id='r-0kc2201p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1395123327',owner_user_name='tempest-AttachVolumeNegativeTest-1395123327-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:45:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='700d6c84a40547e99f3e364d6447ad4e',uuid=1fd1c257-2903-47ce-bd31-a00ba6a8b9df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2105173-adeb-478a-abf5-24a32a1922fb", "address": "fa:16:3e:90:44:8b", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2105173-ad", "ovs_interfaceid": "b2105173-adeb-478a-abf5-24a32a1922fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:49:00 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-77ecad9c-d769-4678-97e8-16699ce591da tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Converting VIF {"id": "b2105173-adeb-478a-abf5-24a32a1922fb", "address": "fa:16:3e:90:44:8b", "network": {"id": "d18bfd38-1454-4665-a175-2c7d0e2002ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-212026713-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b6b2c4a38374459b73fa76b8dde9db4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2105173-ad", "ovs_interfaceid": "b2105173-adeb-478a-abf5-24a32a1922fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:49:00 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-77ecad9c-d769-4678-97e8-16699ce591da tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:44:8b,bridge_name='br-int',has_traffic_filtering=True,id=b2105173-adeb-478a-abf5-24a32a1922fb,network=Network(d18bfd38-1454-4665-a175-2c7d0e2002ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2105173-ad') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:49:00 user nova-compute[74996]: DEBUG os_vif [None req-77ecad9c-d769-4678-97e8-16699ce591da tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:44:8b,bridge_name='br-int',has_traffic_filtering=True,id=b2105173-adeb-478a-abf5-24a32a1922fb,network=Network(d18bfd38-1454-4665-a175-2c7d0e2002ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2105173-ad') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:49:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2105173-ad, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:49:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:49:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e34cbde-c319-4ae9-84f2-fcb6ebd51802) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:49:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:49:00 user nova-compute[74996]: INFO os_vif [None req-77ecad9c-d769-4678-97e8-16699ce591da tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:44:8b,bridge_name='br-int',has_traffic_filtering=True,id=b2105173-adeb-478a-abf5-24a32a1922fb,network=Network(d18bfd38-1454-4665-a175-2c7d0e2002ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2105173-ad')
Nov 02 01:49:00 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-77ecad9c-d769-4678-97e8-16699ce591da tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Deleting instance files /opt/stack/data/nova/instances/1fd1c257-2903-47ce-bd31-a00ba6a8b9df_del
Nov 02 01:49:00 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-77ecad9c-d769-4678-97e8-16699ce591da tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Deletion of /opt/stack/data/nova/instances/1fd1c257-2903-47ce-bd31-a00ba6a8b9df_del complete
Nov 02 01:49:00 user nova-compute[74996]: INFO nova.compute.manager [None req-77ecad9c-d769-4678-97e8-16699ce591da tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 02 01:49:00 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-77ecad9c-d769-4678-97e8-16699ce591da tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:49:00 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:49:00 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:49:01 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:49:01 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Took 0.70 seconds to deallocate network for instance.
Nov 02 01:49:01 user nova-compute[74996]: DEBUG nova.compute.manager [req-1a4e8ad2-cd4b-456b-9efa-5b79d3bb481a req-44555f88-59cc-4415-8ea4-3a5690c59ad4 service nova] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Received event network-vif-deleted-b2105173-adeb-478a-abf5-24a32a1922fb {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:49:01 user nova-compute[74996]: INFO nova.compute.manager [req-1a4e8ad2-cd4b-456b-9efa-5b79d3bb481a req-44555f88-59cc-4415-8ea4-3a5690c59ad4 service nova] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Neutron deleted interface b2105173-adeb-478a-abf5-24a32a1922fb; detaching it from the instance and deleting it from the info cache
Nov 02 01:49:01 user nova-compute[74996]: DEBUG nova.network.neutron [req-1a4e8ad2-cd4b-456b-9efa-5b79d3bb481a req-44555f88-59cc-4415-8ea4-3a5690c59ad4 service nova] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:49:01 user nova-compute[74996]: DEBUG nova.compute.manager [req-1a4e8ad2-cd4b-456b-9efa-5b79d3bb481a req-44555f88-59cc-4415-8ea4-3a5690c59ad4 service nova] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Detach interface failed, port_id=b2105173-adeb-478a-abf5-24a32a1922fb, reason: Instance 1fd1c257-2903-47ce-bd31-a00ba6a8b9df could not be found. {{(pid=74996) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 01:49:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-77ecad9c-d769-4678-97e8-16699ce591da tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:49:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-77ecad9c-d769-4678-97e8-16699ce591da tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:49:01 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-77ecad9c-d769-4678-97e8-16699ce591da tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:49:01 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-77ecad9c-d769-4678-97e8-16699ce591da tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:49:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-77ecad9c-d769-4678-97e8-16699ce591da tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:49:01 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-77ecad9c-d769-4678-97e8-16699ce591da tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Deleted allocations for instance 1fd1c257-2903-47ce-bd31-a00ba6a8b9df
Nov 02 01:49:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-77ecad9c-d769-4678-97e8-16699ce591da tempest-AttachVolumeNegativeTest-1395123327 tempest-AttachVolumeNegativeTest-1395123327-project-member] Lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.354s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:49:01 user nova-compute[74996]: DEBUG nova.compute.manager [req-b55fbd70-444a-41b2-8415-95082b0dea79 req-4defed45-0066-4d2f-b362-331ceabf0843 service nova] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Received event network-vif-plugged-b2105173-adeb-478a-abf5-24a32a1922fb {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:49:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b55fbd70-444a-41b2-8415-95082b0dea79 req-4defed45-0066-4d2f-b362-331ceabf0843 service nova] Acquiring lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:49:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b55fbd70-444a-41b2-8415-95082b0dea79 req-4defed45-0066-4d2f-b362-331ceabf0843 service nova] Lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:49:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b55fbd70-444a-41b2-8415-95082b0dea79 req-4defed45-0066-4d2f-b362-331ceabf0843 service nova] Lock "1fd1c257-2903-47ce-bd31-a00ba6a8b9df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:49:01 user nova-compute[74996]: DEBUG nova.compute.manager [req-b55fbd70-444a-41b2-8415-95082b0dea79 req-4defed45-0066-4d2f-b362-331ceabf0843 service nova] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] No waiting events found dispatching network-vif-plugged-b2105173-adeb-478a-abf5-24a32a1922fb {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:49:01 user nova-compute[74996]: WARNING nova.compute.manager [req-b55fbd70-444a-41b2-8415-95082b0dea79 req-4defed45-0066-4d2f-b362-331ceabf0843 service nova] [instance: 1fd1c257-2903-47ce-bd31-a00ba6a8b9df] Received unexpected event network-vif-plugged-b2105173-adeb-478a-abf5-24a32a1922fb for instance with vm_state deleted and task_state None.
Nov 02 01:49:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:10 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:49:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:19 user nova-compute[74996]: DEBUG nova.compute.manager [req-0acc2178-35f5-407f-91d8-4297bc0cb7bb req-9e5731d4-4f46-4dbb-9e8a-328b911f947b service nova] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Received event network-changed-775b74dc-ab9f-4185-b103-d08e272ef6b6 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:49:19 user nova-compute[74996]: DEBUG nova.compute.manager [req-0acc2178-35f5-407f-91d8-4297bc0cb7bb req-9e5731d4-4f46-4dbb-9e8a-328b911f947b service nova] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Refreshing instance network info cache due to event network-changed-775b74dc-ab9f-4185-b103-d08e272ef6b6. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:49:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0acc2178-35f5-407f-91d8-4297bc0cb7bb req-9e5731d4-4f46-4dbb-9e8a-328b911f947b service nova] Acquiring lock "refresh_cache-18c41599-fd0a-44d4-9289-fd92a4b86ca9" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:49:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0acc2178-35f5-407f-91d8-4297bc0cb7bb req-9e5731d4-4f46-4dbb-9e8a-328b911f947b service nova] Acquired lock "refresh_cache-18c41599-fd0a-44d4-9289-fd92a4b86ca9" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:49:19 user nova-compute[74996]: DEBUG nova.network.neutron [req-0acc2178-35f5-407f-91d8-4297bc0cb7bb req-9e5731d4-4f46-4dbb-9e8a-328b911f947b service nova] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Refreshing network info cache for port 775b74dc-ab9f-4185-b103-d08e272ef6b6 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:49:20 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:49:20 user nova-compute[74996]: DEBUG nova.network.neutron [req-0acc2178-35f5-407f-91d8-4297bc0cb7bb req-9e5731d4-4f46-4dbb-9e8a-328b911f947b service nova] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Updated VIF entry in instance network info cache for port 775b74dc-ab9f-4185-b103-d08e272ef6b6. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:49:20 user nova-compute[74996]: DEBUG nova.network.neutron [req-0acc2178-35f5-407f-91d8-4297bc0cb7bb req-9e5731d4-4f46-4dbb-9e8a-328b911f947b service nova] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Updating instance_info_cache with network_info: [{"id": "775b74dc-ab9f-4185-b103-d08e272ef6b6", "address": "fa:16:3e:61:ab:f8", "network": {"id": "dbee5f64-d4d8-4830-97de-59ca235212ed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1625669199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa3d5f0a7d4426695d83218ccf35a8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b74dc-ab", "ovs_interfaceid": "775b74dc-ab9f-4185-b103-d08e272ef6b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:49:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0acc2178-35f5-407f-91d8-4297bc0cb7bb req-9e5731d4-4f46-4dbb-9e8a-328b911f947b service nova] Releasing lock "refresh_cache-18c41599-fd0a-44d4-9289-fd92a4b86ca9" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:49:22 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:49:23 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:49:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:49:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:49:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:49:23 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:49:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:49:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c41599-fd0a-44d4-9289-fd92a4b86ca9/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c41599-fd0a-44d4-9289-fd92a4b86ca9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c41599-fd0a-44d4-9289-fd92a4b86ca9/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c41599-fd0a-44d4-9289-fd92a4b86ca9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.236s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:25 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:49:25 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:49:25 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8081MB free_disk=25.188461303710938GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:49:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:49:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:49:25 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance e38704a7-f8a0-482c-bd51-26a90d37b71d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:49:25 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7c53e6cc-cf69-485d-b24f-5e113dae0e5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:49:25 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 18c41599-fd0a-44d4-9289-fd92a4b86ca9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:49:25 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 03114a20-c464-4ecd-850d-1a29a6ad2584 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:49:25 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance c85f24f9-3441-4825-80a0-386d69727605 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:49:25 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:49:25 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.355s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Acquiring lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG nova.objects.instance [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lazy-loading 'flavor' on Instance uuid 18c41599-fd0a-44d4-9289-fd92a4b86ca9 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Acquiring lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:49:26 user nova-compute[74996]: INFO nova.compute.manager [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Attaching volume a65f8b88-4298-4c93-9256-f4b104f61377 to /dev/vdb
Nov 02 01:49:26 user nova-compute[74996]: DEBUG os_brick.utils [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e76931-5669-4a21-a0ff-3910487d3458]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c930b00d-f8a8-405e-b86c-b2c5ff24a9f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfe806d-65db-4328-89d9-beafa6e98267]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[815b4640-6c28-4d79-9872-54aeb6cbd7a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:49:26 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:49:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b351aa-b92f-437a-948c-cc260ba1abf8]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG os_brick.utils [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:49:26 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Updating existing volume attachment record: 3d5921a3-0802-4b77-80f6-649cf6ae3bd4 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:49:27 user nova-compute[74996]: DEBUG nova.compute.manager [req-426ae6d8-3f68-4760-a75d-cf230aa830c3 req-5acaca88-8422-4508-8820-27f3eba5d32f service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Received event network-changed-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:49:27 user nova-compute[74996]: DEBUG nova.compute.manager [req-426ae6d8-3f68-4760-a75d-cf230aa830c3 req-5acaca88-8422-4508-8820-27f3eba5d32f service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Refreshing instance network info cache due to event network-changed-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:49:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-426ae6d8-3f68-4760-a75d-cf230aa830c3 req-5acaca88-8422-4508-8820-27f3eba5d32f service nova] Acquiring lock "refresh_cache-03114a20-c464-4ecd-850d-1a29a6ad2584" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:49:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-426ae6d8-3f68-4760-a75d-cf230aa830c3 req-5acaca88-8422-4508-8820-27f3eba5d32f service nova] Acquired lock "refresh_cache-03114a20-c464-4ecd-850d-1a29a6ad2584" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:49:27 user nova-compute[74996]: DEBUG nova.network.neutron [req-426ae6d8-3f68-4760-a75d-cf230aa830c3 req-5acaca88-8422-4508-8820-27f3eba5d32f service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Refreshing network info cache for port 0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:49:28 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:49:28 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:49:28 user nova-compute[74996]: DEBUG nova.network.neutron [req-426ae6d8-3f68-4760-a75d-cf230aa830c3 req-5acaca88-8422-4508-8820-27f3eba5d32f service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Updated VIF entry in instance network info cache for port 0aafb9f8-9eec-4e51-a955-fd1aeb4c5246. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:49:28 user nova-compute[74996]: DEBUG nova.network.neutron [req-426ae6d8-3f68-4760-a75d-cf230aa830c3 req-5acaca88-8422-4508-8820-27f3eba5d32f service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Updating instance_info_cache with network_info: [{"id": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "address": "fa:16:3e:a8:7a:d9", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aafb9f8-9e", "ovs_interfaceid": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:49:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-e38704a7-f8a0-482c-bd51-26a90d37b71d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:49:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-e38704a7-f8a0-482c-bd51-26a90d37b71d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:49:28 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 01:49:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-426ae6d8-3f68-4760-a75d-cf230aa830c3 req-5acaca88-8422-4508-8820-27f3eba5d32f service nova] Releasing lock "refresh_cache-03114a20-c464-4ecd-850d-1a29a6ad2584" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:49:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:28 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Updating instance_info_cache with network_info: [{"id": "b5d6eb99-a00c-4440-98d6-6432b493f131", "address": "fa:16:3e:67:64:10", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d6eb99-a0", "ovs_interfaceid": "b5d6eb99-a00c-4440-98d6-6432b493f131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:49:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-e38704a7-f8a0-482c-bd51-26a90d37b71d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:49:28 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 01:49:28 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:49:28 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:49:28 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:49:28 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:49:28 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:49:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:31 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:49:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "03114a20-c464-4ecd-850d-1a29a6ad2584" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:49:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "03114a20-c464-4ecd-850d-1a29a6ad2584" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:49:34 user nova-compute[74996]: INFO nova.compute.manager [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Shelving
Nov 02 01:49:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:34 user nova-compute[74996]: DEBUG nova.compute.manager [req-cc323bf6-8677-42cb-9048-a65feb2cc839 req-a6e29264-1536-443d-9ddf-6731ae3ae9fe service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Received event network-vif-unplugged-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:49:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cc323bf6-8677-42cb-9048-a65feb2cc839 req-a6e29264-1536-443d-9ddf-6731ae3ae9fe service nova] Acquiring lock "03114a20-c464-4ecd-850d-1a29a6ad2584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:49:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cc323bf6-8677-42cb-9048-a65feb2cc839 req-a6e29264-1536-443d-9ddf-6731ae3ae9fe service nova] Lock "03114a20-c464-4ecd-850d-1a29a6ad2584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:49:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cc323bf6-8677-42cb-9048-a65feb2cc839 req-a6e29264-1536-443d-9ddf-6731ae3ae9fe service nova] Lock "03114a20-c464-4ecd-850d-1a29a6ad2584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:49:34 user nova-compute[74996]: DEBUG nova.compute.manager [req-cc323bf6-8677-42cb-9048-a65feb2cc839 req-a6e29264-1536-443d-9ddf-6731ae3ae9fe service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] No waiting events found dispatching network-vif-unplugged-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:49:34 user nova-compute[74996]: WARNING nova.compute.manager [req-cc323bf6-8677-42cb-9048-a65feb2cc839 req-a6e29264-1536-443d-9ddf-6731ae3ae9fe service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Received unexpected event network-vif-unplugged-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 for instance with vm_state active and task_state shelving.
Nov 02 01:49:35 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Instance destroyed successfully.
Nov 02 01:49:35 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Beginning cold snapshot process
Nov 02 01:49:35 user nova-compute[74996]: DEBUG nova.privsep.utils [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74996) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 01:49:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk /opt/stack/data/nova/instances/snapshots/tmpocnap_wm/f2e5242c827741da97a1140a812ddfd7 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk /opt/stack/data/nova/instances/snapshots/tmpocnap_wm/f2e5242c827741da97a1140a812ddfd7" returned: 0 in 0.848s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:36 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Snapshot extracted, beginning image upload
Nov 02 01:49:37 user nova-compute[74996]: DEBUG nova.compute.manager [req-a9b98c76-18d1-48ed-83c7-244e86ab71e4 req-228cb8aa-0672-4409-a8ca-b496d51e6e3d service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Received event network-vif-plugged-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:49:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a9b98c76-18d1-48ed-83c7-244e86ab71e4 req-228cb8aa-0672-4409-a8ca-b496d51e6e3d service nova] Acquiring lock "03114a20-c464-4ecd-850d-1a29a6ad2584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:49:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a9b98c76-18d1-48ed-83c7-244e86ab71e4 req-228cb8aa-0672-4409-a8ca-b496d51e6e3d service nova] Lock "03114a20-c464-4ecd-850d-1a29a6ad2584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:49:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a9b98c76-18d1-48ed-83c7-244e86ab71e4 req-228cb8aa-0672-4409-a8ca-b496d51e6e3d service nova] Lock "03114a20-c464-4ecd-850d-1a29a6ad2584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:49:37 user nova-compute[74996]: DEBUG nova.compute.manager [req-a9b98c76-18d1-48ed-83c7-244e86ab71e4 req-228cb8aa-0672-4409-a8ca-b496d51e6e3d service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] No waiting events found dispatching network-vif-plugged-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:49:37 user nova-compute[74996]: WARNING nova.compute.manager [req-a9b98c76-18d1-48ed-83c7-244e86ab71e4 req-228cb8aa-0672-4409-a8ca-b496d51e6e3d service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Received unexpected event network-vif-plugged-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 for instance with vm_state active and task_state shelving_image_uploading.
Nov 02 01:49:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:39 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:49:39 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Snapshot image upload complete
Nov 02 01:49:39 user nova-compute[74996]: DEBUG nova.compute.manager [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:49:39 user nova-compute[74996]: INFO nova.compute.manager [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Shelve offloading
Nov 02 01:49:39 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Instance destroyed successfully.
Nov 02 01:49:39 user nova-compute[74996]: DEBUG nova.compute.manager [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:49:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "refresh_cache-03114a20-c464-4ecd-850d-1a29a6ad2584" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:49:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquired lock "refresh_cache-03114a20-c464-4ecd-850d-1a29a6ad2584" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:49:39 user nova-compute[74996]: DEBUG nova.network.neutron [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:49:39 user nova-compute[74996]: DEBUG nova.network.neutron [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Updating instance_info_cache with network_info: [{"id": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "address": "fa:16:3e:a8:7a:d9", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aafb9f8-9e", "ovs_interfaceid": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:49:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Releasing lock "refresh_cache-03114a20-c464-4ecd-850d-1a29a6ad2584" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:49:40 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Instance destroyed successfully.
Nov 02 01:49:40 user nova-compute[74996]: DEBUG nova.objects.instance [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lazy-loading 'resources' on Instance uuid 03114a20-c464-4ecd-850d-1a29a6ad2584 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:49:40 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:47:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-324177429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-324177429',id=34,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGC1ZrO4IZqmeKhScK4Khe/R5fSlhAKeS9WeDuGPVzat9NavqbS4CamBVGSNIH1o7iITOcF+YORdUJpDvHOGjwbrgj1KSxyrnSI6g4MKfqy2Az/ytQiVKtTv0qzQxyiASA==',key_name='tempest-keypair-1560575805',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:47:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='22b862880e0c43ab8f5a4d65f6697955',ramdisk_id='',reservation_id='r-e7r370s7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-701748724',owner_user_name='tempest-AttachVolumeShelveTestJSON-701748724-project-member',shelved_at='2023-11-02T01:49:39.218160',shelved_host='user',shelved_image_id='05608a46-ade2-41a1-8e6b-2f415b980ea0'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:49:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01fc2ea044794374b09741ecaf841ba2',uuid=03114a20-c464-4ecd-850d-1a29a6ad2584,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "address": "fa:16:3e:a8:7a:d9", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aafb9f8-9e", "ovs_interfaceid": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:49:40 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Converting VIF {"id": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "address": "fa:16:3e:a8:7a:d9", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aafb9f8-9e", "ovs_interfaceid": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:49:40 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:7a:d9,bridge_name='br-int',has_traffic_filtering=True,id=0aafb9f8-9eec-4e51-a955-fd1aeb4c5246,network=Network(936a0e26-8a02-4c7c-9d24-acbb2f438cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aafb9f8-9e') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:49:40 user nova-compute[74996]: DEBUG os_vif [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:7a:d9,bridge_name='br-int',has_traffic_filtering=True,id=0aafb9f8-9eec-4e51-a955-fd1aeb4c5246,network=Network(936a0e26-8a02-4c7c-9d24-acbb2f438cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aafb9f8-9e') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:49:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0aafb9f8-9e, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:49:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:40 user nova-compute[74996]: DEBUG nova.compute.manager [req-5ea53d6d-d127-4599-b8e0-b910ccc2de98 req-36d05b10-2c76-4009-a8ea-fb44f6acbe9b service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Received event network-changed-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:49:40 user nova-compute[74996]: DEBUG nova.compute.manager [req-5ea53d6d-d127-4599-b8e0-b910ccc2de98 req-36d05b10-2c76-4009-a8ea-fb44f6acbe9b service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Refreshing instance network info cache due to event network-changed-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:49:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5ea53d6d-d127-4599-b8e0-b910ccc2de98 req-36d05b10-2c76-4009-a8ea-fb44f6acbe9b service nova] Acquiring lock "refresh_cache-03114a20-c464-4ecd-850d-1a29a6ad2584" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:49:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5ea53d6d-d127-4599-b8e0-b910ccc2de98 req-36d05b10-2c76-4009-a8ea-fb44f6acbe9b service nova] Acquired lock "refresh_cache-03114a20-c464-4ecd-850d-1a29a6ad2584" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:49:40 user nova-compute[74996]: DEBUG nova.network.neutron [req-5ea53d6d-d127-4599-b8e0-b910ccc2de98 req-36d05b10-2c76-4009-a8ea-fb44f6acbe9b service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Refreshing network info cache for port 0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:49:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:49:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=37fd82f0-e59b-4b47-b806-898e5f4fff53) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:49:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:40 user nova-compute[74996]: INFO os_vif [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:7a:d9,bridge_name='br-int',has_traffic_filtering=True,id=0aafb9f8-9eec-4e51-a955-fd1aeb4c5246,network=Network(936a0e26-8a02-4c7c-9d24-acbb2f438cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aafb9f8-9e')
Nov 02 01:49:40 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Deleting instance files /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584_del
Nov 02 01:49:40 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Deletion of /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584_del complete
Nov 02 01:49:40 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Deleted allocations for instance 03114a20-c464-4ecd-850d-1a29a6ad2584
Nov 02 01:49:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:49:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:49:40 user nova-compute[74996]: DEBUG nova.objects.instance [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lazy-loading 'numa_topology' on Instance uuid 03114a20-c464-4ecd-850d-1a29a6ad2584 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:49:40 user nova-compute[74996]: DEBUG nova.objects.base [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Object Instance<03114a20-c464-4ecd-850d-1a29a6ad2584> lazy-loaded attributes: resources,numa_topology {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:49:40 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:49:40 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:49:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:49:41 user nova-compute[74996]: DEBUG nova.network.neutron [req-5ea53d6d-d127-4599-b8e0-b910ccc2de98 req-36d05b10-2c76-4009-a8ea-fb44f6acbe9b service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Updated VIF entry in instance network info cache for port 0aafb9f8-9eec-4e51-a955-fd1aeb4c5246. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:49:41 user nova-compute[74996]: DEBUG nova.network.neutron [req-5ea53d6d-d127-4599-b8e0-b910ccc2de98 req-36d05b10-2c76-4009-a8ea-fb44f6acbe9b service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Updating instance_info_cache with network_info: [{"id": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "address": "fa:16:3e:a8:7a:d9", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap0aafb9f8-9e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:49:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5ea53d6d-d127-4599-b8e0-b910ccc2de98 req-36d05b10-2c76-4009-a8ea-fb44f6acbe9b service nova] Releasing lock "refresh_cache-03114a20-c464-4ecd-850d-1a29a6ad2584" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:49:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-888022da-4d99-4a3d-beb5-2b8aaede421f tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "03114a20-c464-4ecd-850d-1a29a6ad2584" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.426s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:49:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ALzTuZew', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:49:47 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:49:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:49:47 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:49:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:49:47 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[21457cab-aff8-4b34-84dc-e37bda87be8b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:49:47 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5538e88-1f5c-4c64-baf6-b6ffcc569504]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377] added
Nov 02 01:49:47 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd27315-d800-4c91-a950-97a19c498bd8]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[11163023-0d0a-445f-b6ca-9f55eabbba25]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ALzTuZew {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ALzTuZew" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25d4e14-f4ab-452d-9f32-5dc8b2a74478]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ALzTuZew'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2718262-68d2-4a20-9a34-99bb7312f82a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8bcef7-4420-4b29-af4c-1979a1e7c018]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:49:47 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:49:47 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd59fbf3-d3fd-44b6-92e5-6fad05b42b45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377, portal: 172.16.0.220,3260]
Nov 02 01:49:47 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377, portal: 172.16.0.220,3260] successful.
Nov 02 01:49:47 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1879ecd-93bc-4043-a129-f8b2e8825571]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8d32fc-23fd-4b50-a329-1c067cfbae58]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:49:47 user nova-compute[74996]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 (non-flash)
Nov 02 01:49:47 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:49:47 user nova-compute[74996]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 (non-flash)
Nov 02 01:49:47 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ad84ce-66f9-4bb0-8605-81c4968392cd]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ALzTuZew', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:49:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:49:48 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23431656631306535', 'path': '/dev/sdb'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:49:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431656631306535', 'path': '/dev/sdb'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:49:48 user nova-compute[74996]: DEBUG nova.objects.instance [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lazy-loading 'flavor' on Instance uuid 18c41599-fd0a-44d4-9289-fd92a4b86ca9 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:49:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 01:49:48 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:49:48 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 01:49:48 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:49:48 user nova-compute[74996]:   <serial>a65f8b88-4298-4c93-9256-f4b104f61377</serial>
Nov 02 01:49:48 user nova-compute[74996]: </disk>
Nov 02 01:49:48 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 01:49:49 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:49:49 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:49:49 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] No VIF found with MAC fa:16:3e:61:ab:f8, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:49:49 user nova-compute[74996]: DEBUG nova.compute.manager [req-7b65f551-3e8d-487d-aa85-95b59a4495b7 req-3be8b29a-64fe-4bef-addb-4e06cb8f3a9e service nova] [instance: c85f24f9-3441-4825-80a0-386d69727605] Received event network-changed-012d4eb1-16b8-4820-b5b1-dc84b66435c1 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:49:49 user nova-compute[74996]: DEBUG nova.compute.manager [req-7b65f551-3e8d-487d-aa85-95b59a4495b7 req-3be8b29a-64fe-4bef-addb-4e06cb8f3a9e service nova] [instance: c85f24f9-3441-4825-80a0-386d69727605] Refreshing instance network info cache due to event network-changed-012d4eb1-16b8-4820-b5b1-dc84b66435c1. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:49:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7b65f551-3e8d-487d-aa85-95b59a4495b7 req-3be8b29a-64fe-4bef-addb-4e06cb8f3a9e service nova] Acquiring lock "refresh_cache-c85f24f9-3441-4825-80a0-386d69727605" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:49:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7b65f551-3e8d-487d-aa85-95b59a4495b7 req-3be8b29a-64fe-4bef-addb-4e06cb8f3a9e service nova] Acquired lock "refresh_cache-c85f24f9-3441-4825-80a0-386d69727605" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:49:49 user nova-compute[74996]: DEBUG nova.network.neutron [req-7b65f551-3e8d-487d-aa85-95b59a4495b7 req-3be8b29a-64fe-4bef-addb-4e06cb8f3a9e service nova] [instance: c85f24f9-3441-4825-80a0-386d69727605] Refreshing network info cache for port 012d4eb1-16b8-4820-b5b1-dc84b66435c1 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:49:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0f942239-17a3-44b6-bf51-e021b6971d21 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.909s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:49:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "c85f24f9-3441-4825-80a0-386d69727605" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:49:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "c85f24f9-3441-4825-80a0-386d69727605" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:49:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "c85f24f9-3441-4825-80a0-386d69727605-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:49:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "c85f24f9-3441-4825-80a0-386d69727605-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:49:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "c85f24f9-3441-4825-80a0-386d69727605-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:49:49 user nova-compute[74996]: INFO nova.compute.manager [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Terminating instance
Nov 02 01:49:49 user nova-compute[74996]: DEBUG nova.compute.manager [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG nova.network.neutron [req-7b65f551-3e8d-487d-aa85-95b59a4495b7 req-3be8b29a-64fe-4bef-addb-4e06cb8f3a9e service nova] [instance: c85f24f9-3441-4825-80a0-386d69727605] Updated VIF entry in instance network info cache for port 012d4eb1-16b8-4820-b5b1-dc84b66435c1. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG nova.network.neutron [req-7b65f551-3e8d-487d-aa85-95b59a4495b7 req-3be8b29a-64fe-4bef-addb-4e06cb8f3a9e service nova] [instance: c85f24f9-3441-4825-80a0-386d69727605] Updating instance_info_cache with network_info: [{"id": "012d4eb1-16b8-4820-b5b1-dc84b66435c1", "address": "fa:16:3e:5d:f1:5f", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d4eb1-16", "ovs_interfaceid": "012d4eb1-16b8-4820-b5b1-dc84b66435c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7b65f551-3e8d-487d-aa85-95b59a4495b7 req-3be8b29a-64fe-4bef-addb-4e06cb8f3a9e service nova] Releasing lock "refresh_cache-c85f24f9-3441-4825-80a0-386d69727605" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG nova.compute.manager [req-66f4b806-0ebe-4900-8222-c02d725ddf03 req-1f7baaac-f611-47c0-a7b7-ad811d80e0d4 service nova] [instance: c85f24f9-3441-4825-80a0-386d69727605] Received event network-vif-unplugged-012d4eb1-16b8-4820-b5b1-dc84b66435c1 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-66f4b806-0ebe-4900-8222-c02d725ddf03 req-1f7baaac-f611-47c0-a7b7-ad811d80e0d4 service nova] Acquiring lock "c85f24f9-3441-4825-80a0-386d69727605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-66f4b806-0ebe-4900-8222-c02d725ddf03 req-1f7baaac-f611-47c0-a7b7-ad811d80e0d4 service nova] Lock "c85f24f9-3441-4825-80a0-386d69727605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-66f4b806-0ebe-4900-8222-c02d725ddf03 req-1f7baaac-f611-47c0-a7b7-ad811d80e0d4 service nova] Lock "c85f24f9-3441-4825-80a0-386d69727605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG nova.compute.manager [req-66f4b806-0ebe-4900-8222-c02d725ddf03 req-1f7baaac-f611-47c0-a7b7-ad811d80e0d4 service nova] [instance: c85f24f9-3441-4825-80a0-386d69727605] No waiting events found dispatching network-vif-unplugged-012d4eb1-16b8-4820-b5b1-dc84b66435c1 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG nova.compute.manager [req-66f4b806-0ebe-4900-8222-c02d725ddf03 req-1f7baaac-f611-47c0-a7b7-ad811d80e0d4 service nova] [instance: c85f24f9-3441-4825-80a0-386d69727605] Received event network-vif-unplugged-012d4eb1-16b8-4820-b5b1-dc84b66435c1 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:50 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: c85f24f9-3441-4825-80a0-386d69727605] Instance destroyed successfully.
Nov 02 01:49:50 user nova-compute[74996]: DEBUG nova.objects.instance [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lazy-loading 'resources' on Instance uuid c85f24f9-3441-4825-80a0-386d69727605 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:47:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2013968075',display_name='tempest-TestVolumeBootPattern-server-2013968075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2013968075',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqKsx295qdP4lg7887w79wguzwBudaKLS1CaKDMdZBRiyydUejeP/bphRv12kudSVdoUpRoo+kfCoJgBSoxWJoJnZVJJAUy53PGnOOqIVwETBw7ua4uyU/hdtrnp6uX6w==',key_name='tempest-TestVolumeBootPattern-1607904644',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:48:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31965b482eb243a69112a49bf1302779',ramdisk_id='',reservation_id='r-fadte35w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-216720976',owner_user_name='tempest-TestVolumeBootPattern-216720976-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:48:22Z,user_data=None,user_id='be6bf504c3a649898e8c83399f6fee8e',uuid=c85f24f9-3441-4825-80a0-386d69727605,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "012d4eb1-16b8-4820-b5b1-dc84b66435c1", "address": "fa:16:3e:5d:f1:5f", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d4eb1-16", "ovs_interfaceid": "012d4eb1-16b8-4820-b5b1-dc84b66435c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converting VIF {"id": "012d4eb1-16b8-4820-b5b1-dc84b66435c1", "address": "fa:16:3e:5d:f1:5f", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap012d4eb1-16", "ovs_interfaceid": "012d4eb1-16b8-4820-b5b1-dc84b66435c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:f1:5f,bridge_name='br-int',has_traffic_filtering=True,id=012d4eb1-16b8-4820-b5b1-dc84b66435c1,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012d4eb1-16') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG os_vif [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:f1:5f,bridge_name='br-int',has_traffic_filtering=True,id=012d4eb1-16b8-4820-b5b1-dc84b66435c1,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012d4eb1-16') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap012d4eb1-16, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e32bc4a8-9d5f-466e-81d4-875273ef803f) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:49:50 user nova-compute[74996]: INFO os_vif [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:f1:5f,bridge_name='br-int',has_traffic_filtering=True,id=012d4eb1-16b8-4820-b5b1-dc84b66435c1,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap012d4eb1-16')
Nov 02 01:49:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zpiYoRgf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:49:50 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:49:50 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c774f3bc-8b04-49c3-871b-d8a4fe52007c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:49:50 user nova-compute[74996]: No targets found.
Nov 02 01:49:50 user nova-compute[74996]: iSNS:
Nov 02 01:49:50 user nova-compute[74996]: No targets found.
Nov 02 01:49:50 user nova-compute[74996]: STATIC:
Nov 02 01:49:50 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae
Nov 02 01:49:50 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:49:50 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:49:50 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377
Nov 02 01:49:50 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:49:50 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:49:50 user nova-compute[74996]: FIRMWARE:
Nov 02 01:49:50 user nova-compute[74996]: No targets found.
Nov 02 01:49:50 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:49:50 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:49:50 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[763f2d47-b895-405a-a4c4-71b26024012e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[acaf50e9-b3c5-483c-aa51-1febe3bf513e]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:49:50 user nova-compute[74996]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 (non-flash)
Nov 02 01:49:50 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:49:50 user nova-compute[74996]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 (non-flash)
Nov 02 01:49:50 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e865ac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae'): ({'sdd'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Removing single pathed devices sdd {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[655d9257-4e21-48cf-8b6d-aee29fe29e12]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28f9be4-1907-4ea8-b779-9545322d6bd8]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Flushing IO for device /dev/sdd {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdedbae-772c-4450-9f78-b9c8db8d6e99]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.063s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe070081-3193-4593-9c36-c29ee2fb3cdd]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] SCSI volumes sdd have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:49:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8054cb-3fe1-4632-9f95-81791c6cfc5c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:49:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:49:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[56dc79e4-ace6-4342-ba6e-686da635a136]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:49:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae, portal: 172.16.0.220,3260]
Nov 02 01:49:51 user nova-compute[74996]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae, portal: 172.16.0.220,3260] successful.
Nov 02 01:49:51 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:49:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:49:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:49:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ca92f7-c79c-4de6-90fd-4e0fdafc5003]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:49:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:49:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:49:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] <== disconnect_volume: return (340ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:49:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:49:51 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Deleting instance files /opt/stack/data/nova/instances/c85f24f9-3441-4825-80a0-386d69727605_del
Nov 02 01:49:51 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Deletion of /opt/stack/data/nova/instances/c85f24f9-3441-4825-80a0-386d69727605_del complete
Nov 02 01:49:51 user nova-compute[74996]: INFO nova.compute.manager [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 02 01:49:51 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:49:51 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: c85f24f9-3441-4825-80a0-386d69727605] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:49:51 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: c85f24f9-3441-4825-80a0-386d69727605] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:49:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Acquiring lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:49:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:49:51 user nova-compute[74996]: INFO nova.compute.manager [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Detaching volume a65f8b88-4298-4c93-9256-f4b104f61377
Nov 02 01:49:51 user nova-compute[74996]: INFO nova.virt.block_device [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Attempting to driver detach volume a65f8b88-4298-4c93-9256-f4b104f61377 from mountpoint /dev/vdb
Nov 02 01:49:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Attempting to detach device vdb from instance 18c41599-fd0a-44d4-9289-fd92a4b86ca9 from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 01:49:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 01:49:51 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:49:51 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 01:49:51 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:49:51 user nova-compute[74996]:   <serial>a65f8b88-4298-4c93-9256-f4b104f61377</serial>
Nov 02 01:49:51 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 01:49:51 user nova-compute[74996]: </disk>
Nov 02 01:49:51 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:49:51 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Successfully detached device vdb from instance 18c41599-fd0a-44d4-9289-fd92a4b86ca9 from the persistent domain config.
Nov 02 01:49:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 18c41599-fd0a-44d4-9289-fd92a4b86ca9 from the live domain config. {{(pid=74996) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 01:49:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 01:49:51 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:49:51 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 01:49:51 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:49:51 user nova-compute[74996]:   <serial>a65f8b88-4298-4c93-9256-f4b104f61377</serial>
Nov 02 01:49:51 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 01:49:51 user nova-compute[74996]: </disk>
Nov 02 01:49:51 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:49:52 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: c85f24f9-3441-4825-80a0-386d69727605] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:49:52 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: c85f24f9-3441-4825-80a0-386d69727605] Took 0.95 seconds to deallocate network for instance.
Nov 02 01:49:52 user nova-compute[74996]: DEBUG nova.compute.manager [req-a94904a7-ab7e-4b99-9c27-151b42ec47bf req-e42a091b-ddc3-4535-af98-8d36763fcfd1 service nova] [instance: c85f24f9-3441-4825-80a0-386d69727605] Received event network-vif-plugged-012d4eb1-16b8-4820-b5b1-dc84b66435c1 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:49:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a94904a7-ab7e-4b99-9c27-151b42ec47bf req-e42a091b-ddc3-4535-af98-8d36763fcfd1 service nova] Acquiring lock "c85f24f9-3441-4825-80a0-386d69727605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:49:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a94904a7-ab7e-4b99-9c27-151b42ec47bf req-e42a091b-ddc3-4535-af98-8d36763fcfd1 service nova] Lock "c85f24f9-3441-4825-80a0-386d69727605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:49:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a94904a7-ab7e-4b99-9c27-151b42ec47bf req-e42a091b-ddc3-4535-af98-8d36763fcfd1 service nova] Lock "c85f24f9-3441-4825-80a0-386d69727605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:49:52 user nova-compute[74996]: DEBUG nova.compute.manager [req-a94904a7-ab7e-4b99-9c27-151b42ec47bf req-e42a091b-ddc3-4535-af98-8d36763fcfd1 service nova] [instance: c85f24f9-3441-4825-80a0-386d69727605] No waiting events found dispatching network-vif-plugged-012d4eb1-16b8-4820-b5b1-dc84b66435c1 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:49:52 user nova-compute[74996]: WARNING nova.compute.manager [req-a94904a7-ab7e-4b99-9c27-151b42ec47bf req-e42a091b-ddc3-4535-af98-8d36763fcfd1 service nova] [instance: c85f24f9-3441-4825-80a0-386d69727605] Received unexpected event network-vif-plugged-012d4eb1-16b8-4820-b5b1-dc84b66435c1 for instance with vm_state active and task_state deleting.
Nov 02 01:49:52 user nova-compute[74996]: DEBUG nova.compute.manager [req-a94904a7-ab7e-4b99-9c27-151b42ec47bf req-e42a091b-ddc3-4535-af98-8d36763fcfd1 service nova] [instance: c85f24f9-3441-4825-80a0-386d69727605] Received event network-vif-deleted-012d4eb1-16b8-4820-b5b1-dc84b66435c1 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:49:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 18c41599-fd0a-44d4-9289-fd92a4b86ca9 {{(pid=74996) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 01:49:53 user nova-compute[74996]: INFO nova.compute.manager [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: c85f24f9-3441-4825-80a0-386d69727605] Took 0.90 seconds to detach 1 volumes for instance.
Nov 02 01:49:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:49:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:49:53 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:49:53 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:49:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.241s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:49:53 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Deleted allocations for instance c85f24f9-3441-4825-80a0-386d69727605
Nov 02 01:49:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-27c2dbc5-a350-4874-ba5d-8432b39c6d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "c85f24f9-3441-4825-80a0-386d69727605" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.612s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:49:55 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:49:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:50:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:50:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:50:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:50:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 01:50:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:50:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:50:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:50:10 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:50:12 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 18c41599-fd0a-44d4-9289-fd92a4b86ca9 is timed out.
Nov 02 01:50:12 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Successfully detached device vdb from instance 18c41599-fd0a-44d4-9289-fd92a4b86ca9 from the live domain config.
Nov 02 01:50:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ALzTuZew', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:50:12 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:50:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76141f2-2424-4d2f-ae8f-faa13bd31f87]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:50:12 user nova-compute[74996]: No targets found.
Nov 02 01:50:12 user nova-compute[74996]: iSNS:
Nov 02 01:50:12 user nova-compute[74996]: No targets found.
Nov 02 01:50:12 user nova-compute[74996]: STATIC:
Nov 02 01:50:12 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377
Nov 02 01:50:12 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:50:12 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:50:12 user nova-compute[74996]: FIRMWARE:
Nov 02 01:50:12 user nova-compute[74996]: No targets found.
Nov 02 01:50:12 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:50:12 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:50:12 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cbbe96-fed2-4f7c-9ea9-cb858f341a84]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c2d2ec-dbc5-4489-a3dc-ae7cca338011]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 (non-flash)
Nov 02 01:50:12 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 (non-flash)
Nov 02 01:50:12 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830c2eb0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377'): ({'sdb'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Removing single pathed devices sdb {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e418afd-5d3d-45b7-b40a-e976287fc2bb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c372e6-381f-4e50-84fd-b7fc96d79756]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Flushing IO for device /dev/sdb {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e504b5f-1daa-4652-8c86-e3a01b401c22]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[182a88d9-03dd-4488-a1c8-5d618d0d60eb]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.111s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b98861-5ff7-4ff4-a656-2bf4be70582c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27f2d1b-a8bd-4925-aed5-73bbef307240]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377, portal: 172.16.0.220,3260]
Nov 02 01:50:12 user nova-compute[74996]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377, portal: 172.16.0.220,3260] successful.
Nov 02 01:50:12 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a65f8b88-4298-4c93-9256-f4b104f61377 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4827d753-389a-4703-8bbc-b0f6677192fa]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] <== disconnect_volume: return (375ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:50:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:50:13 user nova-compute[74996]: DEBUG nova.objects.instance [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lazy-loading 'flavor' on Instance uuid 18c41599-fd0a-44d4-9289-fd92a4b86ca9 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:50:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e9d1c551-0136-4a29-ad3a-603b33239aa8 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.967s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:50:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:50:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:50:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:50:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 01:50:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:50:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:50:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:50:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:50:22 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:50:22 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:50:24 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:50:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:50:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:50:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:50:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:50:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:50:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:50:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:50:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:50:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c41599-fd0a-44d4-9289-fd92a4b86ca9/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:50:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c41599-fd0a-44d4-9289-fd92a4b86ca9/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:50:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c41599-fd0a-44d4-9289-fd92a4b86ca9/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:50:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c41599-fd0a-44d4-9289-fd92a4b86ca9/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:50:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:50:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:50:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:50:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:50:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:50:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:50:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:50:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:50:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:50:26 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:50:26 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:50:26 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8488MB free_disk=25.155406951904297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:50:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:50:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:50:26 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance e38704a7-f8a0-482c-bd51-26a90d37b71d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:50:26 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7c53e6cc-cf69-485d-b24f-5e113dae0e5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:50:26 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 18c41599-fd0a-44d4-9289-fd92a4b86ca9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:50:26 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:50:26 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:50:26 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:50:26 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:50:26 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:50:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.427s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:50:26 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:50:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:50:27 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:50:27 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:50:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-7c53e6cc-cf69-485d-b24f-5e113dae0e5d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:50:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-7c53e6cc-cf69-485d-b24f-5e113dae0e5d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:50:28 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 01:50:28 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Updating instance_info_cache with network_info: [{"id": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "address": "fa:16:3e:9b:c8:b7", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391c1ab0-6a", "ovs_interfaceid": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:50:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-7c53e6cc-cf69-485d-b24f-5e113dae0e5d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:50:28 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 01:50:28 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:50:28 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:50:28 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:50:28 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:50:28 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:50:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:50:32 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:50:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:50:38 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:50:38 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Cleaning up deleted instances {{(pid=74996) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 01:50:38 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] There are 1 instances to clean {{(pid=74996) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 01:50:38 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Instance has had 1 of 5 cleanup attempts {{(pid=74996) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Nov 02 01:50:38 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Deleting instance files /opt/stack/data/nova/instances/d28b9820-c059-46cb-9bb0-132e447fca1b_del
Nov 02 01:50:38 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: d28b9820-c059-46cb-9bb0-132e447fca1b] Deletion of /opt/stack/data/nova/instances/d28b9820-c059-46cb-9bb0-132e447fca1b_del complete
Nov 02 01:50:40 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:50:40 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74996) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 01:50:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:50:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "3f80eb60-ba0b-4a4c-8b41-17130ddf51fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:50:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "3f80eb60-ba0b-4a4c-8b41-17130ddf51fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:50:41 user nova-compute[74996]: DEBUG nova.compute.manager [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:50:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:50:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:50:41 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:50:41 user nova-compute[74996]: INFO nova.compute.claims [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Claim successful on node user
Nov 02 01:50:42 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:50:42 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:50:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.287s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:50:42 user nova-compute[74996]: DEBUG nova.compute.manager [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:50:42 user nova-compute[74996]: DEBUG nova.compute.manager [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:50:42 user nova-compute[74996]: DEBUG nova.network.neutron [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:50:42 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:50:42 user nova-compute[74996]: DEBUG nova.compute.manager [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:50:42 user nova-compute[74996]: DEBUG nova.policy [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be6bf504c3a649898e8c83399f6fee8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31965b482eb243a69112a49bf1302779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:50:42 user nova-compute[74996]: INFO nova.virt.block_device [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Booting with volume f5a26f9c-f371-4a37-990c-eadd5a9bcfae at /dev/vda
Nov 02 01:50:42 user nova-compute[74996]: DEBUG os_brick.utils [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:50:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:50:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:50:42 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[701eed26-eb9b-4934-98d0-14c3f1762ea7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:50:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:50:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:50:42 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11f5626-e5d2-4c8f-b03e-5df5ba1b2401]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:50:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:50:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:50:42 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde586c2-7d4d-4256-a974-f362b427a0d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:50:42 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[686dcef0-54f1-4077-9062-72e15f3d9297]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:50:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:50:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:50:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:50:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:50:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:50:42 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:50:42 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e038a0fb-83a7-4c42-8f8a-009557c3db71]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:50:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:50:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:50:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:50:42 user nova-compute[74996]: DEBUG os_brick.utils [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:50:42 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Updating existing volume attachment record: c0baf496-37ae-4bd8-9828-1c78f4cf8090 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:50:43 user nova-compute[74996]: DEBUG nova.network.neutron [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Successfully created port: 3d50920e-49be-4b14-9019-60a286e9f068 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:50:44 user nova-compute[74996]: DEBUG nova.network.neutron [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Successfully updated port: 3d50920e-49be-4b14-9019-60a286e9f068 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:50:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "refresh_cache-3f80eb60-ba0b-4a4c-8b41-17130ddf51fa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:50:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquired lock "refresh_cache-3f80eb60-ba0b-4a4c-8b41-17130ddf51fa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:50:44 user nova-compute[74996]: DEBUG nova.network.neutron [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:50:44 user nova-compute[74996]: DEBUG nova.network.neutron [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:50:44 user nova-compute[74996]: DEBUG nova.compute.manager [req-98e071d2-57dd-436a-8236-bc526be724fe req-5379a20d-003f-436f-b5a9-05174ad0e379 service nova] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Received event network-changed-3d50920e-49be-4b14-9019-60a286e9f068 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:50:44 user nova-compute[74996]: DEBUG nova.compute.manager [req-98e071d2-57dd-436a-8236-bc526be724fe req-5379a20d-003f-436f-b5a9-05174ad0e379 service nova] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Refreshing instance network info cache due to event network-changed-3d50920e-49be-4b14-9019-60a286e9f068. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:50:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-98e071d2-57dd-436a-8236-bc526be724fe req-5379a20d-003f-436f-b5a9-05174ad0e379 service nova] Acquiring lock "refresh_cache-3f80eb60-ba0b-4a4c-8b41-17130ddf51fa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:50:44 user nova-compute[74996]: DEBUG nova.network.neutron [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Updating instance_info_cache with network_info: [{"id": "3d50920e-49be-4b14-9019-60a286e9f068", "address": "fa:16:3e:ba:b0:00", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d50920e-49", "ovs_interfaceid": "3d50920e-49be-4b14-9019-60a286e9f068", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:50:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Releasing lock "refresh_cache-3f80eb60-ba0b-4a4c-8b41-17130ddf51fa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:50:44 user nova-compute[74996]: DEBUG nova.compute.manager [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Instance network_info: |[{"id": "3d50920e-49be-4b14-9019-60a286e9f068", "address": "fa:16:3e:ba:b0:00", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d50920e-49", "ovs_interfaceid": "3d50920e-49be-4b14-9019-60a286e9f068", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:50:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-98e071d2-57dd-436a-8236-bc526be724fe req-5379a20d-003f-436f-b5a9-05174ad0e379 service nova] Acquired lock "refresh_cache-3f80eb60-ba0b-4a4c-8b41-17130ddf51fa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:50:44 user nova-compute[74996]: DEBUG nova.network.neutron [req-98e071d2-57dd-436a-8236-bc526be724fe req-5379a20d-003f-436f-b5a9-05174ad0e379 service nova] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Refreshing network info cache for port 3d50920e-49be-4b14-9019-60a286e9f068 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:50:44 user nova-compute[74996]: DEBUG nova.network.neutron [req-98e071d2-57dd-436a-8236-bc526be724fe req-5379a20d-003f-436f-b5a9-05174ad0e379 service nova] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Updated VIF entry in instance network info cache for port 3d50920e-49be-4b14-9019-60a286e9f068. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:50:44 user nova-compute[74996]: DEBUG nova.network.neutron [req-98e071d2-57dd-436a-8236-bc526be724fe req-5379a20d-003f-436f-b5a9-05174ad0e379 service nova] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Updating instance_info_cache with network_info: [{"id": "3d50920e-49be-4b14-9019-60a286e9f068", "address": "fa:16:3e:ba:b0:00", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d50920e-49", "ovs_interfaceid": "3d50920e-49be-4b14-9019-60a286e9f068", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:50:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-98e071d2-57dd-436a-8236-bc526be724fe req-5379a20d-003f-436f-b5a9-05174ad0e379 service nova] Releasing lock "refresh_cache-3f80eb60-ba0b-4a4c-8b41-17130ddf51fa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:50:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:50:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:50:55 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:50:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1c964147-1fa2-4238-8dd2-0d1f80ec9625 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Acquiring lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:50:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1c964147-1fa2-4238-8dd2-0d1f80ec9625 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:50:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1c964147-1fa2-4238-8dd2-0d1f80ec9625 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Acquiring lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:50:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1c964147-1fa2-4238-8dd2-0d1f80ec9625 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:50:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1c964147-1fa2-4238-8dd2-0d1f80ec9625 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:50:57 user nova-compute[74996]: INFO nova.compute.manager [None req-1c964147-1fa2-4238-8dd2-0d1f80ec9625 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Terminating instance
Nov 02 01:50:57 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1c964147-1fa2-4238-8dd2-0d1f80ec9625 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:50:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:50:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:50:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:50:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:50:57 user nova-compute[74996]: DEBUG nova.compute.manager [req-5349a516-78af-466c-a788-bb5c42310b62 req-f97ff6b7-8848-4f19-816e-986e2b8923c9 service nova] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Received event network-vif-unplugged-775b74dc-ab9f-4185-b103-d08e272ef6b6 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:50:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5349a516-78af-466c-a788-bb5c42310b62 req-f97ff6b7-8848-4f19-816e-986e2b8923c9 service nova] Acquiring lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:50:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5349a516-78af-466c-a788-bb5c42310b62 req-f97ff6b7-8848-4f19-816e-986e2b8923c9 service nova] Lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:50:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5349a516-78af-466c-a788-bb5c42310b62 req-f97ff6b7-8848-4f19-816e-986e2b8923c9 service nova] Lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:50:57 user nova-compute[74996]: DEBUG nova.compute.manager [req-5349a516-78af-466c-a788-bb5c42310b62 req-f97ff6b7-8848-4f19-816e-986e2b8923c9 service nova] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] No waiting events found dispatching network-vif-unplugged-775b74dc-ab9f-4185-b103-d08e272ef6b6 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:50:57 user nova-compute[74996]: DEBUG nova.compute.manager [req-5349a516-78af-466c-a788-bb5c42310b62 req-f97ff6b7-8848-4f19-816e-986e2b8923c9 service nova] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Received event network-vif-unplugged-775b74dc-ab9f-4185-b103-d08e272ef6b6 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:50:58 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Instance destroyed successfully.
Nov 02 01:50:58 user nova-compute[74996]: DEBUG nova.objects.instance [None req-1c964147-1fa2-4238-8dd2-0d1f80ec9625 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lazy-loading 'resources' on Instance uuid 18c41599-fd0a-44d4-9289-fd92a4b86ca9 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:50:58 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-1c964147-1fa2-4238-8dd2-0d1f80ec9625 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:47:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1274478760',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1274478760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1274478',id=33,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnxaEpv05BClrZu2yVhOZ+c5DwwGETJBNISxhJAi5S0uRY6GpIUu7Azq9UiaPsruEzEPqANkYLeNEXKtGv+dtamwQSOJO4m+V/hnFpc6FKDr8j5r9EGrPqlSxxfsOUK8w==',key_name='tempest-keypair-1780689397',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:47:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aaa3d5f0a7d4426695d83218ccf35a8c',ramdisk_id='',reservation_id='r-5528mj00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1436219902',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:47:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97ea3ba1bb9d4336999c9d5435100f7d',uuid=18c41599-fd0a-44d4-9289-fd92a4b86ca9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "775b74dc-ab9f-4185-b103-d08e272ef6b6", "address": "fa:16:3e:61:ab:f8", "network": {"id": "dbee5f64-d4d8-4830-97de-59ca235212ed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1625669199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa3d5f0a7d4426695d83218ccf35a8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b74dc-ab", "ovs_interfaceid": "775b74dc-ab9f-4185-b103-d08e272ef6b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:50:58 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-1c964147-1fa2-4238-8dd2-0d1f80ec9625 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Converting VIF {"id": "775b74dc-ab9f-4185-b103-d08e272ef6b6", "address": "fa:16:3e:61:ab:f8", "network": {"id": "dbee5f64-d4d8-4830-97de-59ca235212ed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1625669199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa3d5f0a7d4426695d83218ccf35a8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775b74dc-ab", "ovs_interfaceid": "775b74dc-ab9f-4185-b103-d08e272ef6b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:50:58 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-1c964147-1fa2-4238-8dd2-0d1f80ec9625 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:ab:f8,bridge_name='br-int',has_traffic_filtering=True,id=775b74dc-ab9f-4185-b103-d08e272ef6b6,network=Network(dbee5f64-d4d8-4830-97de-59ca235212ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775b74dc-ab') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:50:58 user nova-compute[74996]: DEBUG os_vif [None req-1c964147-1fa2-4238-8dd2-0d1f80ec9625 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:ab:f8,bridge_name='br-int',has_traffic_filtering=True,id=775b74dc-ab9f-4185-b103-d08e272ef6b6,network=Network(dbee5f64-d4d8-4830-97de-59ca235212ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775b74dc-ab') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:50:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:50:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap775b74dc-ab, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:50:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:50:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:50:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:50:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fac30a64-820c-499f-9575-b8da38b8c13b) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:50:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:50:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:50:58 user nova-compute[74996]: INFO os_vif [None req-1c964147-1fa2-4238-8dd2-0d1f80ec9625 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:ab:f8,bridge_name='br-int',has_traffic_filtering=True,id=775b74dc-ab9f-4185-b103-d08e272ef6b6,network=Network(dbee5f64-d4d8-4830-97de-59ca235212ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775b74dc-ab')
Nov 02 01:50:58 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-1c964147-1fa2-4238-8dd2-0d1f80ec9625 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Deleting instance files /opt/stack/data/nova/instances/18c41599-fd0a-44d4-9289-fd92a4b86ca9_del
Nov 02 01:50:58 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-1c964147-1fa2-4238-8dd2-0d1f80ec9625 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Deletion of /opt/stack/data/nova/instances/18c41599-fd0a-44d4-9289-fd92a4b86ca9_del complete
Nov 02 01:50:58 user nova-compute[74996]: INFO nova.compute.manager [None req-1c964147-1fa2-4238-8dd2-0d1f80ec9625 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 02 01:50:58 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-1c964147-1fa2-4238-8dd2-0d1f80ec9625 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:50:58 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:50:58 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:50:59 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:50:59 user nova-compute[74996]: DEBUG nova.compute.manager [req-5c23598d-4599-4c99-9f18-464339d1d950 req-235f199f-1d58-4df2-bf9b-73d3d08ab89e service nova] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Received event network-vif-deleted-775b74dc-ab9f-4185-b103-d08e272ef6b6 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:50:59 user nova-compute[74996]: INFO nova.compute.manager [req-5c23598d-4599-4c99-9f18-464339d1d950 req-235f199f-1d58-4df2-bf9b-73d3d08ab89e service nova] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Neutron deleted interface 775b74dc-ab9f-4185-b103-d08e272ef6b6; detaching it from the instance and deleting it from the info cache
Nov 02 01:50:59 user nova-compute[74996]: DEBUG nova.network.neutron [req-5c23598d-4599-4c99-9f18-464339d1d950 req-235f199f-1d58-4df2-bf9b-73d3d08ab89e service nova] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:50:59 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Took 1.20 seconds to deallocate network for instance.
Nov 02 01:50:59 user nova-compute[74996]: DEBUG nova.compute.manager [req-5c23598d-4599-4c99-9f18-464339d1d950 req-235f199f-1d58-4df2-bf9b-73d3d08ab89e service nova] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Detach interface failed, port_id=775b74dc-ab9f-4185-b103-d08e272ef6b6, reason: Instance 18c41599-fd0a-44d4-9289-fd92a4b86ca9 could not be found. {{(pid=74996) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 01:50:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1c964147-1fa2-4238-8dd2-0d1f80ec9625 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:50:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1c964147-1fa2-4238-8dd2-0d1f80ec9625 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:50:59 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-1c964147-1fa2-4238-8dd2-0d1f80ec9625 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:50:59 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-1c964147-1fa2-4238-8dd2-0d1f80ec9625 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:50:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1c964147-1fa2-4238-8dd2-0d1f80ec9625 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:50:59 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-1c964147-1fa2-4238-8dd2-0d1f80ec9625 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Deleted allocations for instance 18c41599-fd0a-44d4-9289-fd92a4b86ca9
Nov 02 01:50:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1c964147-1fa2-4238-8dd2-0d1f80ec9625 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902 tempest-TestServerVolumeAttachScenarioOldVersion-1436219902-project-member] Lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.547s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:50:59 user nova-compute[74996]: DEBUG nova.compute.manager [req-d9544caf-ee0d-4fd7-8c7f-7f11da766bba req-4d2b23a1-6394-4758-b0ee-4ad85f983c6e service nova] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Received event network-vif-plugged-775b74dc-ab9f-4185-b103-d08e272ef6b6 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:50:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d9544caf-ee0d-4fd7-8c7f-7f11da766bba req-4d2b23a1-6394-4758-b0ee-4ad85f983c6e service nova] Acquiring lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:50:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d9544caf-ee0d-4fd7-8c7f-7f11da766bba req-4d2b23a1-6394-4758-b0ee-4ad85f983c6e service nova] Lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:50:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d9544caf-ee0d-4fd7-8c7f-7f11da766bba req-4d2b23a1-6394-4758-b0ee-4ad85f983c6e service nova] Lock "18c41599-fd0a-44d4-9289-fd92a4b86ca9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:50:59 user nova-compute[74996]: DEBUG nova.compute.manager [req-d9544caf-ee0d-4fd7-8c7f-7f11da766bba req-4d2b23a1-6394-4758-b0ee-4ad85f983c6e service nova] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] No waiting events found dispatching network-vif-plugged-775b74dc-ab9f-4185-b103-d08e272ef6b6 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:50:59 user nova-compute[74996]: WARNING nova.compute.manager [req-d9544caf-ee0d-4fd7-8c7f-7f11da766bba req-4d2b23a1-6394-4758-b0ee-4ad85f983c6e service nova] [instance: 18c41599-fd0a-44d4-9289-fd92a4b86ca9] Received unexpected event network-vif-plugged-775b74dc-ab9f-4185-b103-d08e272ef6b6 for instance with vm_state deleted and task_state None.
Nov 02 01:51:02 user nova-compute[74996]: DEBUG nova.compute.manager [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:51:02 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Creating image(s)
Nov 02 01:51:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Did not create local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Ensure instance console log exists: /opt/stack/data/nova/instances/3f80eb60-ba0b-4a4c-8b41-17130ddf51fa/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Start _get_guest_xml network_info=[{"id": "3d50920e-49be-4b14-9019-60a286e9f068", "address": "fa:16:3e:ba:b0:00", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d50920e-49", "ovs_interfaceid": "3d50920e-49be-4b14-9019-60a286e9f068", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c0baf496-37ae-4bd8-9828-1c78f4cf8090', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zpiYoRgf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3f80eb60-ba0b-4a4c-8b41-17130ddf51fa', 'attached_at': '', 'detached_at': '', 'volume_id': 'f5a26f9c-f371-4a37-990c-eadd5a9bcfae', 'serial': 'f5a26f9c-f371-4a37-990c-eadd5a9bcfae'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:51:02 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:51:02 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:51:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zpiYoRgf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:51:02 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:51:02 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:51:02 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:51:02 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:51:02 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac793ab5-55e0-4c77-b9c7-586836514340]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:51:02 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5807b39-6226-498e-9252-0ec761a88656]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae] added
Nov 02 01:51:02 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4a878e-c245-4883-acfb-b2b6d89ae5c5]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d675a00c-382f-4e0f-965c-11982876e31d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zpiYoRgf {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zpiYoRgf" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd89eb7a-bcef-4e5a-9ef4-f85b44dcaf07]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zpiYoRgf'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b56aa9a-0af9-49a8-894a-04b26c0a4de0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d7a58d-0c08-4872-bad1-1ef75e508602]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 01:51:02 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 01:51:02 user nova-compute[74996]:  {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:51:02 user nova-compute[74996]: WARNING os_brick.initiator.connectors.iscsi [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 01:51:02 user nova-compute[74996]: 
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bedc588-3f23-48cc-9314-2bf04b4dbd60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae, portal: 172.16.0.220,3260]
Nov 02 01:51:02 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae, portal: 172.16.0.220,3260] successful.
Nov 02 01:51:02 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cff2e46-0f12-4188-82b6-1d529ba67e27]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c69fa4b-6d44-4399-9403-274b92708406]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:51:02 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:51:02 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ede1dd-0d91-47bf-ae2b-e700efeb26b4]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:51:02 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: None {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:51:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:03 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:51:03 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zpiYoRgf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:51:03 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:51:03 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23031336434663264', 'path': '/dev/sdb'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:51:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031336434663264', 'path': '/dev/sdb'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:51:04 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:50:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1742708987',display_name='tempest-TestVolumeBootPattern-server-1742708987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1742708987',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqKsx295qdP4lg7887w79wguzwBudaKLS1CaKDMdZBRiyydUejeP/bphRv12kudSVdoUpRoo+kfCoJgBSoxWJoJnZVJJAUy53PGnOOqIVwETBw7ua4uyU/hdtrnp6uX6w==',key_name='tempest-TestVolumeBootPattern-1607904644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31965b482eb243a69112a49bf1302779',ramdisk_id='',reservation_id='r-3hzhkh5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-216720976',owner_user_name='tempest-TestVolumeBootPattern-216720976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:50:42Z,user_data=None,user_id='be6bf504c3a649898e8c83399f6fee8e',uuid=3f80eb60-ba0b-4a4c-8b41-17130ddf51fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d50920e-49be-4b14-9019-60a286e9f068", "address": "fa:16:3e:ba:b0:00", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d50920e-49", "ovs_interfaceid": "3d50920e-49be-4b14-9019-60a286e9f068", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:51:04 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converting VIF {"id": "3d50920e-49be-4b14-9019-60a286e9f068", "address": "fa:16:3e:ba:b0:00", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d50920e-49", "ovs_interfaceid": "3d50920e-49be-4b14-9019-60a286e9f068", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:51:04 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:b0:00,bridge_name='br-int',has_traffic_filtering=True,id=3d50920e-49be-4b14-9019-60a286e9f068,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d50920e-49') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:51:04 user nova-compute[74996]: DEBUG nova.objects.instance [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:51:04 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:51:04 user nova-compute[74996]:   <uuid>3f80eb60-ba0b-4a4c-8b41-17130ddf51fa</uuid>
Nov 02 01:51:04 user nova-compute[74996]:   <name>instance-00000024</name>
Nov 02 01:51:04 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:51:04 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:51:04 user nova-compute[74996]:   <metadata>
Nov 02 01:51:04 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:51:04 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:51:04 user nova-compute[74996]:       <nova:name>tempest-TestVolumeBootPattern-server-1742708987</nova:name>
Nov 02 01:51:04 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:51:02</nova:creationTime>
Nov 02 01:51:04 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:51:04 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:51:04 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:51:04 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:51:04 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:51:04 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:51:04 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:51:04 user nova-compute[74996]:       <nova:owner>
Nov 02 01:51:04 user nova-compute[74996]:         <nova:user uuid="be6bf504c3a649898e8c83399f6fee8e">tempest-TestVolumeBootPattern-216720976-project-member</nova:user>
Nov 02 01:51:04 user nova-compute[74996]:         <nova:project uuid="31965b482eb243a69112a49bf1302779">tempest-TestVolumeBootPattern-216720976</nova:project>
Nov 02 01:51:04 user nova-compute[74996]:       </nova:owner>
Nov 02 01:51:04 user nova-compute[74996]:       <nova:ports>
Nov 02 01:51:04 user nova-compute[74996]:         <nova:port uuid="3d50920e-49be-4b14-9019-60a286e9f068">
Nov 02 01:51:04 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 02 01:51:04 user nova-compute[74996]:         </nova:port>
Nov 02 01:51:04 user nova-compute[74996]:       </nova:ports>
Nov 02 01:51:04 user nova-compute[74996]:     </nova:instance>
Nov 02 01:51:04 user nova-compute[74996]:   </metadata>
Nov 02 01:51:04 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:51:04 user nova-compute[74996]:     <system>
Nov 02 01:51:04 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:51:04 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:51:04 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:51:04 user nova-compute[74996]:       <entry name="serial">3f80eb60-ba0b-4a4c-8b41-17130ddf51fa</entry>
Nov 02 01:51:04 user nova-compute[74996]:       <entry name="uuid">3f80eb60-ba0b-4a4c-8b41-17130ddf51fa</entry>
Nov 02 01:51:04 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:51:04 user nova-compute[74996]:     </system>
Nov 02 01:51:04 user nova-compute[74996]:   </sysinfo>
Nov 02 01:51:04 user nova-compute[74996]:   <os>
Nov 02 01:51:04 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:51:04 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:51:04 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:51:04 user nova-compute[74996]:   </os>
Nov 02 01:51:04 user nova-compute[74996]:   <features>
Nov 02 01:51:04 user nova-compute[74996]:     <acpi/>
Nov 02 01:51:04 user nova-compute[74996]:     <apic/>
Nov 02 01:51:04 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:51:04 user nova-compute[74996]:   </features>
Nov 02 01:51:04 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:51:04 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:51:04 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:51:04 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:51:04 user nova-compute[74996]:   </clock>
Nov 02 01:51:04 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:51:04 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:51:04 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:51:04 user nova-compute[74996]:   </cpu>
Nov 02 01:51:04 user nova-compute[74996]:   <devices>
Nov 02 01:51:04 user nova-compute[74996]:     <disk type="block" device="disk">
Nov 02 01:51:04 user nova-compute[74996]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:51:04 user nova-compute[74996]:       <source dev="/dev/sdb"/>
Nov 02 01:51:04 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:51:04 user nova-compute[74996]:       <serial>f5a26f9c-f371-4a37-990c-eadd5a9bcfae</serial>
Nov 02 01:51:04 user nova-compute[74996]:     </disk>
Nov 02 01:51:04 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:51:04 user nova-compute[74996]:       <mac address="fa:16:3e:ba:b0:00"/>
Nov 02 01:51:04 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:51:04 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:51:04 user nova-compute[74996]:       <target dev="tap3d50920e-49"/>
Nov 02 01:51:04 user nova-compute[74996]:     </interface>
Nov 02 01:51:04 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:51:04 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/3f80eb60-ba0b-4a4c-8b41-17130ddf51fa/console.log" append="off"/>
Nov 02 01:51:04 user nova-compute[74996]:     </serial>
Nov 02 01:51:04 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:51:04 user nova-compute[74996]:     <video>
Nov 02 01:51:04 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:51:04 user nova-compute[74996]:     </video>
Nov 02 01:51:04 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:51:04 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:51:04 user nova-compute[74996]:     </rng>
Nov 02 01:51:04 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:51:04 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:51:04 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:51:04 user nova-compute[74996]:     </memballoon>
Nov 02 01:51:04 user nova-compute[74996]:   </devices>
Nov 02 01:51:04 user nova-compute[74996]: </domain>
Nov 02 01:51:04 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:51:04 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:50:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1742708987',display_name='tempest-TestVolumeBootPattern-server-1742708987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1742708987',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqKsx295qdP4lg7887w79wguzwBudaKLS1CaKDMdZBRiyydUejeP/bphRv12kudSVdoUpRoo+kfCoJgBSoxWJoJnZVJJAUy53PGnOOqIVwETBw7ua4uyU/hdtrnp6uX6w==',key_name='tempest-TestVolumeBootPattern-1607904644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31965b482eb243a69112a49bf1302779',ramdisk_id='',reservation_id='r-3hzhkh5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-216720976',owner_user_name='tempest-TestVolumeBootPattern-216720976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:50:42Z,user_data=None,user_id='be6bf504c3a649898e8c83399f6fee8e',uuid=3f80eb60-ba0b-4a4c-8b41-17130ddf51fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d50920e-49be-4b14-9019-60a286e9f068", "address": "fa:16:3e:ba:b0:00", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d50920e-49", "ovs_interfaceid": "3d50920e-49be-4b14-9019-60a286e9f068", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:51:04 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converting VIF {"id": "3d50920e-49be-4b14-9019-60a286e9f068", "address": "fa:16:3e:ba:b0:00", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d50920e-49", "ovs_interfaceid": "3d50920e-49be-4b14-9019-60a286e9f068", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:51:04 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:b0:00,bridge_name='br-int',has_traffic_filtering=True,id=3d50920e-49be-4b14-9019-60a286e9f068,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d50920e-49') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:51:04 user nova-compute[74996]: DEBUG os_vif [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:b0:00,bridge_name='br-int',has_traffic_filtering=True,id=3d50920e-49be-4b14-9019-60a286e9f068,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d50920e-49') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:51:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:51:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:51:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de8a09d2-9ed5-54cb-91a3-816bdd6dcfbc', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:51:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:51:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d50920e-49, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:51:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d50920e-49, col_values=(('qos', UUID('94a292d0-d20c-49ce-931a-4b31e1679c49')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:51:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d50920e-49, col_values=(('external_ids', {'iface-id': '3d50920e-49be-4b14-9019-60a286e9f068', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:b0:00', 'vm-uuid': '3f80eb60-ba0b-4a4c-8b41-17130ddf51fa'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:51:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:51:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:04 user nova-compute[74996]: INFO os_vif [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:b0:00,bridge_name='br-int',has_traffic_filtering=True,id=3d50920e-49be-4b14-9019-60a286e9f068,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d50920e-49')
Nov 02 01:51:04 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:51:04 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] No VIF found with MAC fa:16:3e:ba:b0:00, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:51:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:06 user nova-compute[74996]: DEBUG nova.compute.manager [req-25b94142-2f91-4804-8bbc-8f7af6d17bee req-5f34552f-1ef4-48b3-b541-32bc75a33b0c service nova] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Received event network-vif-plugged-3d50920e-49be-4b14-9019-60a286e9f068 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:51:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-25b94142-2f91-4804-8bbc-8f7af6d17bee req-5f34552f-1ef4-48b3-b541-32bc75a33b0c service nova] Acquiring lock "3f80eb60-ba0b-4a4c-8b41-17130ddf51fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:51:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-25b94142-2f91-4804-8bbc-8f7af6d17bee req-5f34552f-1ef4-48b3-b541-32bc75a33b0c service nova] Lock "3f80eb60-ba0b-4a4c-8b41-17130ddf51fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:51:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-25b94142-2f91-4804-8bbc-8f7af6d17bee req-5f34552f-1ef4-48b3-b541-32bc75a33b0c service nova] Lock "3f80eb60-ba0b-4a4c-8b41-17130ddf51fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:51:06 user nova-compute[74996]: DEBUG nova.compute.manager [req-25b94142-2f91-4804-8bbc-8f7af6d17bee req-5f34552f-1ef4-48b3-b541-32bc75a33b0c service nova] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] No waiting events found dispatching network-vif-plugged-3d50920e-49be-4b14-9019-60a286e9f068 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:51:06 user nova-compute[74996]: WARNING nova.compute.manager [req-25b94142-2f91-4804-8bbc-8f7af6d17bee req-5f34552f-1ef4-48b3-b541-32bc75a33b0c service nova] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Received unexpected event network-vif-plugged-3d50920e-49be-4b14-9019-60a286e9f068 for instance with vm_state building and task_state spawning.
Nov 02 01:51:07 user nova-compute[74996]: DEBUG nova.compute.manager [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:51:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:51:07 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Instance spawned successfully.
Nov 02 01:51:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:51:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:51:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:51:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:51:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:51:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:51:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:51:07 user nova-compute[74996]: INFO nova.compute.manager [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 02 01:51:07 user nova-compute[74996]: DEBUG nova.compute.manager [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:51:07 user nova-compute[74996]: INFO nova.compute.manager [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Took 26.00 seconds to build instance.
Nov 02 01:51:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-553aa0cd-43a8-4b2d-8691-cac9c9f04579 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "3f80eb60-ba0b-4a4c-8b41-17130ddf51fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.103s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:51:08 user nova-compute[74996]: DEBUG nova.compute.manager [req-ffeff8d7-f7f4-40fd-ad9f-4683d57ac706 req-0b088266-e263-4213-b128-fd8224d9980c service nova] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Received event network-vif-plugged-3d50920e-49be-4b14-9019-60a286e9f068 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:51:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ffeff8d7-f7f4-40fd-ad9f-4683d57ac706 req-0b088266-e263-4213-b128-fd8224d9980c service nova] Acquiring lock "3f80eb60-ba0b-4a4c-8b41-17130ddf51fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:51:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ffeff8d7-f7f4-40fd-ad9f-4683d57ac706 req-0b088266-e263-4213-b128-fd8224d9980c service nova] Lock "3f80eb60-ba0b-4a4c-8b41-17130ddf51fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:51:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ffeff8d7-f7f4-40fd-ad9f-4683d57ac706 req-0b088266-e263-4213-b128-fd8224d9980c service nova] Lock "3f80eb60-ba0b-4a4c-8b41-17130ddf51fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:51:08 user nova-compute[74996]: DEBUG nova.compute.manager [req-ffeff8d7-f7f4-40fd-ad9f-4683d57ac706 req-0b088266-e263-4213-b128-fd8224d9980c service nova] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] No waiting events found dispatching network-vif-plugged-3d50920e-49be-4b14-9019-60a286e9f068 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:51:08 user nova-compute[74996]: WARNING nova.compute.manager [req-ffeff8d7-f7f4-40fd-ad9f-4683d57ac706 req-0b088266-e263-4213-b128-fd8224d9980c service nova] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Received unexpected event network-vif-plugged-3d50920e-49be-4b14-9019-60a286e9f068 for instance with vm_state active and task_state None.
Nov 02 01:51:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:51:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 01:51:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:51:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:51:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:22 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:51:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:23 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:51:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:24 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:51:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:51:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:51:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:51:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:51:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:24 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:51:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:26 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:51:26 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:51:26 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8388MB free_disk=25.170421600341797GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:51:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:51:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:51:26 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance e38704a7-f8a0-482c-bd51-26a90d37b71d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:51:26 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7c53e6cc-cf69-485d-b24f-5e113dae0e5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:51:26 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:51:26 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:51:26 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:51:26 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Refreshing inventories for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 01:51:26 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Updating ProviderTree inventory for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 01:51:26 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Updating inventory in ProviderTree for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 01:51:26 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Refreshing aggregate associations for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259, aggregates: None {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 01:51:26 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Refreshing trait associations for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 01:51:26 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:51:26 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:51:26 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:51:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.443s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:51:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "03114a20-c464-4ecd-850d-1a29a6ad2584" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:51:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "03114a20-c464-4ecd-850d-1a29a6ad2584" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:51:27 user nova-compute[74996]: INFO nova.compute.manager [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Unshelving
Nov 02 01:51:28 user nova-compute[74996]: INFO nova.virt.block_device [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Booting with volume b0db817d-7604-4424-9c26-ab9af78869bd at /dev/vdc
Nov 02 01:51:28 user nova-compute[74996]: DEBUG os_brick.utils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:51:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[99866f14-211a-44ba-9508-c7cabe2b8d39]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:51:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0872e33c-3874-4e1b-9522-f7612b9cdf0c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:51:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a436e6a1-8648-4952-8c16-265638f6c453]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:51:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7bd953-a3d8-4499-a0b2-c900ae5a36de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:51:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:51:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:51:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:51:28 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:51:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ff3c87-58c0-4563-b283-09b7eb90b74c]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:51:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:51:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:51:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:51:28 user nova-compute[74996]: DEBUG os_brick.utils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:51:28 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Updating existing volume attachment record: 7d60e1b2-24d9-4efc-8496-1706e64270d2 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:51:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:28 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:51:28 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:51:28 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9965}}
Nov 02 01:51:28 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Didn't find any instances for network info cache update. {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 01:51:28 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:51:28 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:51:28 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:51:28 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:51:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:30 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:51:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:32 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:51:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:51:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:51:36 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:51:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:51:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:51:36 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:51:36 user nova-compute[74996]: INFO nova.compute.claims [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Claim successful on node user
Nov 02 01:51:36 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:51:36 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:51:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.359s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:51:36 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:51:36 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:51:36 user nova-compute[74996]: DEBUG nova.network.neutron [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:51:36 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:51:36 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:51:36 user nova-compute[74996]: DEBUG nova.policy [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7d9a6e0ced84500aab9759d009f0a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be09717763f448b5a5d1a1e5f62e289b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:51:36 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:51:36 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:51:37 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Creating image(s)
Nov 02 01:51:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "/opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:51:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "/opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:51:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "/opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:51:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "133907414d1cd507ae1d146bf8ab715819c37cfc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:51:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "133907414d1cd507ae1d146bf8ab715819c37cfc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:51:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/133907414d1cd507ae1d146bf8ab715819c37cfc.part --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:37 user nova-compute[74996]: DEBUG nova.network.neutron [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Successfully created port: 016a6c69-a1ff-45f9-bc61-6b886fbeaea9 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:51:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/133907414d1cd507ae1d146bf8ab715819c37cfc.part --force-share --output=json" returned: 0 in 0.175s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:37 user nova-compute[74996]: DEBUG nova.virt.images [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] ea004395-87cf-4a65-b2c3-d7209fe6de54 was qcow2, converting to raw {{(pid=74996) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 01:51:37 user nova-compute[74996]: DEBUG nova.privsep.utils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74996) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 01:51:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/133907414d1cd507ae1d146bf8ab715819c37cfc.part /opt/stack/data/nova/instances/_base/133907414d1cd507ae1d146bf8ab715819c37cfc.converted {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/133907414d1cd507ae1d146bf8ab715819c37cfc.part /opt/stack/data/nova/instances/_base/133907414d1cd507ae1d146bf8ab715819c37cfc.converted" returned: 0 in 0.442s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/133907414d1cd507ae1d146bf8ab715819c37cfc.converted --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/133907414d1cd507ae1d146bf8ab715819c37cfc.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "133907414d1cd507ae1d146bf8ab715819c37cfc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.439s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:51:38 user nova-compute[74996]: DEBUG nova.network.neutron [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Successfully updated port: 016a6c69-a1ff-45f9-bc61-6b886fbeaea9 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:51:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/133907414d1cd507ae1d146bf8ab715819c37cfc --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "refresh_cache-26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:51:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquired lock "refresh_cache-26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:51:38 user nova-compute[74996]: DEBUG nova.network.neutron [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:51:38 user nova-compute[74996]: DEBUG nova.compute.manager [req-75087a99-a1c6-49f8-afe1-041021457b5d req-b6222031-e117-48c0-a5cc-4c37d2535e8a service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Received event network-changed-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:51:38 user nova-compute[74996]: DEBUG nova.compute.manager [req-75087a99-a1c6-49f8-afe1-041021457b5d req-b6222031-e117-48c0-a5cc-4c37d2535e8a service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Refreshing instance network info cache due to event network-changed-016a6c69-a1ff-45f9-bc61-6b886fbeaea9. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:51:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-75087a99-a1c6-49f8-afe1-041021457b5d req-b6222031-e117-48c0-a5cc-4c37d2535e8a service nova] Acquiring lock "refresh_cache-26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:51:38 user nova-compute[74996]: DEBUG nova.network.neutron [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:51:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/133907414d1cd507ae1d146bf8ab715819c37cfc --force-share --output=json" returned: 0 in 0.192s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "133907414d1cd507ae1d146bf8ab715819c37cfc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:51:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "133907414d1cd507ae1d146bf8ab715819c37cfc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:51:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/133907414d1cd507ae1d146bf8ab715819c37cfc --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/133907414d1cd507ae1d146bf8ab715819c37cfc --force-share --output=json" returned: 0 in 0.217s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/133907414d1cd507ae1d146bf8ab715819c37cfc,backing_fmt=raw /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:38 user nova-compute[74996]: DEBUG nova.network.neutron [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Updating instance_info_cache with network_info: [{"id": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "address": "fa:16:3e:9f:76:66", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016a6c69-a1", "ovs_interfaceid": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:51:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/133907414d1cd507ae1d146bf8ab715819c37cfc,backing_fmt=raw /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk 1073741824" returned: 0 in 0.059s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "133907414d1cd507ae1d146bf8ab715819c37cfc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:51:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/133907414d1cd507ae1d146bf8ab715819c37cfc --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Releasing lock "refresh_cache-26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:51:38 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Instance network_info: |[{"id": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "address": "fa:16:3e:9f:76:66", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016a6c69-a1", "ovs_interfaceid": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:51:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-75087a99-a1c6-49f8-afe1-041021457b5d req-b6222031-e117-48c0-a5cc-4c37d2535e8a service nova] Acquired lock "refresh_cache-26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:51:38 user nova-compute[74996]: DEBUG nova.network.neutron [req-75087a99-a1c6-49f8-afe1-041021457b5d req-b6222031-e117-48c0-a5cc-4c37d2535e8a service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Refreshing network info cache for port 016a6c69-a1ff-45f9-bc61-6b886fbeaea9 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/133907414d1cd507ae1d146bf8ab715819c37cfc --force-share --output=json" returned: 0 in 0.217s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Checking if we can resize image /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Cannot resize image /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Ensure instance console log exists: /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Start _get_guest_xml network_info=[{"id": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "address": "fa:16:3e:9f:76:66", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016a6c69-a1", "ovs_interfaceid": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:51:33Z,direct_url=<?>,disk_format='qcow2',id=ea004395-87cf-4a65-b2c3-d7209fe6de54,min_disk=0,min_ram=0,name='tempest-scenario-img--1326853147',owner='be09717763f448b5a5d1a1e5f62e289b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:51:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ea004395-87cf-4a65-b2c3-d7209fe6de54'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:51:39 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:51:39 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.network.neutron [req-75087a99-a1c6-49f8-afe1-041021457b5d req-b6222031-e117-48c0-a5cc-4c37d2535e8a service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Updated VIF entry in instance network info cache for port 016a6c69-a1ff-45f9-bc61-6b886fbeaea9. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.network.neutron [req-75087a99-a1c6-49f8-afe1-041021457b5d req-b6222031-e117-48c0-a5cc-4c37d2535e8a service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Updating instance_info_cache with network_info: [{"id": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "address": "fa:16:3e:9f:76:66", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016a6c69-a1", "ovs_interfaceid": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:51:33Z,direct_url=<?>,disk_format='qcow2',id=ea004395-87cf-4a65-b2c3-d7209fe6de54,min_disk=0,min_ram=0,name='tempest-scenario-img--1326853147',owner='be09717763f448b5a5d1a1e5f62e289b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:51:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:51:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1075914983',display_name='tempest-TestMinimumBasicScenario-server-1075914983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1075914983',id=37,image_ref='ea004395-87cf-4a65-b2c3-d7209fe6de54',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMvrpfr8DB7QKESZzs371DYHVWv6Cr8QRChW6oecJXHRRCF4YAmNE7fPnrko7Qfal8r86tFHqOSMirgo7DE2B0Ycg1rGJucHkjJ/UjAecASQQZ+T2IhJlejkDf09HPCPQ==',key_name='tempest-TestMinimumBasicScenario-341687183',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be09717763f448b5a5d1a1e5f62e289b',ramdisk_id='',reservation_id='r-c22faqut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea004395-87cf-4a65-b2c3-d7209fe6de54',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1426618310',owner_user_name='tempest-TestMinimumBasicScenario-1426618310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:51:37Z,user_data=None,user_id='e7d9a6e0ced84500aab9759d009f0a49',uuid=26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "address": "fa:16:3e:9f:76:66", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016a6c69-a1", "ovs_interfaceid": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Converting VIF {"id": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "address": "fa:16:3e:9f:76:66", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016a6c69-a1", "ovs_interfaceid": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:76:66,bridge_name='br-int',has_traffic_filtering=True,id=016a6c69-a1ff-45f9-bc61-6b886fbeaea9,network=Network(ab25d1c6-cd19-42dd-abe2-cb20978f06e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap016a6c69-a1') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.objects.instance [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lazy-loading 'pci_devices' on Instance uuid 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-75087a99-a1c6-49f8-afe1-041021457b5d req-b6222031-e117-48c0-a5cc-4c37d2535e8a service nova] Releasing lock "refresh_cache-26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:51:39 user nova-compute[74996]:   <uuid>26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea</uuid>
Nov 02 01:51:39 user nova-compute[74996]:   <name>instance-00000025</name>
Nov 02 01:51:39 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:51:39 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:51:39 user nova-compute[74996]:   <metadata>
Nov 02 01:51:39 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:51:39 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:51:39 user nova-compute[74996]:       <nova:name>tempest-TestMinimumBasicScenario-server-1075914983</nova:name>
Nov 02 01:51:39 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:51:39</nova:creationTime>
Nov 02 01:51:39 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:51:39 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:51:39 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:51:39 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:51:39 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:51:39 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:51:39 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:51:39 user nova-compute[74996]:       <nova:owner>
Nov 02 01:51:39 user nova-compute[74996]:         <nova:user uuid="e7d9a6e0ced84500aab9759d009f0a49">tempest-TestMinimumBasicScenario-1426618310-project-member</nova:user>
Nov 02 01:51:39 user nova-compute[74996]:         <nova:project uuid="be09717763f448b5a5d1a1e5f62e289b">tempest-TestMinimumBasicScenario-1426618310</nova:project>
Nov 02 01:51:39 user nova-compute[74996]:       </nova:owner>
Nov 02 01:51:39 user nova-compute[74996]:       <nova:root type="image" uuid="ea004395-87cf-4a65-b2c3-d7209fe6de54"/>
Nov 02 01:51:39 user nova-compute[74996]:       <nova:ports>
Nov 02 01:51:39 user nova-compute[74996]:         <nova:port uuid="016a6c69-a1ff-45f9-bc61-6b886fbeaea9">
Nov 02 01:51:39 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 01:51:39 user nova-compute[74996]:         </nova:port>
Nov 02 01:51:39 user nova-compute[74996]:       </nova:ports>
Nov 02 01:51:39 user nova-compute[74996]:     </nova:instance>
Nov 02 01:51:39 user nova-compute[74996]:   </metadata>
Nov 02 01:51:39 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:51:39 user nova-compute[74996]:     <system>
Nov 02 01:51:39 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:51:39 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:51:39 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:51:39 user nova-compute[74996]:       <entry name="serial">26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea</entry>
Nov 02 01:51:39 user nova-compute[74996]:       <entry name="uuid">26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea</entry>
Nov 02 01:51:39 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:51:39 user nova-compute[74996]:     </system>
Nov 02 01:51:39 user nova-compute[74996]:   </sysinfo>
Nov 02 01:51:39 user nova-compute[74996]:   <os>
Nov 02 01:51:39 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:51:39 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:51:39 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:51:39 user nova-compute[74996]:   </os>
Nov 02 01:51:39 user nova-compute[74996]:   <features>
Nov 02 01:51:39 user nova-compute[74996]:     <acpi/>
Nov 02 01:51:39 user nova-compute[74996]:     <apic/>
Nov 02 01:51:39 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:51:39 user nova-compute[74996]:   </features>
Nov 02 01:51:39 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:51:39 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:51:39 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:51:39 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:51:39 user nova-compute[74996]:   </clock>
Nov 02 01:51:39 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:51:39 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:51:39 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:51:39 user nova-compute[74996]:   </cpu>
Nov 02 01:51:39 user nova-compute[74996]:   <devices>
Nov 02 01:51:39 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:51:39 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:51:39 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk"/>
Nov 02 01:51:39 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:51:39 user nova-compute[74996]:     </disk>
Nov 02 01:51:39 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:51:39 user nova-compute[74996]:       <mac address="fa:16:3e:9f:76:66"/>
Nov 02 01:51:39 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:51:39 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:51:39 user nova-compute[74996]:       <target dev="tap016a6c69-a1"/>
Nov 02 01:51:39 user nova-compute[74996]:     </interface>
Nov 02 01:51:39 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:51:39 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/console.log" append="off"/>
Nov 02 01:51:39 user nova-compute[74996]:     </serial>
Nov 02 01:51:39 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:51:39 user nova-compute[74996]:     <video>
Nov 02 01:51:39 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:51:39 user nova-compute[74996]:     </video>
Nov 02 01:51:39 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:51:39 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:51:39 user nova-compute[74996]:     </rng>
Nov 02 01:51:39 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:51:39 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:51:39 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:51:39 user nova-compute[74996]:     </memballoon>
Nov 02 01:51:39 user nova-compute[74996]:   </devices>
Nov 02 01:51:39 user nova-compute[74996]: </domain>
Nov 02 01:51:39 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:51:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1075914983',display_name='tempest-TestMinimumBasicScenario-server-1075914983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1075914983',id=37,image_ref='ea004395-87cf-4a65-b2c3-d7209fe6de54',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMvrpfr8DB7QKESZzs371DYHVWv6Cr8QRChW6oecJXHRRCF4YAmNE7fPnrko7Qfal8r86tFHqOSMirgo7DE2B0Ycg1rGJucHkjJ/UjAecASQQZ+T2IhJlejkDf09HPCPQ==',key_name='tempest-TestMinimumBasicScenario-341687183',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be09717763f448b5a5d1a1e5f62e289b',ramdisk_id='',reservation_id='r-c22faqut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea004395-87cf-4a65-b2c3-d7209fe6de54',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1426618310',owner_user_name='tempest-TestMinimumBasicScenario-1426618310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:51:37Z,user_data=None,user_id='e7d9a6e0ced84500aab9759d009f0a49',uuid=26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "address": "fa:16:3e:9f:76:66", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016a6c69-a1", "ovs_interfaceid": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Converting VIF {"id": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "address": "fa:16:3e:9f:76:66", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016a6c69-a1", "ovs_interfaceid": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:76:66,bridge_name='br-int',has_traffic_filtering=True,id=016a6c69-a1ff-45f9-bc61-6b886fbeaea9,network=Network(ab25d1c6-cd19-42dd-abe2-cb20978f06e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap016a6c69-a1') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG os_vif [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:76:66,bridge_name='br-int',has_traffic_filtering=True,id=016a6c69-a1ff-45f9-bc61-6b886fbeaea9,network=Network(ab25d1c6-cd19-42dd-abe2-cb20978f06e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap016a6c69-a1') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d7fcc09-7e5d-5a62-9b08-9d08f0708c62', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap016a6c69-a1, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap016a6c69-a1, col_values=(('qos', UUID('de3db28b-b700-4b0e-a8c3-e874a4941eee')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap016a6c69-a1, col_values=(('external_ids', {'iface-id': '016a6c69-a1ff-45f9-bc61-6b886fbeaea9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:76:66', 'vm-uuid': '26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:39 user nova-compute[74996]: INFO os_vif [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:76:66,bridge_name='br-int',has_traffic_filtering=True,id=016a6c69-a1ff-45f9-bc61-6b886fbeaea9,network=Network(ab25d1c6-cd19-42dd-abe2-cb20978f06e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap016a6c69-a1')
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:51:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] No VIF found with MAC fa:16:3e:9f:76:66, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:51:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:41 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:51:41 user nova-compute[74996]: DEBUG nova.compute.manager [req-e07fc625-c8f0-48a7-855e-ad9509fb644b req-8dfa6e94-c3ee-49f9-8022-2fbcea729ab2 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Received event network-vif-plugged-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:51:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-e07fc625-c8f0-48a7-855e-ad9509fb644b req-8dfa6e94-c3ee-49f9-8022-2fbcea729ab2 service nova] Acquiring lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:51:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-e07fc625-c8f0-48a7-855e-ad9509fb644b req-8dfa6e94-c3ee-49f9-8022-2fbcea729ab2 service nova] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:51:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-e07fc625-c8f0-48a7-855e-ad9509fb644b req-8dfa6e94-c3ee-49f9-8022-2fbcea729ab2 service nova] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:51:41 user nova-compute[74996]: DEBUG nova.compute.manager [req-e07fc625-c8f0-48a7-855e-ad9509fb644b req-8dfa6e94-c3ee-49f9-8022-2fbcea729ab2 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] No waiting events found dispatching network-vif-plugged-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:51:41 user nova-compute[74996]: WARNING nova.compute.manager [req-e07fc625-c8f0-48a7-855e-ad9509fb644b req-8dfa6e94-c3ee-49f9-8022-2fbcea729ab2 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Received unexpected event network-vif-plugged-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 for instance with vm_state building and task_state spawning.
Nov 02 01:51:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:43 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:51:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:51:43 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Instance spawned successfully.
Nov 02 01:51:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:51:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:51:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:51:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:51:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:51:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:51:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:51:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-2d1386be-a199-4b66-a808-4ba3bcd4146c req-222c6e8f-1389-4577-a184-0c95265c7860 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Received event network-vif-plugged-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:51:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2d1386be-a199-4b66-a808-4ba3bcd4146c req-222c6e8f-1389-4577-a184-0c95265c7860 service nova] Acquiring lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:51:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2d1386be-a199-4b66-a808-4ba3bcd4146c req-222c6e8f-1389-4577-a184-0c95265c7860 service nova] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:51:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2d1386be-a199-4b66-a808-4ba3bcd4146c req-222c6e8f-1389-4577-a184-0c95265c7860 service nova] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:51:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-2d1386be-a199-4b66-a808-4ba3bcd4146c req-222c6e8f-1389-4577-a184-0c95265c7860 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] No waiting events found dispatching network-vif-plugged-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:51:43 user nova-compute[74996]: WARNING nova.compute.manager [req-2d1386be-a199-4b66-a808-4ba3bcd4146c req-222c6e8f-1389-4577-a184-0c95265c7860 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Received unexpected event network-vif-plugged-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 for instance with vm_state building and task_state spawning.
Nov 02 01:51:43 user nova-compute[74996]: INFO nova.compute.manager [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Took 6.33 seconds to spawn the instance on the hypervisor.
Nov 02 01:51:43 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:51:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:43 user nova-compute[74996]: INFO nova.compute.manager [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Took 7.06 seconds to build instance.
Nov 02 01:51:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1de7b14b-2426-48c6-aafa-b47676b0f00f tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.169s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:51:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:46 user nova-compute[74996]: INFO nova.compute.manager [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Rescuing
Nov 02 01:51:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "refresh_cache-e38704a7-f8a0-482c-bd51-26a90d37b71d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:51:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquired lock "refresh_cache-e38704a7-f8a0-482c-bd51-26a90d37b71d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:51:46 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:51:47 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Updating instance_info_cache with network_info: [{"id": "b5d6eb99-a00c-4440-98d6-6432b493f131", "address": "fa:16:3e:67:64:10", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d6eb99-a0", "ovs_interfaceid": "b5d6eb99-a00c-4440-98d6-6432b493f131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:51:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Releasing lock "refresh_cache-e38704a7-f8a0-482c-bd51-26a90d37b71d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:51:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:47 user nova-compute[74996]: DEBUG nova.compute.manager [req-1739ebd3-1b82-47fe-8b4b-6ffcff39a094 req-483ba367-49fa-4662-98fe-08b775d03c15 service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received event network-vif-unplugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:51:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1739ebd3-1b82-47fe-8b4b-6ffcff39a094 req-483ba367-49fa-4662-98fe-08b775d03c15 service nova] Acquiring lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:51:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1739ebd3-1b82-47fe-8b4b-6ffcff39a094 req-483ba367-49fa-4662-98fe-08b775d03c15 service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:51:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1739ebd3-1b82-47fe-8b4b-6ffcff39a094 req-483ba367-49fa-4662-98fe-08b775d03c15 service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:51:47 user nova-compute[74996]: DEBUG nova.compute.manager [req-1739ebd3-1b82-47fe-8b4b-6ffcff39a094 req-483ba367-49fa-4662-98fe-08b775d03c15 service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] No waiting events found dispatching network-vif-unplugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:51:47 user nova-compute[74996]: WARNING nova.compute.manager [req-1739ebd3-1b82-47fe-8b4b-6ffcff39a094 req-483ba367-49fa-4662-98fe-08b775d03c15 service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received unexpected event network-vif-unplugged-b5d6eb99-a00c-4440-98d6-6432b493f131 for instance with vm_state active and task_state rescuing.
Nov 02 01:51:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:48 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Instance destroyed successfully.
Nov 02 01:51:48 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Attempting rescue
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74996) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Instance directory exists: not creating {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 01:51:48 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Creating image(s)
Nov 02 01:51:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "/opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "/opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "/opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.objects.instance [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lazy-loading 'trusted_certs' on Instance uuid e38704a7-f8a0-482c-bd51-26a90d37b71d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.239s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk.rescue {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk.rescue" returned: 0 in 0.062s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.objects.instance [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lazy-loading 'migration_context' on Instance uuid e38704a7-f8a0-482c-bd51-26a90d37b71d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.objects.base [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Object Instance<e38704a7-f8a0-482c-bd51-26a90d37b71d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Start _get_guest_xml network_info=[{"id": "b5d6eb99-a00c-4440-98d6-6432b493f131", "address": "fa:16:3e:67:64:10", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "vif_mac": "fa:16:3e:67:64:10"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d6eb99-a0", "ovs_interfaceid": "b5d6eb99-a00c-4440-98d6-6432b493f131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.objects.instance [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lazy-loading 'resources' on Instance uuid e38704a7-f8a0-482c-bd51-26a90d37b71d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.objects.base [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Object Instance<e38704a7-f8a0-482c-bd51-26a90d37b71d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.objects.instance [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lazy-loading 'numa_topology' on Instance uuid e38704a7-f8a0-482c-bd51-26a90d37b71d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.objects.base [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Object Instance<e38704a7-f8a0-482c-bd51-26a90d37b71d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:51:48 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:51:48 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.objects.instance [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lazy-loading 'vcpu_model' on Instance uuid e38704a7-f8a0-482c-bd51-26a90d37b71d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.objects.base [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Object Instance<e38704a7-f8a0-482c-bd51-26a90d37b71d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1755702352',display_name='tempest-ServerRescueNegativeTestJSON-server-1755702352',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1755702352',id=31,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:47:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d89083c24ba475f9159a80fddfe9159',ramdisk_id='',reservation_id='r-oqxxr67v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1433266011',owner_user_name='tempest-ServerRescueNegativeTestJSON-1433266011-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:47:07Z,user_data=None,user_id='87e5cf8786fe44b5a5305f3be11d64c2',uuid=e38704a7-f8a0-482c-bd51-26a90d37b71d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5d6eb99-a00c-4440-98d6-6432b493f131", "address": "fa:16:3e:67:64:10", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "vif_mac": "fa:16:3e:67:64:10"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d6eb99-a0", "ovs_interfaceid": "b5d6eb99-a00c-4440-98d6-6432b493f131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Converting VIF {"id": "b5d6eb99-a00c-4440-98d6-6432b493f131", "address": "fa:16:3e:67:64:10", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "vif_mac": "fa:16:3e:67:64:10"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d6eb99-a0", "ovs_interfaceid": "b5d6eb99-a00c-4440-98d6-6432b493f131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:64:10,bridge_name='br-int',has_traffic_filtering=True,id=b5d6eb99-a00c-4440-98d6-6432b493f131,network=Network(81a443a7-0a10-4c81-9903-853291c58596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5d6eb99-a0') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.objects.instance [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lazy-loading 'pci_devices' on Instance uuid e38704a7-f8a0-482c-bd51-26a90d37b71d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.objects.base [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Object Instance<e38704a7-f8a0-482c-bd51-26a90d37b71d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:51:48 user nova-compute[74996]:   <uuid>e38704a7-f8a0-482c-bd51-26a90d37b71d</uuid>
Nov 02 01:51:48 user nova-compute[74996]:   <name>instance-0000001f</name>
Nov 02 01:51:48 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:51:48 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:51:48 user nova-compute[74996]:   <metadata>
Nov 02 01:51:48 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:51:48 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:51:48 user nova-compute[74996]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1755702352</nova:name>
Nov 02 01:51:48 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:51:48</nova:creationTime>
Nov 02 01:51:48 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:51:48 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:51:48 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:51:48 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:51:48 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:51:48 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:51:48 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:51:48 user nova-compute[74996]:       <nova:owner>
Nov 02 01:51:48 user nova-compute[74996]:         <nova:user uuid="87e5cf8786fe44b5a5305f3be11d64c2">tempest-ServerRescueNegativeTestJSON-1433266011-project-member</nova:user>
Nov 02 01:51:48 user nova-compute[74996]:         <nova:project uuid="6d89083c24ba475f9159a80fddfe9159">tempest-ServerRescueNegativeTestJSON-1433266011</nova:project>
Nov 02 01:51:48 user nova-compute[74996]:       </nova:owner>
Nov 02 01:51:48 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:51:48 user nova-compute[74996]:       <nova:ports>
Nov 02 01:51:48 user nova-compute[74996]:         <nova:port uuid="b5d6eb99-a00c-4440-98d6-6432b493f131">
Nov 02 01:51:48 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 01:51:48 user nova-compute[74996]:         </nova:port>
Nov 02 01:51:48 user nova-compute[74996]:       </nova:ports>
Nov 02 01:51:48 user nova-compute[74996]:     </nova:instance>
Nov 02 01:51:48 user nova-compute[74996]:   </metadata>
Nov 02 01:51:48 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:51:48 user nova-compute[74996]:     <system>
Nov 02 01:51:48 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:51:48 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:51:48 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:51:48 user nova-compute[74996]:       <entry name="serial">e38704a7-f8a0-482c-bd51-26a90d37b71d</entry>
Nov 02 01:51:48 user nova-compute[74996]:       <entry name="uuid">e38704a7-f8a0-482c-bd51-26a90d37b71d</entry>
Nov 02 01:51:48 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:51:48 user nova-compute[74996]:     </system>
Nov 02 01:51:48 user nova-compute[74996]:   </sysinfo>
Nov 02 01:51:48 user nova-compute[74996]:   <os>
Nov 02 01:51:48 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:51:48 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:51:48 user nova-compute[74996]:   </os>
Nov 02 01:51:48 user nova-compute[74996]:   <features>
Nov 02 01:51:48 user nova-compute[74996]:     <acpi/>
Nov 02 01:51:48 user nova-compute[74996]:     <apic/>
Nov 02 01:51:48 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:51:48 user nova-compute[74996]:   </features>
Nov 02 01:51:48 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:51:48 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:51:48 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:51:48 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:51:48 user nova-compute[74996]:   </clock>
Nov 02 01:51:48 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:51:48 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:51:48 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:51:48 user nova-compute[74996]:   </cpu>
Nov 02 01:51:48 user nova-compute[74996]:   <devices>
Nov 02 01:51:48 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:51:48 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:51:48 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk.rescue"/>
Nov 02 01:51:48 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:51:48 user nova-compute[74996]:     </disk>
Nov 02 01:51:48 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:51:48 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:51:48 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk"/>
Nov 02 01:51:48 user nova-compute[74996]:       <target dev="vdb" bus="virtio"/>
Nov 02 01:51:48 user nova-compute[74996]:     </disk>
Nov 02 01:51:48 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:51:48 user nova-compute[74996]:       <mac address="fa:16:3e:67:64:10"/>
Nov 02 01:51:48 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:51:48 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:51:48 user nova-compute[74996]:       <target dev="tapb5d6eb99-a0"/>
Nov 02 01:51:48 user nova-compute[74996]:     </interface>
Nov 02 01:51:48 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:51:48 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/console.log" append="off"/>
Nov 02 01:51:48 user nova-compute[74996]:     </serial>
Nov 02 01:51:48 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:51:48 user nova-compute[74996]:     <video>
Nov 02 01:51:48 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:51:48 user nova-compute[74996]:     </video>
Nov 02 01:51:48 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:51:48 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:51:48 user nova-compute[74996]:     </rng>
Nov 02 01:51:48 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:51:48 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:51:48 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:51:48 user nova-compute[74996]:     </memballoon>
Nov 02 01:51:48 user nova-compute[74996]:   </devices>
Nov 02 01:51:48 user nova-compute[74996]: </domain>
Nov 02 01:51:48 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:51:48 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Instance destroyed successfully.
Nov 02 01:51:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:49 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:51:49 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:51:49 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] No VIF found with MAC fa:16:3e:67:64:10, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:51:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:51:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:51:49 user nova-compute[74996]: DEBUG nova.objects.instance [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lazy-loading 'pci_requests' on Instance uuid 03114a20-c464-4ecd-850d-1a29a6ad2584 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:51:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:49 user nova-compute[74996]: DEBUG nova.objects.instance [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lazy-loading 'numa_topology' on Instance uuid 03114a20-c464-4ecd-850d-1a29a6ad2584 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:51:49 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:51:49 user nova-compute[74996]: INFO nova.compute.claims [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Claim successful on node user
Nov 02 01:51:49 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:51:49 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:51:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:51:49 user nova-compute[74996]: INFO nova.network.neutron [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Updating port 0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG nova.compute.manager [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received event network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] Acquiring lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG nova.compute.manager [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] No waiting events found dispatching network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:51:50 user nova-compute[74996]: WARNING nova.compute.manager [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received unexpected event network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 for instance with vm_state active and task_state rescuing.
Nov 02 01:51:50 user nova-compute[74996]: DEBUG nova.compute.manager [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received event network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] Acquiring lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG nova.compute.manager [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] No waiting events found dispatching network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:51:50 user nova-compute[74996]: WARNING nova.compute.manager [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received unexpected event network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 for instance with vm_state active and task_state rescuing.
Nov 02 01:51:50 user nova-compute[74996]: DEBUG nova.compute.manager [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received event network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] Acquiring lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG nova.compute.manager [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] No waiting events found dispatching network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:51:50 user nova-compute[74996]: WARNING nova.compute.manager [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received unexpected event network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 for instance with vm_state active and task_state rescuing.
Nov 02 01:51:50 user nova-compute[74996]: DEBUG nova.compute.manager [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received event network-vif-unplugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] Acquiring lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG nova.compute.manager [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] No waiting events found dispatching network-vif-unplugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:51:50 user nova-compute[74996]: WARNING nova.compute.manager [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received unexpected event network-vif-unplugged-b5d6eb99-a00c-4440-98d6-6432b493f131 for instance with vm_state active and task_state rescuing.
Nov 02 01:51:50 user nova-compute[74996]: DEBUG nova.compute.manager [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received event network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] Acquiring lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG nova.compute.manager [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] No waiting events found dispatching network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:51:50 user nova-compute[74996]: WARNING nova.compute.manager [req-6db063ff-a35b-47f6-b39d-5d44e49a56c3 req-dd7adb66-ae5d-44df-b33a-2f1bdca7df8f service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received unexpected event network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 for instance with vm_state active and task_state rescuing.
Nov 02 01:51:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "refresh_cache-03114a20-c464-4ecd-850d-1a29a6ad2584" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquired lock "refresh_cache-03114a20-c464-4ecd-850d-1a29a6ad2584" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG nova.network.neutron [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG nova.compute.manager [req-d3295405-a5a4-4e83-9236-db0ea3b7abdc req-790ab75a-8a56-41ca-9d72-576387f142dc service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Received event network-changed-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG nova.compute.manager [req-d3295405-a5a4-4e83-9236-db0ea3b7abdc req-790ab75a-8a56-41ca-9d72-576387f142dc service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Refreshing instance network info cache due to event network-changed-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d3295405-a5a4-4e83-9236-db0ea3b7abdc req-790ab75a-8a56-41ca-9d72-576387f142dc service nova] Acquiring lock "refresh_cache-03114a20-c464-4ecd-850d-1a29a6ad2584" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:51:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:51 user nova-compute[74996]: DEBUG nova.network.neutron [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Updating instance_info_cache with network_info: [{"id": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "address": "fa:16:3e:a8:7a:d9", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aafb9f8-9e", "ovs_interfaceid": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:51:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Releasing lock "refresh_cache-03114a20-c464-4ecd-850d-1a29a6ad2584" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:51:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:51:51 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Creating image(s)
Nov 02 01:51:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "/opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:51:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "/opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:51:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "/opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:51:51 user nova-compute[74996]: DEBUG nova.objects.instance [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lazy-loading 'trusted_certs' on Instance uuid 03114a20-c464-4ecd-850d-1a29a6ad2584 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:51:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d3295405-a5a4-4e83-9236-db0ea3b7abdc req-790ab75a-8a56-41ca-9d72-576387f142dc service nova] Acquired lock "refresh_cache-03114a20-c464-4ecd-850d-1a29a6ad2584" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:51:51 user nova-compute[74996]: DEBUG nova.network.neutron [req-d3295405-a5a4-4e83-9236-db0ea3b7abdc req-790ab75a-8a56-41ca-9d72-576387f142dc service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Refreshing network info cache for port 0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:51:51 user nova-compute[74996]: DEBUG nova.objects.base [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Object Instance<03114a20-c464-4ecd-850d-1a29a6ad2584> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:51:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "44a9a1f7b3dc70ce8ec5563589cc5ebee7e6a690" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:51:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "44a9a1f7b3dc70ce8ec5563589cc5ebee7e6a690" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:51:52 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44a9a1f7b3dc70ce8ec5563589cc5ebee7e6a690.part --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:52 user nova-compute[74996]: DEBUG nova.compute.manager [req-1cb2b1cd-9965-44ef-af61-859464f46946 req-c4ee83db-0cd5-4c3d-b971-e3b43ab9e0d2 service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received event network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:51:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1cb2b1cd-9965-44ef-af61-859464f46946 req-c4ee83db-0cd5-4c3d-b971-e3b43ab9e0d2 service nova] Acquiring lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:51:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1cb2b1cd-9965-44ef-af61-859464f46946 req-c4ee83db-0cd5-4c3d-b971-e3b43ab9e0d2 service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:51:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1cb2b1cd-9965-44ef-af61-859464f46946 req-c4ee83db-0cd5-4c3d-b971-e3b43ab9e0d2 service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:51:52 user nova-compute[74996]: DEBUG nova.compute.manager [req-1cb2b1cd-9965-44ef-af61-859464f46946 req-c4ee83db-0cd5-4c3d-b971-e3b43ab9e0d2 service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] No waiting events found dispatching network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:51:52 user nova-compute[74996]: WARNING nova.compute.manager [req-1cb2b1cd-9965-44ef-af61-859464f46946 req-c4ee83db-0cd5-4c3d-b971-e3b43ab9e0d2 service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received unexpected event network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 for instance with vm_state active and task_state rescuing.
Nov 02 01:51:52 user nova-compute[74996]: DEBUG nova.compute.manager [req-1cb2b1cd-9965-44ef-af61-859464f46946 req-c4ee83db-0cd5-4c3d-b971-e3b43ab9e0d2 service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received event network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:51:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1cb2b1cd-9965-44ef-af61-859464f46946 req-c4ee83db-0cd5-4c3d-b971-e3b43ab9e0d2 service nova] Acquiring lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:51:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1cb2b1cd-9965-44ef-af61-859464f46946 req-c4ee83db-0cd5-4c3d-b971-e3b43ab9e0d2 service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:51:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1cb2b1cd-9965-44ef-af61-859464f46946 req-c4ee83db-0cd5-4c3d-b971-e3b43ab9e0d2 service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:51:52 user nova-compute[74996]: DEBUG nova.compute.manager [req-1cb2b1cd-9965-44ef-af61-859464f46946 req-c4ee83db-0cd5-4c3d-b971-e3b43ab9e0d2 service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] No waiting events found dispatching network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:51:52 user nova-compute[74996]: WARNING nova.compute.manager [req-1cb2b1cd-9965-44ef-af61-859464f46946 req-c4ee83db-0cd5-4c3d-b971-e3b43ab9e0d2 service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received unexpected event network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 for instance with vm_state active and task_state rescuing.
Nov 02 01:51:52 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44a9a1f7b3dc70ce8ec5563589cc5ebee7e6a690.part --force-share --output=json" returned: 0 in 0.194s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:52 user nova-compute[74996]: DEBUG nova.virt.images [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] 05608a46-ade2-41a1-8e6b-2f415b980ea0 was qcow2, converting to raw {{(pid=74996) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 01:51:52 user nova-compute[74996]: DEBUG nova.privsep.utils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74996) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 01:51:52 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/44a9a1f7b3dc70ce8ec5563589cc5ebee7e6a690.part /opt/stack/data/nova/instances/_base/44a9a1f7b3dc70ce8ec5563589cc5ebee7e6a690.converted {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:53 user nova-compute[74996]: DEBUG nova.network.neutron [req-d3295405-a5a4-4e83-9236-db0ea3b7abdc req-790ab75a-8a56-41ca-9d72-576387f142dc service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Updated VIF entry in instance network info cache for port 0aafb9f8-9eec-4e51-a955-fd1aeb4c5246. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:51:53 user nova-compute[74996]: DEBUG nova.network.neutron [req-d3295405-a5a4-4e83-9236-db0ea3b7abdc req-790ab75a-8a56-41ca-9d72-576387f142dc service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Updating instance_info_cache with network_info: [{"id": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "address": "fa:16:3e:a8:7a:d9", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aafb9f8-9e", "ovs_interfaceid": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:51:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/44a9a1f7b3dc70ce8ec5563589cc5ebee7e6a690.part /opt/stack/data/nova/instances/_base/44a9a1f7b3dc70ce8ec5563589cc5ebee7e6a690.converted" returned: 0 in 0.526s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44a9a1f7b3dc70ce8ec5563589cc5ebee7e6a690.converted --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d3295405-a5a4-4e83-9236-db0ea3b7abdc req-790ab75a-8a56-41ca-9d72-576387f142dc service nova] Releasing lock "refresh_cache-03114a20-c464-4ecd-850d-1a29a6ad2584" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:51:53 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ca4d0b2f-268a-49b1-974a-5459d6390f1c tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:51:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44a9a1f7b3dc70ce8ec5563589cc5ebee7e6a690.converted --force-share --output=json" returned: 0 in 0.244s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "44a9a1f7b3dc70ce8ec5563589cc5ebee7e6a690" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.156s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:51:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44a9a1f7b3dc70ce8ec5563589cc5ebee7e6a690 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44a9a1f7b3dc70ce8ec5563589cc5ebee7e6a690 --force-share --output=json" returned: 0 in 0.209s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "44a9a1f7b3dc70ce8ec5563589cc5ebee7e6a690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:51:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "44a9a1f7b3dc70ce8ec5563589cc5ebee7e6a690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:51:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44a9a1f7b3dc70ce8ec5563589cc5ebee7e6a690 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44a9a1f7b3dc70ce8ec5563589cc5ebee7e6a690 --force-share --output=json" returned: 0 in 0.201s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44a9a1f7b3dc70ce8ec5563589cc5ebee7e6a690,backing_fmt=raw /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44a9a1f7b3dc70ce8ec5563589cc5ebee7e6a690,backing_fmt=raw /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk 1073741824" returned: 0 in 0.062s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "44a9a1f7b3dc70ce8ec5563589cc5ebee7e6a690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:51:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44a9a1f7b3dc70ce8ec5563589cc5ebee7e6a690 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44a9a1f7b3dc70ce8ec5563589cc5ebee7e6a690 --force-share --output=json" returned: 0 in 0.254s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:54 user nova-compute[74996]: DEBUG nova.objects.instance [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lazy-loading 'migration_context' on Instance uuid 03114a20-c464-4ecd-850d-1a29a6ad2584 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:51:54 user nova-compute[74996]: DEBUG nova.objects.base [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Object Instance<03114a20-c464-4ecd-850d-1a29a6ad2584> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:51:54 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Rebasing disk image.
Nov 02 01:51:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.224s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:54 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 -F raw /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 -F raw /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk" returned: 0 in 2.711s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Ensure instance console log exists: /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Start _get_guest_xml network_info=[{"id": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "address": "fa:16:3e:a8:7a:d9", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aafb9f8-9e", "ovs_interfaceid": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='f6703abef133c4a9eed24c53d93213ee',container_format='bare',created_at=2023-11-02T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=05608a46-ade2-41a1-8e6b-2f415b980ea0,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-324177429-shelved',owner='22b862880e0c43ab8f5a4d65f6697955',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-02T01:49:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '7d60e1b2-24d9-4efc-8496-1706e64270d2', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xjRuimBY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '03114a20-c464-4ecd-850d-1a29a6ad2584', 'attached_at': '', 'detached_at': '', 'volume_id': 'b0db817d-7604-4424-9c26-ab9af78869bd', 'serial': 'b0db817d-7604-4424-9c26-ab9af78869bd'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:51:57 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:51:57 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:51:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f6703abef133c4a9eed24c53d93213ee',container_format='bare',created_at=2023-11-02T01:49:35Z,direct_url=<?>,disk_format='qcow2',id=05608a46-ade2-41a1-8e6b-2f415b980ea0,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-324177429-shelved',owner='22b862880e0c43ab8f5a4d65f6697955',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-02T01:49:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG nova.objects.instance [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lazy-loading 'vcpu_model' on Instance uuid 03114a20-c464-4ecd-850d-1a29a6ad2584 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG nova.objects.base [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Object Instance<03114a20-c464-4ecd-850d-1a29a6ad2584> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xjRuimBY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:51:57 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:51:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:51:57 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:51:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:51:57 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe94e869-471c-4dbb-99fd-361cbf55218e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:51:57 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7465f4b-4057-4cfe-85c5-3f5f1559db81]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd] added
Nov 02 01:51:57 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d512bf-7411-4a2b-8dae-e4671f8378f2]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[158d788c-85e7-4246-b9a7-8b75a3f2b300]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xjRuimBY {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xjRuimBY" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9f7215-440f-4b7a-9b37-2971ad788c29]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xjRuimBY'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6c84ad-55e2-4722-b47c-055b77b84429]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[666ad32a-3715-403a-8201-77336734448d]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:51:57 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:51:57 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d55b27-1fa3-497f-989d-092622aa3fd9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd, portal: 172.16.0.220,3260]
Nov 02 01:51:57 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd, portal: 172.16.0.220,3260] successful.
Nov 02 01:51:57 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2e9caa-342a-4637-a829-5ddffaa0fe6d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cb23e6-6a24-46ca-a9d5-8aa48723d3ae]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:51:57 user nova-compute[74996]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd (non-flash)
Nov 02 01:51:57 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:51:57 user nova-compute[74996]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd (non-flash)
Nov 02 01:51:57 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[31970677-9810-4052-a785-4e93d581661a]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:51:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xjRuimBY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:51:58 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:51:58 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '23933373465363932', 'path': '/dev/sdc'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:51:58 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933373465363932', 'path': '/dev/sdc'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:51:58 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T01:47:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-324177429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-324177429',id=34,image_ref='05608a46-ade2-41a1-8e6b-2f415b980ea0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1560575805',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:47:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='22b862880e0c43ab8f5a4d65f6697955',ramdisk_id='',reservation_id='r-e7r370s7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-701748724',owner_user_name='tempest-AttachVolumeShelveTestJSON-701748724-project-member',shelved_at='2023-11-02T01:49:39.218160',shelved_host='user',shelved_image_id='05608a46-ade2-41a1-8e6b-2f415b980ea0'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:51:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01fc2ea044794374b09741ecaf841ba2',uuid=03114a20-c464-4ecd-850d-1a29a6ad2584,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "address": "fa:16:3e:a8:7a:d9", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aafb9f8-9e", "ovs_interfaceid": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:51:58 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Converting VIF {"id": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "address": "fa:16:3e:a8:7a:d9", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aafb9f8-9e", "ovs_interfaceid": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:51:58 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:7a:d9,bridge_name='br-int',has_traffic_filtering=True,id=0aafb9f8-9eec-4e51-a955-fd1aeb4c5246,network=Network(936a0e26-8a02-4c7c-9d24-acbb2f438cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aafb9f8-9e') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:51:58 user nova-compute[74996]: DEBUG nova.objects.instance [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lazy-loading 'pci_devices' on Instance uuid 03114a20-c464-4ecd-850d-1a29a6ad2584 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:51:58 user nova-compute[74996]: DEBUG nova.objects.base [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Object Instance<03114a20-c464-4ecd-850d-1a29a6ad2584> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:51:58 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:51:58 user nova-compute[74996]:   <uuid>03114a20-c464-4ecd-850d-1a29a6ad2584</uuid>
Nov 02 01:51:58 user nova-compute[74996]:   <name>instance-00000022</name>
Nov 02 01:51:58 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:51:58 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:51:58 user nova-compute[74996]:   <metadata>
Nov 02 01:51:58 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:51:58 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:51:58 user nova-compute[74996]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-324177429</nova:name>
Nov 02 01:51:58 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:51:57</nova:creationTime>
Nov 02 01:51:58 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:51:58 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:51:58 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:51:58 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:51:58 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:51:58 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:51:58 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:51:58 user nova-compute[74996]:       <nova:owner>
Nov 02 01:51:58 user nova-compute[74996]:         <nova:user uuid="01fc2ea044794374b09741ecaf841ba2">tempest-AttachVolumeShelveTestJSON-701748724-project-member</nova:user>
Nov 02 01:51:58 user nova-compute[74996]:         <nova:project uuid="22b862880e0c43ab8f5a4d65f6697955">tempest-AttachVolumeShelveTestJSON-701748724</nova:project>
Nov 02 01:51:58 user nova-compute[74996]:       </nova:owner>
Nov 02 01:51:58 user nova-compute[74996]:       <nova:root type="image" uuid="05608a46-ade2-41a1-8e6b-2f415b980ea0"/>
Nov 02 01:51:58 user nova-compute[74996]:       <nova:ports>
Nov 02 01:51:58 user nova-compute[74996]:         <nova:port uuid="0aafb9f8-9eec-4e51-a955-fd1aeb4c5246">
Nov 02 01:51:58 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 01:51:58 user nova-compute[74996]:         </nova:port>
Nov 02 01:51:58 user nova-compute[74996]:       </nova:ports>
Nov 02 01:51:58 user nova-compute[74996]:     </nova:instance>
Nov 02 01:51:58 user nova-compute[74996]:   </metadata>
Nov 02 01:51:58 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:51:58 user nova-compute[74996]:     <system>
Nov 02 01:51:58 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:51:58 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:51:58 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:51:58 user nova-compute[74996]:       <entry name="serial">03114a20-c464-4ecd-850d-1a29a6ad2584</entry>
Nov 02 01:51:58 user nova-compute[74996]:       <entry name="uuid">03114a20-c464-4ecd-850d-1a29a6ad2584</entry>
Nov 02 01:51:58 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:51:58 user nova-compute[74996]:     </system>
Nov 02 01:51:58 user nova-compute[74996]:   </sysinfo>
Nov 02 01:51:58 user nova-compute[74996]:   <os>
Nov 02 01:51:58 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:51:58 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:51:58 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:51:58 user nova-compute[74996]:   </os>
Nov 02 01:51:58 user nova-compute[74996]:   <features>
Nov 02 01:51:58 user nova-compute[74996]:     <acpi/>
Nov 02 01:51:58 user nova-compute[74996]:     <apic/>
Nov 02 01:51:58 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:51:58 user nova-compute[74996]:   </features>
Nov 02 01:51:58 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:51:58 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:51:58 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:51:58 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:51:58 user nova-compute[74996]:   </clock>
Nov 02 01:51:58 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:51:58 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:51:58 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:51:58 user nova-compute[74996]:   </cpu>
Nov 02 01:51:58 user nova-compute[74996]:   <devices>
Nov 02 01:51:58 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:51:58 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:51:58 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk"/>
Nov 02 01:51:58 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:51:58 user nova-compute[74996]:     </disk>
Nov 02 01:51:58 user nova-compute[74996]:     <disk type="block" device="disk">
Nov 02 01:51:58 user nova-compute[74996]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:51:58 user nova-compute[74996]:       <source dev="/dev/sdc"/>
Nov 02 01:51:58 user nova-compute[74996]:       <target dev="vdc" bus="virtio"/>
Nov 02 01:51:58 user nova-compute[74996]:       <serial>b0db817d-7604-4424-9c26-ab9af78869bd</serial>
Nov 02 01:51:58 user nova-compute[74996]:     </disk>
Nov 02 01:51:58 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:51:58 user nova-compute[74996]:       <mac address="fa:16:3e:a8:7a:d9"/>
Nov 02 01:51:58 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:51:58 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:51:58 user nova-compute[74996]:       <target dev="tap0aafb9f8-9e"/>
Nov 02 01:51:58 user nova-compute[74996]:     </interface>
Nov 02 01:51:58 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:51:58 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/console.log" append="off"/>
Nov 02 01:51:58 user nova-compute[74996]:     </serial>
Nov 02 01:51:58 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:51:58 user nova-compute[74996]:     <video>
Nov 02 01:51:58 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:51:58 user nova-compute[74996]:     </video>
Nov 02 01:51:58 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:51:58 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:51:58 user nova-compute[74996]:     </rng>
Nov 02 01:51:58 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:51:58 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:51:58 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:51:58 user nova-compute[74996]:     </memballoon>
Nov 02 01:51:58 user nova-compute[74996]:   </devices>
Nov 02 01:51:58 user nova-compute[74996]: </domain>
Nov 02 01:51:58 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:51:58 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T01:47:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-324177429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-324177429',id=34,image_ref='05608a46-ade2-41a1-8e6b-2f415b980ea0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1560575805',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:47:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='22b862880e0c43ab8f5a4d65f6697955',ramdisk_id='',reservation_id='r-e7r370s7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-701748724',owner_user_name='tempest-AttachVolumeShelveTestJSON-701748724-project-member',shelved_at='2023-11-02T01:49:39.218160',shelved_host='user',shelved_image_id='05608a46-ade2-41a1-8e6b-2f415b980ea0'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:51:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01fc2ea044794374b09741ecaf841ba2',uuid=03114a20-c464-4ecd-850d-1a29a6ad2584,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "address": "fa:16:3e:a8:7a:d9", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aafb9f8-9e", "ovs_interfaceid": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:51:58 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Converting VIF {"id": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "address": "fa:16:3e:a8:7a:d9", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aafb9f8-9e", "ovs_interfaceid": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:51:58 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:7a:d9,bridge_name='br-int',has_traffic_filtering=True,id=0aafb9f8-9eec-4e51-a955-fd1aeb4c5246,network=Network(936a0e26-8a02-4c7c-9d24-acbb2f438cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aafb9f8-9e') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:51:58 user nova-compute[74996]: DEBUG os_vif [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:7a:d9,bridge_name='br-int',has_traffic_filtering=True,id=0aafb9f8-9eec-4e51-a955-fd1aeb4c5246,network=Network(936a0e26-8a02-4c7c-9d24-acbb2f438cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aafb9f8-9e') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:51:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:51:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:51:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ccbe9b0-e822-5b34-9113-6dcbfb8f174b', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:51:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0aafb9f8-9e, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:51:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0aafb9f8-9e, col_values=(('qos', UUID('a624f984-8fe3-4eb5-a9af-a56f87b1d61a')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:51:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0aafb9f8-9e, col_values=(('external_ids', {'iface-id': '0aafb9f8-9eec-4e51-a955-fd1aeb4c5246', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:7a:d9', 'vm-uuid': '03114a20-c464-4ecd-850d-1a29a6ad2584'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:51:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:51:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:51:58 user nova-compute[74996]: INFO os_vif [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:7a:d9,bridge_name='br-int',has_traffic_filtering=True,id=0aafb9f8-9eec-4e51-a955-fd1aeb4c5246,network=Network(936a0e26-8a02-4c7c-9d24-acbb2f438cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aafb9f8-9e')
Nov 02 01:51:58 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:51:58 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:51:58 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] No VIF found with MAC fa:16:3e:a8:7a:d9, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:52:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:52:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:52:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:52:00 user nova-compute[74996]: DEBUG nova.compute.manager [req-11ef28b6-e6a5-46ba-a520-6e0aeb8231cc req-466d596f-a44e-446e-a5fe-8246569f4aab service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Received event network-vif-plugged-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:52:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-11ef28b6-e6a5-46ba-a520-6e0aeb8231cc req-466d596f-a44e-446e-a5fe-8246569f4aab service nova] Acquiring lock "03114a20-c464-4ecd-850d-1a29a6ad2584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:52:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-11ef28b6-e6a5-46ba-a520-6e0aeb8231cc req-466d596f-a44e-446e-a5fe-8246569f4aab service nova] Lock "03114a20-c464-4ecd-850d-1a29a6ad2584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:52:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-11ef28b6-e6a5-46ba-a520-6e0aeb8231cc req-466d596f-a44e-446e-a5fe-8246569f4aab service nova] Lock "03114a20-c464-4ecd-850d-1a29a6ad2584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:52:00 user nova-compute[74996]: DEBUG nova.compute.manager [req-11ef28b6-e6a5-46ba-a520-6e0aeb8231cc req-466d596f-a44e-446e-a5fe-8246569f4aab service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] No waiting events found dispatching network-vif-plugged-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:52:00 user nova-compute[74996]: WARNING nova.compute.manager [req-11ef28b6-e6a5-46ba-a520-6e0aeb8231cc req-466d596f-a44e-446e-a5fe-8246569f4aab service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Received unexpected event network-vif-plugged-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 02 01:52:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:52:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:52:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:52:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:52:03 user nova-compute[74996]: DEBUG nova.compute.manager [req-2afe623f-4a59-4c27-a139-1974f300ed69 req-159c7fa6-10cf-4808-9c2e-0175ae964b5b service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Received event network-vif-plugged-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:52:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2afe623f-4a59-4c27-a139-1974f300ed69 req-159c7fa6-10cf-4808-9c2e-0175ae964b5b service nova] Acquiring lock "03114a20-c464-4ecd-850d-1a29a6ad2584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:52:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2afe623f-4a59-4c27-a139-1974f300ed69 req-159c7fa6-10cf-4808-9c2e-0175ae964b5b service nova] Lock "03114a20-c464-4ecd-850d-1a29a6ad2584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:52:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2afe623f-4a59-4c27-a139-1974f300ed69 req-159c7fa6-10cf-4808-9c2e-0175ae964b5b service nova] Lock "03114a20-c464-4ecd-850d-1a29a6ad2584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:52:03 user nova-compute[74996]: DEBUG nova.compute.manager [req-2afe623f-4a59-4c27-a139-1974f300ed69 req-159c7fa6-10cf-4808-9c2e-0175ae964b5b service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] No waiting events found dispatching network-vif-plugged-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:52:03 user nova-compute[74996]: WARNING nova.compute.manager [req-2afe623f-4a59-4c27-a139-1974f300ed69 req-159c7fa6-10cf-4808-9c2e-0175ae964b5b service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Received unexpected event network-vif-plugged-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 02 01:52:03 user nova-compute[74996]: DEBUG nova.compute.manager [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:52:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:52:03 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Instance spawned successfully.
Nov 02 01:52:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:52:03 user nova-compute[74996]: DEBUG nova.compute.manager [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:52:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bcb1bf91-6ccf-4c75-bf70-d5fce651a1b8 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "03114a20-c464-4ecd-850d-1a29a6ad2584" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 35.834s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:52:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:52:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:52:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:52:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:52:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:52:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:52:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:52:22 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:52:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:52:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:52:24 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:52:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:52:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:52:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:52:24 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:52:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:52:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk.rescue --force-share --output=json" returned: 0 in 0.253s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:52:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:52:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:52:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:52:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:52:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:52:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:52:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:52:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:52:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:52:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:52:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:52:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:52:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:52:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:52:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:52:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:52:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:52:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:52:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:52:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:52:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:52:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:52:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:52:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:52:27 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:52:27 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:52:27 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8172MB free_disk=25.042583465576172GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:52:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:52:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:52:27 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance e38704a7-f8a0-482c-bd51-26a90d37b71d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:52:27 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7c53e6cc-cf69-485d-b24f-5e113dae0e5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:52:27 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:52:27 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 03114a20-c464-4ecd-850d-1a29a6ad2584 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:52:27 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:52:27 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:52:27 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:52:27 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:52:27 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:52:27 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:52:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.310s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:52:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:52:28 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:52:28 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:52:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:52:29 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:52:29 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:52:29 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Rebuilding the list of instances to heal {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 01:52:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-e38704a7-f8a0-482c-bd51-26a90d37b71d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:52:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-e38704a7-f8a0-482c-bd51-26a90d37b71d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:52:29 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 01:52:29 user nova-compute[74996]: DEBUG nova.objects.instance [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lazy-loading 'info_cache' on Instance uuid e38704a7-f8a0-482c-bd51-26a90d37b71d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:52:29 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Updating instance_info_cache with network_info: [{"id": "b5d6eb99-a00c-4440-98d6-6432b493f131", "address": "fa:16:3e:67:64:10", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d6eb99-a0", "ovs_interfaceid": "b5d6eb99-a00c-4440-98d6-6432b493f131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:52:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-e38704a7-f8a0-482c-bd51-26a90d37b71d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:52:29 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 01:52:29 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:52:29 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:52:30 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:52:32 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:52:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:52:33 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:52:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:52:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-85c9a85b-9e43-4293-864c-d16f536eebfc req-b5bd4301-f2b5-4c1e-828d-fa05c3278519 service nova] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Received event network-changed-3d50920e-49be-4b14-9019-60a286e9f068 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:52:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-85c9a85b-9e43-4293-864c-d16f536eebfc req-b5bd4301-f2b5-4c1e-828d-fa05c3278519 service nova] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Refreshing instance network info cache due to event network-changed-3d50920e-49be-4b14-9019-60a286e9f068. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:52:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-85c9a85b-9e43-4293-864c-d16f536eebfc req-b5bd4301-f2b5-4c1e-828d-fa05c3278519 service nova] Acquiring lock "refresh_cache-3f80eb60-ba0b-4a4c-8b41-17130ddf51fa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:52:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-85c9a85b-9e43-4293-864c-d16f536eebfc req-b5bd4301-f2b5-4c1e-828d-fa05c3278519 service nova] Acquired lock "refresh_cache-3f80eb60-ba0b-4a4c-8b41-17130ddf51fa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:52:33 user nova-compute[74996]: DEBUG nova.network.neutron [req-85c9a85b-9e43-4293-864c-d16f536eebfc req-b5bd4301-f2b5-4c1e-828d-fa05c3278519 service nova] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Refreshing network info cache for port 3d50920e-49be-4b14-9019-60a286e9f068 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:52:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:52:34 user nova-compute[74996]: DEBUG nova.network.neutron [req-85c9a85b-9e43-4293-864c-d16f536eebfc req-b5bd4301-f2b5-4c1e-828d-fa05c3278519 service nova] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Updated VIF entry in instance network info cache for port 3d50920e-49be-4b14-9019-60a286e9f068. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:52:34 user nova-compute[74996]: DEBUG nova.network.neutron [req-85c9a85b-9e43-4293-864c-d16f536eebfc req-b5bd4301-f2b5-4c1e-828d-fa05c3278519 service nova] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Updating instance_info_cache with network_info: [{"id": "3d50920e-49be-4b14-9019-60a286e9f068", "address": "fa:16:3e:ba:b0:00", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d50920e-49", "ovs_interfaceid": "3d50920e-49be-4b14-9019-60a286e9f068", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:52:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-85c9a85b-9e43-4293-864c-d16f536eebfc req-b5bd4301-f2b5-4c1e-828d-fa05c3278519 service nova] Releasing lock "refresh_cache-3f80eb60-ba0b-4a4c-8b41-17130ddf51fa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:52:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:52:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:52:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:52:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:52:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:52:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:52:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "7b264ec1-a5d7-40ef-833c-c68211a041d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:52:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "7b264ec1-a5d7-40ef-833c-c68211a041d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:52:51 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:52:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:52:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:52:51 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:52:51 user nova-compute[74996]: INFO nova.compute.claims [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Claim successful on node user
Nov 02 01:52:52 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:52:52 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:52:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:52:52 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:52:52 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:52:52 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:52:52 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:52:52 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:52:52 user nova-compute[74996]: DEBUG nova.policy [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be6bf504c3a649898e8c83399f6fee8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31965b482eb243a69112a49bf1302779', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:52:52 user nova-compute[74996]: INFO nova.virt.block_device [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Booting with volume 375c9c0e-b580-44bd-af3d-99e63b2a559c at /dev/vda
Nov 02 01:52:52 user nova-compute[74996]: DEBUG os_brick.utils [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:52:52 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:52:52 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:52:52 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c54063-c70c-49f2-ae0a-497a03169f2b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:52:52 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:52:52 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:52:52 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b04fd61-ea0f-4b59-abec-5059500e5714]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:52:52 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:52:52 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:52:52 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[07129b6a-1cea-4f61-ab5d-195dac117547]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:52:52 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[042478bb-647c-46f1-8147-3f4115b134f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:52:52 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:52:52 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:52:52 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:52:52 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:52:52 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:52:52 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:52:52 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[29aff456-e536-4b6e-8d05-f906c58bb707]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:52:52 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:52:52 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:52:52 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:52:52 user nova-compute[74996]: DEBUG os_brick.utils [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:52:52 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Updating existing volume attachment record: f290ac2b-5804-45e4-bd64-765000aa8b52 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:52:53 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Successfully created port: dd958dd3-c95f-4f47-9361-d505727a4497 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:52:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:52:53 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Successfully updated port: dd958dd3-c95f-4f47-9361-d505727a4497 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:52:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "refresh_cache-7b264ec1-a5d7-40ef-833c-c68211a041d1" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:52:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquired lock "refresh_cache-7b264ec1-a5d7-40ef-833c-c68211a041d1" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:52:53 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:52:53 user nova-compute[74996]: DEBUG nova.compute.manager [req-7e8b9d1d-86d8-4388-ba74-1daa7b09ecb7 req-fa3795ae-7ba7-4254-8d9b-f4d71e2e2692 service nova] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Received event network-changed-dd958dd3-c95f-4f47-9361-d505727a4497 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:52:53 user nova-compute[74996]: DEBUG nova.compute.manager [req-7e8b9d1d-86d8-4388-ba74-1daa7b09ecb7 req-fa3795ae-7ba7-4254-8d9b-f4d71e2e2692 service nova] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Refreshing instance network info cache due to event network-changed-dd958dd3-c95f-4f47-9361-d505727a4497. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:52:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7e8b9d1d-86d8-4388-ba74-1daa7b09ecb7 req-fa3795ae-7ba7-4254-8d9b-f4d71e2e2692 service nova] Acquiring lock "refresh_cache-7b264ec1-a5d7-40ef-833c-c68211a041d1" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:52:53 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:52:54 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Updating instance_info_cache with network_info: [{"id": "dd958dd3-c95f-4f47-9361-d505727a4497", "address": "fa:16:3e:b9:67:bf", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd958dd3-c9", "ovs_interfaceid": "dd958dd3-c95f-4f47-9361-d505727a4497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:52:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Releasing lock "refresh_cache-7b264ec1-a5d7-40ef-833c-c68211a041d1" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:52:54 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Instance network_info: |[{"id": "dd958dd3-c95f-4f47-9361-d505727a4497", "address": "fa:16:3e:b9:67:bf", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd958dd3-c9", "ovs_interfaceid": "dd958dd3-c95f-4f47-9361-d505727a4497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:52:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7e8b9d1d-86d8-4388-ba74-1daa7b09ecb7 req-fa3795ae-7ba7-4254-8d9b-f4d71e2e2692 service nova] Acquired lock "refresh_cache-7b264ec1-a5d7-40ef-833c-c68211a041d1" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:52:54 user nova-compute[74996]: DEBUG nova.network.neutron [req-7e8b9d1d-86d8-4388-ba74-1daa7b09ecb7 req-fa3795ae-7ba7-4254-8d9b-f4d71e2e2692 service nova] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Refreshing network info cache for port dd958dd3-c95f-4f47-9361-d505727a4497 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:52:54 user nova-compute[74996]: DEBUG nova.network.neutron [req-7e8b9d1d-86d8-4388-ba74-1daa7b09ecb7 req-fa3795ae-7ba7-4254-8d9b-f4d71e2e2692 service nova] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Updated VIF entry in instance network info cache for port dd958dd3-c95f-4f47-9361-d505727a4497. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:52:54 user nova-compute[74996]: DEBUG nova.network.neutron [req-7e8b9d1d-86d8-4388-ba74-1daa7b09ecb7 req-fa3795ae-7ba7-4254-8d9b-f4d71e2e2692 service nova] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Updating instance_info_cache with network_info: [{"id": "dd958dd3-c95f-4f47-9361-d505727a4497", "address": "fa:16:3e:b9:67:bf", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd958dd3-c9", "ovs_interfaceid": "dd958dd3-c95f-4f47-9361-d505727a4497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:52:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7e8b9d1d-86d8-4388-ba74-1daa7b09ecb7 req-fa3795ae-7ba7-4254-8d9b-f4d71e2e2692 service nova] Releasing lock "refresh_cache-7b264ec1-a5d7-40ef-833c-c68211a041d1" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:52:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:52:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:52:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 01:52:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:52:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:52:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:53:16 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Creating image(s)
Nov 02 01:53:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Did not create local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Ensure instance console log exists: /opt/stack/data/nova/instances/7b264ec1-a5d7-40ef-833c-c68211a041d1/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Start _get_guest_xml network_info=[{"id": "dd958dd3-c95f-4f47-9361-d505727a4497", "address": "fa:16:3e:b9:67:bf", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd958dd3-c9", "ovs_interfaceid": "dd958dd3-c95f-4f47-9361-d505727a4497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f290ac2b-5804-45e4-bd64-765000aa8b52', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMkoHixF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7b264ec1-a5d7-40ef-833c-c68211a041d1', 'attached_at': '', 'detached_at': '', 'volume_id': '375c9c0e-b580-44bd-af3d-99e63b2a559c', 'serial': '375c9c0e-b580-44bd-af3d-99e63b2a559c'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'volume_type': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:53:16 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:53:16 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:53:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMkoHixF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:53:16 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:53:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:53:16 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:53:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:53:16 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:53:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f300775-1adc-412c-88b1-5c209d474db7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:53:16 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[63477ae6-6c89-49cc-8f13-5168137278ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c] added
Nov 02 01:53:16 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c60ffe-ff59-4aad-bdb7-ddb45e6bd8cc]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3239874a-eede-42b8-adf2-94b5a75ff89c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMkoHixF {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMkoHixF" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef25c38-64d5-4fa5-a811-f658ac90714a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DMkoHixF'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9f5424-6a62-440e-8bdf-a2e01ef15834]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8f1b2a-3095-4132-9565-7aea1b6f679f]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:53:16 user nova-compute[74996]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd (non-flash)
Nov 02 01:53:16 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:53:16 user nova-compute[74996]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd (non-flash)
Nov 02 01:53:16 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf1f773-44de-47ff-bdd2-a9e34397ff2b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c, portal: 172.16.0.220,3260]
Nov 02 01:53:16 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c, portal: 172.16.0.220,3260] successful.
Nov 02 01:53:16 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:53:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:17 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c708060-b38b-432b-b9af-6772d971c33c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:53:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:17 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c31cab-3f05-4296-9c16-062c53924bbf]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:53:17 user nova-compute[74996]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd (non-flash)
Nov 02 01:53:17 user nova-compute[74996]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c (non-flash)
Nov 02 01:53:17 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:53:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:53:17 user nova-compute[74996]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd (non-flash)
Nov 02 01:53:17 user nova-compute[74996]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c (non-flash)
Nov 02 01:53:17 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:53:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:53:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:53:17 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:53:17 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:53:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:17 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[672b472d-fa8c-4230-89ac-f2d76b0c4949]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:17 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:53:17 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMkoHixF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:53:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "03114a20-c464-4ecd-850d-1a29a6ad2584" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:53:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "03114a20-c464-4ecd-850d-1a29a6ad2584" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:53:17 user nova-compute[74996]: INFO nova.compute.manager [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Detaching volume b0db817d-7604-4424-9c26-ab9af78869bd
Nov 02 01:53:17 user nova-compute[74996]: INFO nova.virt.block_device [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Attempting to driver detach volume b0db817d-7604-4424-9c26-ab9af78869bd from mountpoint /dev/vdc
Nov 02 01:53:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Attempting to detach device vdc from instance 03114a20-c464-4ecd-850d-1a29a6ad2584 from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 01:53:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 01:53:17 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:53:17 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 01:53:17 user nova-compute[74996]:   <target dev="vdc" bus="virtio"/>
Nov 02 01:53:17 user nova-compute[74996]:   <serial>b0db817d-7604-4424-9c26-ab9af78869bd</serial>
Nov 02 01:53:17 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 01:53:17 user nova-compute[74996]: </disk>
Nov 02 01:53:17 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:53:17 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Successfully detached device vdc from instance 03114a20-c464-4ecd-850d-1a29a6ad2584 from the persistent domain config.
Nov 02 01:53:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 03114a20-c464-4ecd-850d-1a29a6ad2584 from the live domain config. {{(pid=74996) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 01:53:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 01:53:17 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:53:17 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 01:53:17 user nova-compute[74996]:   <target dev="vdc" bus="virtio"/>
Nov 02 01:53:17 user nova-compute[74996]:   <serial>b0db817d-7604-4424-9c26-ab9af78869bd</serial>
Nov 02 01:53:17 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 01:53:17 user nova-compute[74996]: </disk>
Nov 02 01:53:17 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:53:18 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:53:18 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23666626564383835', 'path': '/dev/sdd'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:53:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666626564383835', 'path': '/dev/sdd'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:53:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:52:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1289502398',display_name='tempest-TestVolumeBootPattern-server-1289502398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1289502398',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqKsx295qdP4lg7887w79wguzwBudaKLS1CaKDMdZBRiyydUejeP/bphRv12kudSVdoUpRoo+kfCoJgBSoxWJoJnZVJJAUy53PGnOOqIVwETBw7ua4uyU/hdtrnp6uX6w==',key_name='tempest-TestVolumeBootPattern-1607904644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31965b482eb243a69112a49bf1302779',ramdisk_id='',reservation_id='r-r60bpgjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-216720976',owner_user_name='tempest-TestVolumeBootPattern-216720976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:52:52Z,user_data=None,user_id='be6bf504c3a649898e8c83399f6fee8e',uuid=7b264ec1-a5d7-40ef-833c-c68211a041d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd958dd3-c95f-4f47-9361-d505727a4497", "address": "fa:16:3e:b9:67:bf", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd958dd3-c9", "ovs_interfaceid": "dd958dd3-c95f-4f47-9361-d505727a4497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:53:18 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converting VIF {"id": "dd958dd3-c95f-4f47-9361-d505727a4497", "address": "fa:16:3e:b9:67:bf", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd958dd3-c9", "ovs_interfaceid": "dd958dd3-c95f-4f47-9361-d505727a4497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:53:18 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:67:bf,bridge_name='br-int',has_traffic_filtering=True,id=dd958dd3-c95f-4f47-9361-d505727a4497,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd958dd3-c9') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:53:18 user nova-compute[74996]: DEBUG nova.objects.instance [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b264ec1-a5d7-40ef-833c-c68211a041d1 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:53:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:53:18 user nova-compute[74996]:   <uuid>7b264ec1-a5d7-40ef-833c-c68211a041d1</uuid>
Nov 02 01:53:18 user nova-compute[74996]:   <name>instance-00000026</name>
Nov 02 01:53:18 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:53:18 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:53:18 user nova-compute[74996]:   <metadata>
Nov 02 01:53:18 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:53:18 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:53:18 user nova-compute[74996]:       <nova:name>tempest-TestVolumeBootPattern-server-1289502398</nova:name>
Nov 02 01:53:18 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:53:16</nova:creationTime>
Nov 02 01:53:18 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:53:18 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:53:18 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:53:18 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:53:18 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:53:18 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:53:18 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:53:18 user nova-compute[74996]:       <nova:owner>
Nov 02 01:53:18 user nova-compute[74996]:         <nova:user uuid="be6bf504c3a649898e8c83399f6fee8e">tempest-TestVolumeBootPattern-216720976-project-member</nova:user>
Nov 02 01:53:18 user nova-compute[74996]:         <nova:project uuid="31965b482eb243a69112a49bf1302779">tempest-TestVolumeBootPattern-216720976</nova:project>
Nov 02 01:53:18 user nova-compute[74996]:       </nova:owner>
Nov 02 01:53:18 user nova-compute[74996]:       <nova:ports>
Nov 02 01:53:18 user nova-compute[74996]:         <nova:port uuid="dd958dd3-c95f-4f47-9361-d505727a4497">
Nov 02 01:53:18 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 02 01:53:18 user nova-compute[74996]:         </nova:port>
Nov 02 01:53:18 user nova-compute[74996]:       </nova:ports>
Nov 02 01:53:18 user nova-compute[74996]:     </nova:instance>
Nov 02 01:53:18 user nova-compute[74996]:   </metadata>
Nov 02 01:53:18 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:53:18 user nova-compute[74996]:     <system>
Nov 02 01:53:18 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:53:18 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:53:18 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:53:18 user nova-compute[74996]:       <entry name="serial">7b264ec1-a5d7-40ef-833c-c68211a041d1</entry>
Nov 02 01:53:18 user nova-compute[74996]:       <entry name="uuid">7b264ec1-a5d7-40ef-833c-c68211a041d1</entry>
Nov 02 01:53:18 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:53:18 user nova-compute[74996]:     </system>
Nov 02 01:53:18 user nova-compute[74996]:   </sysinfo>
Nov 02 01:53:18 user nova-compute[74996]:   <os>
Nov 02 01:53:18 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:53:18 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:53:18 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:53:18 user nova-compute[74996]:   </os>
Nov 02 01:53:18 user nova-compute[74996]:   <features>
Nov 02 01:53:18 user nova-compute[74996]:     <acpi/>
Nov 02 01:53:18 user nova-compute[74996]:     <apic/>
Nov 02 01:53:18 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:53:18 user nova-compute[74996]:   </features>
Nov 02 01:53:18 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:53:18 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:53:18 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:53:18 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:53:18 user nova-compute[74996]:   </clock>
Nov 02 01:53:18 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:53:18 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:53:18 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:53:18 user nova-compute[74996]:   </cpu>
Nov 02 01:53:18 user nova-compute[74996]:   <devices>
Nov 02 01:53:18 user nova-compute[74996]:     <disk type="block" device="disk">
Nov 02 01:53:18 user nova-compute[74996]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:53:18 user nova-compute[74996]:       <source dev="/dev/sdd"/>
Nov 02 01:53:18 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:53:18 user nova-compute[74996]:       <serial>375c9c0e-b580-44bd-af3d-99e63b2a559c</serial>
Nov 02 01:53:18 user nova-compute[74996]:     </disk>
Nov 02 01:53:18 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:53:18 user nova-compute[74996]:       <mac address="fa:16:3e:b9:67:bf"/>
Nov 02 01:53:18 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:53:18 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:53:18 user nova-compute[74996]:       <target dev="tapdd958dd3-c9"/>
Nov 02 01:53:18 user nova-compute[74996]:     </interface>
Nov 02 01:53:18 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:53:18 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/7b264ec1-a5d7-40ef-833c-c68211a041d1/console.log" append="off"/>
Nov 02 01:53:18 user nova-compute[74996]:     </serial>
Nov 02 01:53:18 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:53:18 user nova-compute[74996]:     <video>
Nov 02 01:53:18 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:53:18 user nova-compute[74996]:     </video>
Nov 02 01:53:18 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:53:18 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:53:18 user nova-compute[74996]:     </rng>
Nov 02 01:53:18 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:53:18 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:53:18 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:53:18 user nova-compute[74996]:     </memballoon>
Nov 02 01:53:18 user nova-compute[74996]:   </devices>
Nov 02 01:53:18 user nova-compute[74996]: </domain>
Nov 02 01:53:18 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:53:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:52:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1289502398',display_name='tempest-TestVolumeBootPattern-server-1289502398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1289502398',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqKsx295qdP4lg7887w79wguzwBudaKLS1CaKDMdZBRiyydUejeP/bphRv12kudSVdoUpRoo+kfCoJgBSoxWJoJnZVJJAUy53PGnOOqIVwETBw7ua4uyU/hdtrnp6uX6w==',key_name='tempest-TestVolumeBootPattern-1607904644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31965b482eb243a69112a49bf1302779',ramdisk_id='',reservation_id='r-r60bpgjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-216720976',owner_user_name='tempest-TestVolumeBootPattern-216720976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:52:52Z,user_data=None,user_id='be6bf504c3a649898e8c83399f6fee8e',uuid=7b264ec1-a5d7-40ef-833c-c68211a041d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd958dd3-c95f-4f47-9361-d505727a4497", "address": "fa:16:3e:b9:67:bf", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd958dd3-c9", "ovs_interfaceid": "dd958dd3-c95f-4f47-9361-d505727a4497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:53:18 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converting VIF {"id": "dd958dd3-c95f-4f47-9361-d505727a4497", "address": "fa:16:3e:b9:67:bf", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd958dd3-c9", "ovs_interfaceid": "dd958dd3-c95f-4f47-9361-d505727a4497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:53:18 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:67:bf,bridge_name='br-int',has_traffic_filtering=True,id=dd958dd3-c95f-4f47-9361-d505727a4497,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd958dd3-c9') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:53:18 user nova-compute[74996]: DEBUG os_vif [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:67:bf,bridge_name='br-int',has_traffic_filtering=True,id=dd958dd3-c95f-4f47-9361-d505727a4497,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd958dd3-c9') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:53:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:53:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:53:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a9f3fbd6-e618-5e78-ae1c-60dc381d9fec', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:53:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:53:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd958dd3-c9, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:53:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd958dd3-c9, col_values=(('qos', UUID('2dc5c01c-3827-40bc-a12e-40739099c2d9')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:53:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd958dd3-c9, col_values=(('external_ids', {'iface-id': 'dd958dd3-c95f-4f47-9361-d505727a4497', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:67:bf', 'vm-uuid': '7b264ec1-a5d7-40ef-833c-c68211a041d1'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:53:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:53:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:18 user nova-compute[74996]: INFO os_vif [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:67:bf,bridge_name='br-int',has_traffic_filtering=True,id=dd958dd3-c95f-4f47-9361-d505727a4497,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd958dd3-c9')
Nov 02 01:53:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:53:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] No VIF found with MAC fa:16:3e:b9:67:bf, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:53:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 03114a20-c464-4ecd-850d-1a29a6ad2584 {{(pid=74996) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 01:53:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:20 user nova-compute[74996]: DEBUG nova.compute.manager [req-5702fc0f-f984-4542-8e12-6b3a52829b09 req-8ce3b04e-95ed-4ea6-a59a-7888d1c50cf4 service nova] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Received event network-vif-plugged-dd958dd3-c95f-4f47-9361-d505727a4497 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:53:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5702fc0f-f984-4542-8e12-6b3a52829b09 req-8ce3b04e-95ed-4ea6-a59a-7888d1c50cf4 service nova] Acquiring lock "7b264ec1-a5d7-40ef-833c-c68211a041d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:53:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5702fc0f-f984-4542-8e12-6b3a52829b09 req-8ce3b04e-95ed-4ea6-a59a-7888d1c50cf4 service nova] Lock "7b264ec1-a5d7-40ef-833c-c68211a041d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:53:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5702fc0f-f984-4542-8e12-6b3a52829b09 req-8ce3b04e-95ed-4ea6-a59a-7888d1c50cf4 service nova] Lock "7b264ec1-a5d7-40ef-833c-c68211a041d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:53:20 user nova-compute[74996]: DEBUG nova.compute.manager [req-5702fc0f-f984-4542-8e12-6b3a52829b09 req-8ce3b04e-95ed-4ea6-a59a-7888d1c50cf4 service nova] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] No waiting events found dispatching network-vif-plugged-dd958dd3-c95f-4f47-9361-d505727a4497 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:53:20 user nova-compute[74996]: WARNING nova.compute.manager [req-5702fc0f-f984-4542-8e12-6b3a52829b09 req-8ce3b04e-95ed-4ea6-a59a-7888d1c50cf4 service nova] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Received unexpected event network-vif-plugged-dd958dd3-c95f-4f47-9361-d505727a4497 for instance with vm_state building and task_state spawning.
Nov 02 01:53:22 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:53:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:53:22 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Instance spawned successfully.
Nov 02 01:53:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:53:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:53:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:53:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:53:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:53:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:53:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:53:22 user nova-compute[74996]: INFO nova.compute.manager [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 02 01:53:22 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:53:22 user nova-compute[74996]: INFO nova.compute.manager [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Took 30.52 seconds to build instance.
Nov 02 01:53:22 user nova-compute[74996]: DEBUG nova.compute.manager [req-28d9adb2-542b-4206-93f5-dd1b1a4de1f8 req-46989dd2-e6ca-4c2f-889f-1e239a1e774e service nova] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Received event network-vif-plugged-dd958dd3-c95f-4f47-9361-d505727a4497 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:53:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-28d9adb2-542b-4206-93f5-dd1b1a4de1f8 req-46989dd2-e6ca-4c2f-889f-1e239a1e774e service nova] Acquiring lock "7b264ec1-a5d7-40ef-833c-c68211a041d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:53:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-28d9adb2-542b-4206-93f5-dd1b1a4de1f8 req-46989dd2-e6ca-4c2f-889f-1e239a1e774e service nova] Lock "7b264ec1-a5d7-40ef-833c-c68211a041d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:53:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-28d9adb2-542b-4206-93f5-dd1b1a4de1f8 req-46989dd2-e6ca-4c2f-889f-1e239a1e774e service nova] Lock "7b264ec1-a5d7-40ef-833c-c68211a041d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:53:22 user nova-compute[74996]: DEBUG nova.compute.manager [req-28d9adb2-542b-4206-93f5-dd1b1a4de1f8 req-46989dd2-e6ca-4c2f-889f-1e239a1e774e service nova] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] No waiting events found dispatching network-vif-plugged-dd958dd3-c95f-4f47-9361-d505727a4497 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:53:22 user nova-compute[74996]: WARNING nova.compute.manager [req-28d9adb2-542b-4206-93f5-dd1b1a4de1f8 req-46989dd2-e6ca-4c2f-889f-1e239a1e774e service nova] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Received unexpected event network-vif-plugged-dd958dd3-c95f-4f47-9361-d505727a4497 for instance with vm_state active and task_state None.
Nov 02 01:53:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7c7a8ceb-548b-47df-becd-9e28f484cba2 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "7b264ec1-a5d7-40ef-833c-c68211a041d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.644s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:53:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:24 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:53:25 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:53:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:53:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:53:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:53:25 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:53:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk.rescue --force-share --output=json" returned: 0 in 0.262s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:53:28 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:53:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:28 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:53:28 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:53:28 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8250MB free_disk=25.039104461669922GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:53:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:53:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:53:28 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance e38704a7-f8a0-482c-bd51-26a90d37b71d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:53:28 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7c53e6cc-cf69-485d-b24f-5e113dae0e5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:53:28 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:53:28 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 03114a20-c464-4ecd-850d-1a29a6ad2584 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:53:28 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:53:28 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7b264ec1-a5d7-40ef-833c-c68211a041d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:53:28 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:53:28 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:53:28 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:53:28 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:53:28 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:53:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.476s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:53:30 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:53:30 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:53:30 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:53:30 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:53:31 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:53:31 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:53:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-7c53e6cc-cf69-485d-b24f-5e113dae0e5d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:53:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-7c53e6cc-cf69-485d-b24f-5e113dae0e5d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:53:31 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 01:53:31 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Updating instance_info_cache with network_info: [{"id": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "address": "fa:16:3e:9b:c8:b7", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391c1ab0-6a", "ovs_interfaceid": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:53:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-7c53e6cc-cf69-485d-b24f-5e113dae0e5d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:53:31 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 01:53:32 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:53:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:53:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:53:32 user nova-compute[74996]: DEBUG nova.objects.instance [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lazy-loading 'flavor' on Instance uuid 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:53:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:53:33 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:53:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:53:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:53:33 user nova-compute[74996]: INFO nova.compute.manager [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Attaching volume 73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 to /dev/vdb
Nov 02 01:53:33 user nova-compute[74996]: DEBUG os_brick.utils [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:53:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd070310-0744-4a28-b79a-04d66148dd6e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae54134-fca7-4bd8-a64c-d2f8d989b1e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e408c1-35f9-49f3-8c05-e1921462548a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1da676a-f9eb-43bb-a5e2-ada5cd791b3b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:53:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:53:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:53:33 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:53:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[588d8cda-288d-4c78-92c7-119fed50c1b3]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:53:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:53:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:53:33 user nova-compute[74996]: DEBUG os_brick.utils [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:53:33 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Updating existing volume attachment record: 2383c007-343b-49d9-914e-95cbd5cc64ab {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:53:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:35 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:53:37 user nova-compute[74996]: INFO nova.compute.manager [None req-d9afc8ff-56d7-4162-98e7-f603f301cd51 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Unrescuing
Nov 02 01:53:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d9afc8ff-56d7-4162-98e7-f603f301cd51 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "refresh_cache-e38704a7-f8a0-482c-bd51-26a90d37b71d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:53:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d9afc8ff-56d7-4162-98e7-f603f301cd51 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquired lock "refresh_cache-e38704a7-f8a0-482c-bd51-26a90d37b71d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:53:37 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d9afc8ff-56d7-4162-98e7-f603f301cd51 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d9afc8ff-56d7-4162-98e7-f603f301cd51 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Updating instance_info_cache with network_info: [{"id": "b5d6eb99-a00c-4440-98d6-6432b493f131", "address": "fa:16:3e:67:64:10", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d6eb99-a0", "ovs_interfaceid": "b5d6eb99-a00c-4440-98d6-6432b493f131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d9afc8ff-56d7-4162-98e7-f603f301cd51 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Releasing lock "refresh_cache-e38704a7-f8a0-482c-bd51-26a90d37b71d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG nova.objects.instance [None req-d9afc8ff-56d7-4162-98e7-f603f301cd51 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lazy-loading 'flavor' on Instance uuid e38704a7-f8a0-482c-bd51-26a90d37b71d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG nova.compute.manager [req-b7baad8c-70ae-4c7d-8097-85a90e5e5bfb req-d7b23628-f960-4105-b201-74b41d2e4109 service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received event network-vif-unplugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b7baad8c-70ae-4c7d-8097-85a90e5e5bfb req-d7b23628-f960-4105-b201-74b41d2e4109 service nova] Acquiring lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b7baad8c-70ae-4c7d-8097-85a90e5e5bfb req-d7b23628-f960-4105-b201-74b41d2e4109 service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b7baad8c-70ae-4c7d-8097-85a90e5e5bfb req-d7b23628-f960-4105-b201-74b41d2e4109 service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG nova.compute.manager [req-b7baad8c-70ae-4c7d-8097-85a90e5e5bfb req-d7b23628-f960-4105-b201-74b41d2e4109 service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] No waiting events found dispatching network-vif-unplugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:53:38 user nova-compute[74996]: WARNING nova.compute.manager [req-b7baad8c-70ae-4c7d-8097-85a90e5e5bfb req-d7b23628-f960-4105-b201-74b41d2e4109 service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received unexpected event network-vif-unplugged-b5d6eb99-a00c-4440-98d6-6432b493f131 for instance with vm_state rescued and task_state unrescuing.
Nov 02 01:53:38 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 03114a20-c464-4ecd-850d-1a29a6ad2584 is timed out.
Nov 02 01:53:38 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Successfully detached device vdc from instance 03114a20-c464-4ecd-850d-1a29a6ad2584 from the live domain config.
Nov 02 01:53:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xjRuimBY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:53:38 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:53:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e241e0dd-9c55-4edc-bd99-32e740d0db13]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:53:38 user nova-compute[74996]: No targets found.
Nov 02 01:53:38 user nova-compute[74996]: iSNS:
Nov 02 01:53:38 user nova-compute[74996]: No targets found.
Nov 02 01:53:38 user nova-compute[74996]: STATIC:
Nov 02 01:53:38 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae
Nov 02 01:53:38 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:53:38 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:53:38 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd
Nov 02 01:53:38 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:53:38 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:53:38 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c
Nov 02 01:53:38 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:53:38 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:53:38 user nova-compute[74996]: FIRMWARE:
Nov 02 01:53:38 user nova-compute[74996]: No targets found.
Nov 02 01:53:38 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:53:38 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:53:38 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec64ae3-3927-4a58-b3a7-cb754202c4bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc3035a-90e8-40af-b1de-fc04c846df3b]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:53:38 user nova-compute[74996]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd (non-flash)
Nov 02 01:53:38 user nova-compute[74996]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c (non-flash)
Nov 02 01:53:38 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:53:38 user nova-compute[74996]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd (non-flash)
Nov 02 01:53:38 user nova-compute[74996]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c (non-flash)
Nov 02 01:53:38 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e86ffb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd'): ({'sdc'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Removing single pathed devices sdc {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fb7478-67a0-4d03-9250-07aaa9b090fd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f986b394-d2d7-48d5-b7ae-09f2600249ff]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Flushing IO for device /dev/sdc {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ed85cc-c1ce-4c57-a240-faccb60fb5d8]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c307d316-816f-4e63-9078-ca8c36a66434]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9816203d-3be6-4565-8f3c-677437f7b1e9]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae091e6-f97a-4f83-84fd-f83d3a3a0253]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd, portal: 172.16.0.220,3260]
Nov 02 01:53:38 user nova-compute[74996]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd, portal: 172.16.0.220,3260] successful.
Nov 02 01:53:38 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0db817d-7604-4424-9c26-ab9af78869bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a546030-3335-4c6f-b270-93c03791dfb5]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] <== disconnect_volume: return (331ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:53:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:53:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:39 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Instance destroyed successfully.
Nov 02 01:53:39 user nova-compute[74996]: DEBUG nova.objects.instance [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lazy-loading 'flavor' on Instance uuid 03114a20-c464-4ecd-850d-1a29a6ad2584 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:53:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-bbc1e850-3fc7-404a-a70c-7f9737e12c21 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "03114a20-c464-4ecd-850d-1a29a6ad2584" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.147s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:53:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:40 user nova-compute[74996]: DEBUG nova.compute.manager [req-af8b25f5-b5bf-45c1-81d8-2e62b27b0200 req-a4a562fe-b6cd-4a40-880e-81c0f7213b79 service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received event network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:53:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-af8b25f5-b5bf-45c1-81d8-2e62b27b0200 req-a4a562fe-b6cd-4a40-880e-81c0f7213b79 service nova] Acquiring lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:53:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-af8b25f5-b5bf-45c1-81d8-2e62b27b0200 req-a4a562fe-b6cd-4a40-880e-81c0f7213b79 service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:53:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-af8b25f5-b5bf-45c1-81d8-2e62b27b0200 req-a4a562fe-b6cd-4a40-880e-81c0f7213b79 service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:53:40 user nova-compute[74996]: DEBUG nova.compute.manager [req-af8b25f5-b5bf-45c1-81d8-2e62b27b0200 req-a4a562fe-b6cd-4a40-880e-81c0f7213b79 service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] No waiting events found dispatching network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:53:40 user nova-compute[74996]: WARNING nova.compute.manager [req-af8b25f5-b5bf-45c1-81d8-2e62b27b0200 req-a4a562fe-b6cd-4a40-880e-81c0f7213b79 service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received unexpected event network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 for instance with vm_state rescued and task_state unrescuing.
Nov 02 01:53:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:42 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d9afc8ff-56d7-4162-98e7-f603f301cd51 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:53:42 user nova-compute[74996]: DEBUG nova.compute.manager [req-5c604484-d874-418f-a26c-5f1726ba1ec9 req-441c9175-533d-4e48-b4a1-0d46c80bb145 service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received event network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:53:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5c604484-d874-418f-a26c-5f1726ba1ec9 req-441c9175-533d-4e48-b4a1-0d46c80bb145 service nova] Acquiring lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:53:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5c604484-d874-418f-a26c-5f1726ba1ec9 req-441c9175-533d-4e48-b4a1-0d46c80bb145 service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:53:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5c604484-d874-418f-a26c-5f1726ba1ec9 req-441c9175-533d-4e48-b4a1-0d46c80bb145 service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:53:42 user nova-compute[74996]: DEBUG nova.compute.manager [req-5c604484-d874-418f-a26c-5f1726ba1ec9 req-441c9175-533d-4e48-b4a1-0d46c80bb145 service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] No waiting events found dispatching network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:53:42 user nova-compute[74996]: WARNING nova.compute.manager [req-5c604484-d874-418f-a26c-5f1726ba1ec9 req-441c9175-533d-4e48-b4a1-0d46c80bb145 service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received unexpected event network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 for instance with vm_state rescued and task_state unrescuing.
Nov 02 01:53:42 user nova-compute[74996]: DEBUG nova.compute.manager [req-5c604484-d874-418f-a26c-5f1726ba1ec9 req-441c9175-533d-4e48-b4a1-0d46c80bb145 service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received event network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:53:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5c604484-d874-418f-a26c-5f1726ba1ec9 req-441c9175-533d-4e48-b4a1-0d46c80bb145 service nova] Acquiring lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:53:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5c604484-d874-418f-a26c-5f1726ba1ec9 req-441c9175-533d-4e48-b4a1-0d46c80bb145 service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:53:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5c604484-d874-418f-a26c-5f1726ba1ec9 req-441c9175-533d-4e48-b4a1-0d46c80bb145 service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:53:42 user nova-compute[74996]: DEBUG nova.compute.manager [req-5c604484-d874-418f-a26c-5f1726ba1ec9 req-441c9175-533d-4e48-b4a1-0d46c80bb145 service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] No waiting events found dispatching network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:53:42 user nova-compute[74996]: WARNING nova.compute.manager [req-5c604484-d874-418f-a26c-5f1726ba1ec9 req-441c9175-533d-4e48-b4a1-0d46c80bb145 service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received unexpected event network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 for instance with vm_state rescued and task_state unrescuing.
Nov 02 01:53:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:46 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:53:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANIRezLT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:53:53 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:53:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:53:53 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:53:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:53:53 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4092daef-3359-4f51-8bbb-ab832b10cab3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:53:53 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf9fce0-e0e0-4dd7-aa36-d88037f37b28]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4] added
Nov 02 01:53:53 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[029b802c-1055-4cf1-98c9-92a61ef34431]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd93aba5-1e9f-4684-b60d-1f12ebae5101]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ANIRezLT {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ANIRezLT" returned: 0 in 0.029s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f0a01a-b6fa-4e5a-a78c-6d3928a843f4]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ANIRezLT'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[879b3ab6-a790-4c66-b991-23796a98b8ea]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7415b9-dd88-4a23-826d-a7126ed15ceb]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:53:53 user nova-compute[74996]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c (non-flash)
Nov 02 01:53:53 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:53:53 user nova-compute[74996]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c (non-flash)
Nov 02 01:53:53 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b2438f-544c-4f4e-be1b-9be063faf379]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4, portal: 172.16.0.220,3260]
Nov 02 01:53:53 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4, portal: 172.16.0.220,3260] successful.
Nov 02 01:53:53 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ccb69c-1a7b-4188-9b51-51f02f25df4c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3af602-70b2-4144-b2e9-b2e9fd376e84]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:53:53 user nova-compute[74996]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c (non-flash)
Nov 02 01:53:53 user nova-compute[74996]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 (non-flash)
Nov 02 01:53:53 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:53:53 user nova-compute[74996]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c (non-flash)
Nov 02 01:53:53 user nova-compute[74996]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 (non-flash)
Nov 02 01:53:53 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f628fd20-8219-453a-9208-07b0d6542e34]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:53:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANIRezLT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:53:54 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:53:54 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23836373063366463', 'path': '/dev/sdc'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:53:54 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836373063366463', 'path': '/dev/sdc'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:53:54 user nova-compute[74996]: DEBUG nova.objects.instance [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lazy-loading 'flavor' on Instance uuid 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:53:54 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 01:53:54 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:53:54 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 01:53:54 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:53:54 user nova-compute[74996]:   <serial>73e6dc34-c59d-4469-b2c4-0ba29df6b6c4</serial>
Nov 02 01:53:54 user nova-compute[74996]: </disk>
Nov 02 01:53:54 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 01:53:54 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:53:54 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:53:54 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] No VIF found with MAC fa:16:3e:9f:76:66, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:53:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-47bd351c-3115-489c-84d4-7b79fcf1a2ab tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.895s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:53:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:53:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-12aea0e3-5512-4aee-839d-246466732ea1 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "03114a20-c464-4ecd-850d-1a29a6ad2584" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:54:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-12aea0e3-5512-4aee-839d-246466732ea1 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "03114a20-c464-4ecd-850d-1a29a6ad2584" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:54:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-12aea0e3-5512-4aee-839d-246466732ea1 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "03114a20-c464-4ecd-850d-1a29a6ad2584-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:54:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-12aea0e3-5512-4aee-839d-246466732ea1 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "03114a20-c464-4ecd-850d-1a29a6ad2584-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:54:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-12aea0e3-5512-4aee-839d-246466732ea1 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "03114a20-c464-4ecd-850d-1a29a6ad2584-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:54:08 user nova-compute[74996]: INFO nova.compute.manager [None req-12aea0e3-5512-4aee-839d-246466732ea1 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Terminating instance
Nov 02 01:54:08 user nova-compute[74996]: DEBUG nova.compute.manager [None req-12aea0e3-5512-4aee-839d-246466732ea1 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:54:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:08 user nova-compute[74996]: DEBUG nova.compute.manager [req-a12fae57-5558-4788-8234-92c84caae5c5 req-31933ad0-9821-4d87-bbc3-71787d965571 service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Received event network-vif-unplugged-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:54:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a12fae57-5558-4788-8234-92c84caae5c5 req-31933ad0-9821-4d87-bbc3-71787d965571 service nova] Acquiring lock "03114a20-c464-4ecd-850d-1a29a6ad2584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:54:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a12fae57-5558-4788-8234-92c84caae5c5 req-31933ad0-9821-4d87-bbc3-71787d965571 service nova] Lock "03114a20-c464-4ecd-850d-1a29a6ad2584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:54:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a12fae57-5558-4788-8234-92c84caae5c5 req-31933ad0-9821-4d87-bbc3-71787d965571 service nova] Lock "03114a20-c464-4ecd-850d-1a29a6ad2584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:54:08 user nova-compute[74996]: DEBUG nova.compute.manager [req-a12fae57-5558-4788-8234-92c84caae5c5 req-31933ad0-9821-4d87-bbc3-71787d965571 service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] No waiting events found dispatching network-vif-unplugged-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:54:08 user nova-compute[74996]: DEBUG nova.compute.manager [req-a12fae57-5558-4788-8234-92c84caae5c5 req-31933ad0-9821-4d87-bbc3-71787d965571 service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Received event network-vif-unplugged-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:54:09 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Instance destroyed successfully.
Nov 02 01:54:09 user nova-compute[74996]: DEBUG nova.objects.instance [None req-12aea0e3-5512-4aee-839d-246466732ea1 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lazy-loading 'resources' on Instance uuid 03114a20-c464-4ecd-850d-1a29a6ad2584 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:54:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-12aea0e3-5512-4aee-839d-246466732ea1 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T01:47:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-324177429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-324177429',id=34,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGC1ZrO4IZqmeKhScK4Khe/R5fSlhAKeS9WeDuGPVzat9NavqbS4CamBVGSNIH1o7iITOcF+YORdUJpDvHOGjwbrgj1KSxyrnSI6g4MKfqy2Az/ytQiVKtTv0qzQxyiASA==',key_name='tempest-keypair-1560575805',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:52:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='22b862880e0c43ab8f5a4d65f6697955',ramdisk_id='',reservation_id='r-e7r370s7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-701748724',owner_user_name='tempest-AttachVolumeShelveTestJSON-701748724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:52:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01fc2ea044794374b09741ecaf841ba2',uuid=03114a20-c464-4ecd-850d-1a29a6ad2584,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "address": "fa:16:3e:a8:7a:d9", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aafb9f8-9e", "ovs_interfaceid": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:54:09 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-12aea0e3-5512-4aee-839d-246466732ea1 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Converting VIF {"id": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "address": "fa:16:3e:a8:7a:d9", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aafb9f8-9e", "ovs_interfaceid": "0aafb9f8-9eec-4e51-a955-fd1aeb4c5246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:54:09 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-12aea0e3-5512-4aee-839d-246466732ea1 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:7a:d9,bridge_name='br-int',has_traffic_filtering=True,id=0aafb9f8-9eec-4e51-a955-fd1aeb4c5246,network=Network(936a0e26-8a02-4c7c-9d24-acbb2f438cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aafb9f8-9e') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:54:09 user nova-compute[74996]: DEBUG os_vif [None req-12aea0e3-5512-4aee-839d-246466732ea1 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:7a:d9,bridge_name='br-int',has_traffic_filtering=True,id=0aafb9f8-9eec-4e51-a955-fd1aeb4c5246,network=Network(936a0e26-8a02-4c7c-9d24-acbb2f438cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aafb9f8-9e') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:54:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0aafb9f8-9e, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:54:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:54:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a624f984-8fe3-4eb5-a9af-a56f87b1d61a) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:54:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:09 user nova-compute[74996]: INFO os_vif [None req-12aea0e3-5512-4aee-839d-246466732ea1 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:7a:d9,bridge_name='br-int',has_traffic_filtering=True,id=0aafb9f8-9eec-4e51-a955-fd1aeb4c5246,network=Network(936a0e26-8a02-4c7c-9d24-acbb2f438cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aafb9f8-9e')
Nov 02 01:54:09 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-12aea0e3-5512-4aee-839d-246466732ea1 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Deleting instance files /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584_del
Nov 02 01:54:09 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-12aea0e3-5512-4aee-839d-246466732ea1 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Deletion of /opt/stack/data/nova/instances/03114a20-c464-4ecd-850d-1a29a6ad2584_del complete
Nov 02 01:54:09 user nova-compute[74996]: INFO nova.compute.manager [None req-12aea0e3-5512-4aee-839d-246466732ea1 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 02 01:54:09 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-12aea0e3-5512-4aee-839d-246466732ea1 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:54:09 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:54:09 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:54:10 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:54:10 user nova-compute[74996]: DEBUG nova.compute.manager [req-d5b8689a-a007-447b-85be-89f228e09da8 req-ef2eeb8c-0dff-4f02-98fe-0f0c9110a368 service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Received event network-vif-deleted-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:54:10 user nova-compute[74996]: INFO nova.compute.manager [req-d5b8689a-a007-447b-85be-89f228e09da8 req-ef2eeb8c-0dff-4f02-98fe-0f0c9110a368 service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Neutron deleted interface 0aafb9f8-9eec-4e51-a955-fd1aeb4c5246; detaching it from the instance and deleting it from the info cache
Nov 02 01:54:10 user nova-compute[74996]: DEBUG nova.network.neutron [req-d5b8689a-a007-447b-85be-89f228e09da8 req-ef2eeb8c-0dff-4f02-98fe-0f0c9110a368 service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:54:10 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Took 1.09 seconds to deallocate network for instance.
Nov 02 01:54:10 user nova-compute[74996]: DEBUG nova.compute.manager [req-d5b8689a-a007-447b-85be-89f228e09da8 req-ef2eeb8c-0dff-4f02-98fe-0f0c9110a368 service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Detach interface failed, port_id=0aafb9f8-9eec-4e51-a955-fd1aeb4c5246, reason: Instance 03114a20-c464-4ecd-850d-1a29a6ad2584 could not be found. {{(pid=74996) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 01:54:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-12aea0e3-5512-4aee-839d-246466732ea1 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:54:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-12aea0e3-5512-4aee-839d-246466732ea1 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:54:10 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-12aea0e3-5512-4aee-839d-246466732ea1 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:54:10 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-12aea0e3-5512-4aee-839d-246466732ea1 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:54:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-12aea0e3-5512-4aee-839d-246466732ea1 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.228s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:54:10 user nova-compute[74996]: DEBUG nova.compute.manager [req-4738023f-50db-4a4d-b372-4cf79f6c4c8d req-be5deb32-83f1-49ab-9a1b-64f57e291e1d service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Received event network-vif-plugged-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:54:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4738023f-50db-4a4d-b372-4cf79f6c4c8d req-be5deb32-83f1-49ab-9a1b-64f57e291e1d service nova] Acquiring lock "03114a20-c464-4ecd-850d-1a29a6ad2584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:54:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4738023f-50db-4a4d-b372-4cf79f6c4c8d req-be5deb32-83f1-49ab-9a1b-64f57e291e1d service nova] Lock "03114a20-c464-4ecd-850d-1a29a6ad2584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:54:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4738023f-50db-4a4d-b372-4cf79f6c4c8d req-be5deb32-83f1-49ab-9a1b-64f57e291e1d service nova] Lock "03114a20-c464-4ecd-850d-1a29a6ad2584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:54:10 user nova-compute[74996]: DEBUG nova.compute.manager [req-4738023f-50db-4a4d-b372-4cf79f6c4c8d req-be5deb32-83f1-49ab-9a1b-64f57e291e1d service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] No waiting events found dispatching network-vif-plugged-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:54:10 user nova-compute[74996]: WARNING nova.compute.manager [req-4738023f-50db-4a4d-b372-4cf79f6c4c8d req-be5deb32-83f1-49ab-9a1b-64f57e291e1d service nova] [instance: 03114a20-c464-4ecd-850d-1a29a6ad2584] Received unexpected event network-vif-plugged-0aafb9f8-9eec-4e51-a955-fd1aeb4c5246 for instance with vm_state deleted and task_state None.
Nov 02 01:54:10 user nova-compute[74996]: DEBUG nova.compute.manager [req-4738023f-50db-4a4d-b372-4cf79f6c4c8d req-be5deb32-83f1-49ab-9a1b-64f57e291e1d service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Received event network-changed-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:54:10 user nova-compute[74996]: DEBUG nova.compute.manager [req-4738023f-50db-4a4d-b372-4cf79f6c4c8d req-be5deb32-83f1-49ab-9a1b-64f57e291e1d service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Refreshing instance network info cache due to event network-changed-016a6c69-a1ff-45f9-bc61-6b886fbeaea9. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:54:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4738023f-50db-4a4d-b372-4cf79f6c4c8d req-be5deb32-83f1-49ab-9a1b-64f57e291e1d service nova] Acquiring lock "refresh_cache-26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:54:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4738023f-50db-4a4d-b372-4cf79f6c4c8d req-be5deb32-83f1-49ab-9a1b-64f57e291e1d service nova] Acquired lock "refresh_cache-26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:54:10 user nova-compute[74996]: DEBUG nova.network.neutron [req-4738023f-50db-4a4d-b372-4cf79f6c4c8d req-be5deb32-83f1-49ab-9a1b-64f57e291e1d service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Refreshing network info cache for port 016a6c69-a1ff-45f9-bc61-6b886fbeaea9 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:54:10 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-12aea0e3-5512-4aee-839d-246466732ea1 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Deleted allocations for instance 03114a20-c464-4ecd-850d-1a29a6ad2584
Nov 02 01:54:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-12aea0e3-5512-4aee-839d-246466732ea1 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "03114a20-c464-4ecd-850d-1a29a6ad2584" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.535s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:54:11 user nova-compute[74996]: DEBUG nova.network.neutron [req-4738023f-50db-4a4d-b372-4cf79f6c4c8d req-be5deb32-83f1-49ab-9a1b-64f57e291e1d service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Updated VIF entry in instance network info cache for port 016a6c69-a1ff-45f9-bc61-6b886fbeaea9. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:54:11 user nova-compute[74996]: DEBUG nova.network.neutron [req-4738023f-50db-4a4d-b372-4cf79f6c4c8d req-be5deb32-83f1-49ab-9a1b-64f57e291e1d service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Updating instance_info_cache with network_info: [{"id": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "address": "fa:16:3e:9f:76:66", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016a6c69-a1", "ovs_interfaceid": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:54:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4738023f-50db-4a4d-b372-4cf79f6c4c8d req-be5deb32-83f1-49ab-9a1b-64f57e291e1d service nova] Releasing lock "refresh_cache-26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:54:12 user nova-compute[74996]: DEBUG nova.compute.manager [req-0a36f9f6-a4f8-43b5-8d39-2754b6acc307 req-c520a1ea-505b-474b-8afc-e0a53c639157 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Received event network-changed-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:54:12 user nova-compute[74996]: DEBUG nova.compute.manager [req-0a36f9f6-a4f8-43b5-8d39-2754b6acc307 req-c520a1ea-505b-474b-8afc-e0a53c639157 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Refreshing instance network info cache due to event network-changed-016a6c69-a1ff-45f9-bc61-6b886fbeaea9. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:54:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0a36f9f6-a4f8-43b5-8d39-2754b6acc307 req-c520a1ea-505b-474b-8afc-e0a53c639157 service nova] Acquiring lock "refresh_cache-26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:54:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0a36f9f6-a4f8-43b5-8d39-2754b6acc307 req-c520a1ea-505b-474b-8afc-e0a53c639157 service nova] Acquired lock "refresh_cache-26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:54:12 user nova-compute[74996]: DEBUG nova.network.neutron [req-0a36f9f6-a4f8-43b5-8d39-2754b6acc307 req-c520a1ea-505b-474b-8afc-e0a53c639157 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Refreshing network info cache for port 016a6c69-a1ff-45f9-bc61-6b886fbeaea9 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:54:13 user nova-compute[74996]: DEBUG nova.network.neutron [req-0a36f9f6-a4f8-43b5-8d39-2754b6acc307 req-c520a1ea-505b-474b-8afc-e0a53c639157 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Updated VIF entry in instance network info cache for port 016a6c69-a1ff-45f9-bc61-6b886fbeaea9. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:54:13 user nova-compute[74996]: DEBUG nova.network.neutron [req-0a36f9f6-a4f8-43b5-8d39-2754b6acc307 req-c520a1ea-505b-474b-8afc-e0a53c639157 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Updating instance_info_cache with network_info: [{"id": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "address": "fa:16:3e:9f:76:66", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016a6c69-a1", "ovs_interfaceid": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:54:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0a36f9f6-a4f8-43b5-8d39-2754b6acc307 req-c520a1ea-505b-474b-8afc-e0a53c639157 service nova] Releasing lock "refresh_cache-26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:54:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:54:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:54:24 user nova-compute[74996]: INFO nova.compute.manager [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Rebooting instance
Nov 02 01:54:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "refresh_cache-26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:54:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquired lock "refresh_cache-26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:54:24 user nova-compute[74996]: DEBUG nova.network.neutron [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:54:24 user nova-compute[74996]: DEBUG nova.network.neutron [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Updating instance_info_cache with network_info: [{"id": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "address": "fa:16:3e:9f:76:66", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016a6c69-a1", "ovs_interfaceid": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:54:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Releasing lock "refresh_cache-26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:54:24 user nova-compute[74996]: DEBUG nova.compute.manager [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG nova.compute.manager [req-676530d5-7089-438a-bb28-d6de7c1790f4 req-70fa871c-4810-4d0d-afbd-f8dceb56fe27 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Received event network-vif-unplugged-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-676530d5-7089-438a-bb28-d6de7c1790f4 req-70fa871c-4810-4d0d-afbd-f8dceb56fe27 service nova] Acquiring lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-676530d5-7089-438a-bb28-d6de7c1790f4 req-70fa871c-4810-4d0d-afbd-f8dceb56fe27 service nova] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-676530d5-7089-438a-bb28-d6de7c1790f4 req-70fa871c-4810-4d0d-afbd-f8dceb56fe27 service nova] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG nova.compute.manager [req-676530d5-7089-438a-bb28-d6de7c1790f4 req-70fa871c-4810-4d0d-afbd-f8dceb56fe27 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] No waiting events found dispatching network-vif-unplugged-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:54:25 user nova-compute[74996]: WARNING nova.compute.manager [req-676530d5-7089-438a-bb28-d6de7c1790f4 req-70fa871c-4810-4d0d-afbd-f8dceb56fe27 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Received unexpected event network-vif-unplugged-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 for instance with vm_state active and task_state reboot_started_hard.
Nov 02 01:54:25 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Instance destroyed successfully.
Nov 02 01:54:25 user nova-compute[74996]: DEBUG nova.objects.instance [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lazy-loading 'resources' on Instance uuid 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:51:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1075914983',display_name='tempest-TestMinimumBasicScenario-server-1075914983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1075914983',id=37,image_ref='ea004395-87cf-4a65-b2c3-d7209fe6de54',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMvrpfr8DB7QKESZzs371DYHVWv6Cr8QRChW6oecJXHRRCF4YAmNE7fPnrko7Qfal8r86tFHqOSMirgo7DE2B0Ycg1rGJucHkjJ/UjAecASQQZ+T2IhJlejkDf09HPCPQ==',key_name='tempest-TestMinimumBasicScenario-341687183',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:51:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be09717763f448b5a5d1a1e5f62e289b',ramdisk_id='',reservation_id='r-c22faqut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea004395-87cf-4a65-b2c3-d7209fe6de54',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1426618310',owner_user_name='tempest-TestMinimumBasicScenario-1426618310-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:54:25Z,user_data=None,user_id='e7d9a6e0ced84500aab9759d009f0a49',uuid=26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "address": "fa:16:3e:9f:76:66", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016a6c69-a1", "ovs_interfaceid": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Converting VIF {"id": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "address": "fa:16:3e:9f:76:66", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016a6c69-a1", "ovs_interfaceid": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:76:66,bridge_name='br-int',has_traffic_filtering=True,id=016a6c69-a1ff-45f9-bc61-6b886fbeaea9,network=Network(ab25d1c6-cd19-42dd-abe2-cb20978f06e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap016a6c69-a1') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG os_vif [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:76:66,bridge_name='br-int',has_traffic_filtering=True,id=016a6c69-a1ff-45f9-bc61-6b886fbeaea9,network=Network(ab25d1c6-cd19-42dd-abe2-cb20978f06e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap016a6c69-a1') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap016a6c69-a1, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de3db28b-b700-4b0e-a8c3-e874a4941eee) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:54:25 user nova-compute[74996]: INFO os_vif [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:76:66,bridge_name='br-int',has_traffic_filtering=True,id=016a6c69-a1ff-45f9-bc61-6b886fbeaea9,network=Network(ab25d1c6-cd19-42dd-abe2-cb20978f06e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap016a6c69-a1')
Nov 02 01:54:25 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANIRezLT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:54:25 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:54:25 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[828bcca7-a346-4f96-8b36-618cc237b31e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:54:25 user nova-compute[74996]: No targets found.
Nov 02 01:54:25 user nova-compute[74996]: iSNS:
Nov 02 01:54:25 user nova-compute[74996]: No targets found.
Nov 02 01:54:25 user nova-compute[74996]: STATIC:
Nov 02 01:54:25 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae
Nov 02 01:54:25 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:54:25 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:54:25 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c
Nov 02 01:54:25 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:54:25 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:54:25 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4
Nov 02 01:54:25 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:54:25 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:54:25 user nova-compute[74996]: FIRMWARE:
Nov 02 01:54:25 user nova-compute[74996]: No targets found.
Nov 02 01:54:25 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:54:25 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:54:25 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:54:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc2be35-e358-4b92-93d0-1b2aa6c76f29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eeeed56-5aad-4073-8348-1e2b9840bbb2]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:54:26 user nova-compute[74996]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c (non-flash)
Nov 02 01:54:26 user nova-compute[74996]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 (non-flash)
Nov 02 01:54:26 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:54:26 user nova-compute[74996]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c (non-flash)
Nov 02 01:54:26 user nova-compute[74996]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 (non-flash)
Nov 02 01:54:26 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830c61e200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4'): ({'sdc'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Removing single pathed devices sdc {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd61ac00-c471-4163-b5c1-30d7a48b74f4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a810fe47-c26e-45af-ad67-1d6886deab66]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Flushing IO for device /dev/sdc {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e11dfa-0bac-4419-90d6-70fc0df50e18]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27ada2d-ce0d-4620-bbe7-56ecb98ac785]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1649f795-abee-49aa-a6a8-b99fd3d158b7]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e08f3b-eece-4f07-8e83-f624ed5c7093]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4, portal: 172.16.0.220,3260]
Nov 02 01:54:26 user nova-compute[74996]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4, portal: 172.16.0.220,3260] successful.
Nov 02 01:54:26 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d0f201-3c68-4db2-a4ff-1b97cfff4956]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] <== disconnect_volume: return (306ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Start _get_guest_xml network_info=[{"id": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "address": "fa:16:3e:9f:76:66", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016a6c69-a1", "ovs_interfaceid": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ea004395-87cf-4a65-b2c3-d7209fe6de54,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'ea004395-87cf-4a65-b2c3-d7209fe6de54'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2383c007-343b-49d9-914e-95cbd5cc64ab', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANIRezLT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea', 'attached_at': '', 'detached_at': '', 'volume_id': '73e6dc34-c59d-4469-b2c4-0ba29df6b6c4', 'serial': '73e6dc34-c59d-4469-b2c4-0ba29df6b6c4'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:54:26 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:54:26 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:54:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ea004395-87cf-4a65-b2c3-d7209fe6de54,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG nova.objects.instance [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lazy-loading 'vcpu_model' on Instance uuid 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG nova.objects.base [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Object Instance<26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea> lazy-loaded attributes: resources,vcpu_model {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANIRezLT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:54:26 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:54:26 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:54:26 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3023ea7-ae71-4e99-8256-af7c52ecf0b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:54:26 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7181f8-e951-4be1-a9f4-327cde426c34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4] added
Nov 02 01:54:26 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd12e78-9e05-4eb5-80f4-d3040f3b8fa3]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfabb9a-ea17-4f98-914b-ebb6aa2e4179]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ANIRezLT {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ANIRezLT" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f309cc3-1424-4f5f-ac05-7a2e1ba18f4f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ANIRezLT'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad769d1e-ece8-43b0-b848-853a82967bac]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ff23ff-3663-4338-96cc-87a1f347d2c5]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:54:26 user nova-compute[74996]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c (non-flash)
Nov 02 01:54:26 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:54:26 user nova-compute[74996]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c (non-flash)
Nov 02 01:54:26 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad26a8b-5f7e-4e26-ba4a-07228ef68eb5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4, portal: 172.16.0.220,3260]
Nov 02 01:54:26 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4, portal: 172.16.0.220,3260] successful.
Nov 02 01:54:26 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ff1385-3d0f-464e-9eb0-9b7226588c4f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa34b5c-8eba-4ed6-9cc9-0e4c8f6243ef]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:54:26 user nova-compute[74996]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c (non-flash)
Nov 02 01:54:26 user nova-compute[74996]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 (non-flash)
Nov 02 01:54:26 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:54:26 user nova-compute[74996]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c (non-flash)
Nov 02 01:54:26 user nova-compute[74996]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 (non-flash)
Nov 02 01:54:26 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eaa9008-d1dc-496d-90d0-dda982b474cc]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: None {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:27 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Error from libvirt while getting description of instance-00000025: [Error Code 42] Domain not found: no domain with matching uuid '26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea' (instance-00000025): libvirt.libvirtError: Domain not found: no domain with matching uuid '26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea' (instance-00000025)
Nov 02 01:54:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:54:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:54:27 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:54:27 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANIRezLT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:54:27 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.507s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:54:27 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] <== connect_volume: return (1509ms) {'type': 'block', 'scsi_wwn': '23836373063366463', 'path': '/dev/sdc'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:54:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836373063366463', 'path': '/dev/sdc'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:54:27 user nova-compute[74996]: DEBUG nova.compute.manager [req-1e32af82-4852-44ff-930f-148182359b19 req-2f5f3213-5085-4a55-90c3-660a81f1a2c8 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Received event network-vif-plugged-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:54:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1e32af82-4852-44ff-930f-148182359b19 req-2f5f3213-5085-4a55-90c3-660a81f1a2c8 service nova] Acquiring lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:54:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1e32af82-4852-44ff-930f-148182359b19 req-2f5f3213-5085-4a55-90c3-660a81f1a2c8 service nova] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:54:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-1e32af82-4852-44ff-930f-148182359b19 req-2f5f3213-5085-4a55-90c3-660a81f1a2c8 service nova] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:54:27 user nova-compute[74996]: DEBUG nova.compute.manager [req-1e32af82-4852-44ff-930f-148182359b19 req-2f5f3213-5085-4a55-90c3-660a81f1a2c8 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] No waiting events found dispatching network-vif-plugged-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:54:27 user nova-compute[74996]: WARNING nova.compute.manager [req-1e32af82-4852-44ff-930f-148182359b19 req-2f5f3213-5085-4a55-90c3-660a81f1a2c8 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Received unexpected event network-vif-plugged-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 for instance with vm_state active and task_state reboot_started_hard.
Nov 02 01:54:27 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:54:27 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:54:27 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8380MB free_disk=25.063575744628906GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:54:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:54:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:54:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:51:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1075914983',display_name='tempest-TestMinimumBasicScenario-server-1075914983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1075914983',id=37,image_ref='ea004395-87cf-4a65-b2c3-d7209fe6de54',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMvrpfr8DB7QKESZzs371DYHVWv6Cr8QRChW6oecJXHRRCF4YAmNE7fPnrko7Qfal8r86tFHqOSMirgo7DE2B0Ycg1rGJucHkjJ/UjAecASQQZ+T2IhJlejkDf09HPCPQ==',key_name='tempest-TestMinimumBasicScenario-341687183',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:51:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be09717763f448b5a5d1a1e5f62e289b',ramdisk_id='',reservation_id='r-c22faqut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea004395-87cf-4a65-b2c3-d7209fe6de54',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1426618310',owner_user_name='tempest-TestMinimumBasicScenario-1426618310-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:54:25Z,user_data=None,user_id='e7d9a6e0ced84500aab9759d009f0a49',uuid=26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "address": "fa:16:3e:9f:76:66", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016a6c69-a1", "ovs_interfaceid": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:54:27 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Converting VIF {"id": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "address": "fa:16:3e:9f:76:66", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016a6c69-a1", "ovs_interfaceid": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:54:27 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:76:66,bridge_name='br-int',has_traffic_filtering=True,id=016a6c69-a1ff-45f9-bc61-6b886fbeaea9,network=Network(ab25d1c6-cd19-42dd-abe2-cb20978f06e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap016a6c69-a1') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:54:27 user nova-compute[74996]: DEBUG nova.objects.instance [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lazy-loading 'pci_devices' on Instance uuid 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:54:27 user nova-compute[74996]: DEBUG nova.objects.base [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Object Instance<26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:54:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:54:27 user nova-compute[74996]:   <uuid>26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea</uuid>
Nov 02 01:54:27 user nova-compute[74996]:   <name>instance-00000025</name>
Nov 02 01:54:27 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:54:27 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:54:27 user nova-compute[74996]:   <metadata>
Nov 02 01:54:27 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:54:27 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:54:27 user nova-compute[74996]:       <nova:name>tempest-TestMinimumBasicScenario-server-1075914983</nova:name>
Nov 02 01:54:27 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:54:26</nova:creationTime>
Nov 02 01:54:27 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:54:27 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:54:27 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:54:27 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:54:27 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:54:27 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:54:27 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:54:27 user nova-compute[74996]:       <nova:owner>
Nov 02 01:54:27 user nova-compute[74996]:         <nova:user uuid="e7d9a6e0ced84500aab9759d009f0a49">tempest-TestMinimumBasicScenario-1426618310-project-member</nova:user>
Nov 02 01:54:27 user nova-compute[74996]:         <nova:project uuid="be09717763f448b5a5d1a1e5f62e289b">tempest-TestMinimumBasicScenario-1426618310</nova:project>
Nov 02 01:54:27 user nova-compute[74996]:       </nova:owner>
Nov 02 01:54:27 user nova-compute[74996]:       <nova:root type="image" uuid="ea004395-87cf-4a65-b2c3-d7209fe6de54"/>
Nov 02 01:54:27 user nova-compute[74996]:       <nova:ports>
Nov 02 01:54:27 user nova-compute[74996]:         <nova:port uuid="016a6c69-a1ff-45f9-bc61-6b886fbeaea9">
Nov 02 01:54:27 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 01:54:27 user nova-compute[74996]:         </nova:port>
Nov 02 01:54:27 user nova-compute[74996]:       </nova:ports>
Nov 02 01:54:27 user nova-compute[74996]:     </nova:instance>
Nov 02 01:54:27 user nova-compute[74996]:   </metadata>
Nov 02 01:54:27 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:54:27 user nova-compute[74996]:     <system>
Nov 02 01:54:27 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:54:27 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:54:27 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:54:27 user nova-compute[74996]:       <entry name="serial">26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea</entry>
Nov 02 01:54:27 user nova-compute[74996]:       <entry name="uuid">26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea</entry>
Nov 02 01:54:27 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:54:27 user nova-compute[74996]:     </system>
Nov 02 01:54:27 user nova-compute[74996]:   </sysinfo>
Nov 02 01:54:27 user nova-compute[74996]:   <os>
Nov 02 01:54:27 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:54:27 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:54:27 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:54:27 user nova-compute[74996]:   </os>
Nov 02 01:54:27 user nova-compute[74996]:   <features>
Nov 02 01:54:27 user nova-compute[74996]:     <acpi/>
Nov 02 01:54:27 user nova-compute[74996]:     <apic/>
Nov 02 01:54:27 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:54:27 user nova-compute[74996]:   </features>
Nov 02 01:54:27 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:54:27 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:54:27 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:54:27 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:54:27 user nova-compute[74996]:   </clock>
Nov 02 01:54:27 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:54:27 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:54:27 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:54:27 user nova-compute[74996]:   </cpu>
Nov 02 01:54:27 user nova-compute[74996]:   <devices>
Nov 02 01:54:27 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:54:27 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:54:27 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk"/>
Nov 02 01:54:27 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:54:27 user nova-compute[74996]:     </disk>
Nov 02 01:54:27 user nova-compute[74996]:     <disk type="block" device="disk">
Nov 02 01:54:27 user nova-compute[74996]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:54:27 user nova-compute[74996]:       <source dev="/dev/sdc"/>
Nov 02 01:54:27 user nova-compute[74996]:       <target dev="vdb" bus="virtio"/>
Nov 02 01:54:27 user nova-compute[74996]:       <serial>73e6dc34-c59d-4469-b2c4-0ba29df6b6c4</serial>
Nov 02 01:54:27 user nova-compute[74996]:     </disk>
Nov 02 01:54:27 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:54:27 user nova-compute[74996]:       <mac address="fa:16:3e:9f:76:66"/>
Nov 02 01:54:27 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:54:27 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:54:27 user nova-compute[74996]:       <target dev="tap016a6c69-a1"/>
Nov 02 01:54:27 user nova-compute[74996]:     </interface>
Nov 02 01:54:27 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:54:27 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/console.log" append="off"/>
Nov 02 01:54:27 user nova-compute[74996]:     </serial>
Nov 02 01:54:27 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:54:27 user nova-compute[74996]:     <video>
Nov 02 01:54:27 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:54:27 user nova-compute[74996]:     </video>
Nov 02 01:54:27 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:54:27 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:54:27 user nova-compute[74996]:     </rng>
Nov 02 01:54:27 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:54:27 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:54:27 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:54:27 user nova-compute[74996]:     </memballoon>
Nov 02 01:54:27 user nova-compute[74996]:   </devices>
Nov 02 01:54:27 user nova-compute[74996]: </domain>
Nov 02 01:54:27 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:54:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance e38704a7-f8a0-482c-bd51-26a90d37b71d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7c53e6cc-cf69-485d-b24f-5e113dae0e5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7b264ec1-a5d7-40ef-833c-c68211a041d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.380s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG nova.objects.instance [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lazy-loading 'trusted_certs' on Instance uuid 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG nova.objects.base [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Object Instance<26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/133907414d1cd507ae1d146bf8ab715819c37cfc --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/133907414d1cd507ae1d146bf8ab715819c37cfc --force-share --output=json" returned: 0 in 0.175s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Checking if we can resize image /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Cannot resize image /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG nova.objects.instance [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lazy-loading 'migration_context' on Instance uuid 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG nova.objects.base [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Object Instance<26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:51:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1075914983',display_name='tempest-TestMinimumBasicScenario-server-1075914983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1075914983',id=37,image_ref='ea004395-87cf-4a65-b2c3-d7209fe6de54',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMvrpfr8DB7QKESZzs371DYHVWv6Cr8QRChW6oecJXHRRCF4YAmNE7fPnrko7Qfal8r86tFHqOSMirgo7DE2B0Ycg1rGJucHkjJ/UjAecASQQZ+T2IhJlejkDf09HPCPQ==',key_name='tempest-TestMinimumBasicScenario-341687183',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:51:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='be09717763f448b5a5d1a1e5f62e289b',ramdisk_id='',reservation_id='r-c22faqut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea004395-87cf-4a65-b2c3-d7209fe6de54',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1426618310',owner_user_name='tempest-TestMinimumBasicScenario-1426618310-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:54:25Z,user_data=None,user_id='e7d9a6e0ced84500aab9759d009f0a49',uuid=26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "address": "fa:16:3e:9f:76:66", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016a6c69-a1", "ovs_interfaceid": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Converting VIF {"id": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "address": "fa:16:3e:9f:76:66", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016a6c69-a1", "ovs_interfaceid": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:76:66,bridge_name='br-int',has_traffic_filtering=True,id=016a6c69-a1ff-45f9-bc61-6b886fbeaea9,network=Network(ab25d1c6-cd19-42dd-abe2-cb20978f06e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap016a6c69-a1') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG os_vif [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:76:66,bridge_name='br-int',has_traffic_filtering=True,id=016a6c69-a1ff-45f9-bc61-6b886fbeaea9,network=Network(ab25d1c6-cd19-42dd-abe2-cb20978f06e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap016a6c69-a1') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d7fcc09-7e5d-5a62-9b08-9d08f0708c62', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap016a6c69-a1, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap016a6c69-a1, col_values=(('qos', UUID('7dea93fc-206b-42cf-907a-b99b96929fcc')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap016a6c69-a1, col_values=(('external_ids', {'iface-id': '016a6c69-a1ff-45f9-bc61-6b886fbeaea9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:76:66', 'vm-uuid': '26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:54:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:28 user nova-compute[74996]: INFO os_vif [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:76:66,bridge_name='br-int',has_traffic_filtering=True,id=016a6c69-a1ff-45f9-bc61-6b886fbeaea9,network=Network(ab25d1c6-cd19-42dd-abe2-cb20978f06e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap016a6c69-a1')
Nov 02 01:54:29 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:54:29 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:54:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:30 user nova-compute[74996]: DEBUG nova.compute.manager [req-25942616-cb68-43d2-896a-125cc5386ba3 req-8881b387-632b-40e3-8679-73bb93aacdb4 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Received event network-vif-plugged-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:54:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-25942616-cb68-43d2-896a-125cc5386ba3 req-8881b387-632b-40e3-8679-73bb93aacdb4 service nova] Acquiring lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:54:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-25942616-cb68-43d2-896a-125cc5386ba3 req-8881b387-632b-40e3-8679-73bb93aacdb4 service nova] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:54:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-25942616-cb68-43d2-896a-125cc5386ba3 req-8881b387-632b-40e3-8679-73bb93aacdb4 service nova] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:54:30 user nova-compute[74996]: DEBUG nova.compute.manager [req-25942616-cb68-43d2-896a-125cc5386ba3 req-8881b387-632b-40e3-8679-73bb93aacdb4 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] No waiting events found dispatching network-vif-plugged-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:54:30 user nova-compute[74996]: WARNING nova.compute.manager [req-25942616-cb68-43d2-896a-125cc5386ba3 req-8881b387-632b-40e3-8679-73bb93aacdb4 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Received unexpected event network-vif-plugged-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 for instance with vm_state active and task_state reboot_started_hard.
Nov 02 01:54:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:32 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:54:32 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:54:32 user nova-compute[74996]: DEBUG nova.compute.manager [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:54:32 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Instance rebooted successfully.
Nov 02 01:54:32 user nova-compute[74996]: DEBUG nova.compute.manager [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:54:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5b8f16bc-317a-4350-855f-7cf6704ef11b tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.210s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:54:32 user nova-compute[74996]: DEBUG nova.compute.manager [req-3c948b13-5e4e-48ef-ae10-9fa24625ad4a req-b31c65e7-eff7-44db-b1e1-2d5c85b7132b service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Received event network-vif-plugged-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:54:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3c948b13-5e4e-48ef-ae10-9fa24625ad4a req-b31c65e7-eff7-44db-b1e1-2d5c85b7132b service nova] Acquiring lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:54:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3c948b13-5e4e-48ef-ae10-9fa24625ad4a req-b31c65e7-eff7-44db-b1e1-2d5c85b7132b service nova] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:54:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3c948b13-5e4e-48ef-ae10-9fa24625ad4a req-b31c65e7-eff7-44db-b1e1-2d5c85b7132b service nova] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:54:32 user nova-compute[74996]: DEBUG nova.compute.manager [req-3c948b13-5e4e-48ef-ae10-9fa24625ad4a req-b31c65e7-eff7-44db-b1e1-2d5c85b7132b service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] No waiting events found dispatching network-vif-plugged-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:54:32 user nova-compute[74996]: WARNING nova.compute.manager [req-3c948b13-5e4e-48ef-ae10-9fa24625ad4a req-b31c65e7-eff7-44db-b1e1-2d5c85b7132b service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Received unexpected event network-vif-plugged-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 for instance with vm_state active and task_state None.
Nov 02 01:54:33 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:54:33 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:54:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-3f80eb60-ba0b-4a4c-8b41-17130ddf51fa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:54:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-3f80eb60-ba0b-4a4c-8b41-17130ddf51fa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:54:33 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 01:54:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:33 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Updating instance_info_cache with network_info: [{"id": "3d50920e-49be-4b14-9019-60a286e9f068", "address": "fa:16:3e:ba:b0:00", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d50920e-49", "ovs_interfaceid": "3d50920e-49be-4b14-9019-60a286e9f068", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:54:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-3f80eb60-ba0b-4a4c-8b41-17130ddf51fa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:54:33 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 01:54:33 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:54:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:34 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:54:36 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:54:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:54:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 01:54:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:54:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:54:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-bba62a86-37be-4078-a177-0a0b64ae0d2e req-cf562130-66df-4e2d-842f-6690e7372fc4 service nova] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Received event network-changed-dd958dd3-c95f-4f47-9361-d505727a4497 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:54:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-bba62a86-37be-4078-a177-0a0b64ae0d2e req-cf562130-66df-4e2d-842f-6690e7372fc4 service nova] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Refreshing instance network info cache due to event network-changed-dd958dd3-c95f-4f47-9361-d505727a4497. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:54:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-bba62a86-37be-4078-a177-0a0b64ae0d2e req-cf562130-66df-4e2d-842f-6690e7372fc4 service nova] Acquiring lock "refresh_cache-7b264ec1-a5d7-40ef-833c-c68211a041d1" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:54:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-bba62a86-37be-4078-a177-0a0b64ae0d2e req-cf562130-66df-4e2d-842f-6690e7372fc4 service nova] Acquired lock "refresh_cache-7b264ec1-a5d7-40ef-833c-c68211a041d1" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:54:43 user nova-compute[74996]: DEBUG nova.network.neutron [req-bba62a86-37be-4078-a177-0a0b64ae0d2e req-cf562130-66df-4e2d-842f-6690e7372fc4 service nova] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Refreshing network info cache for port dd958dd3-c95f-4f47-9361-d505727a4497 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:54:44 user nova-compute[74996]: DEBUG nova.network.neutron [req-bba62a86-37be-4078-a177-0a0b64ae0d2e req-cf562130-66df-4e2d-842f-6690e7372fc4 service nova] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Updated VIF entry in instance network info cache for port dd958dd3-c95f-4f47-9361-d505727a4497. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:54:44 user nova-compute[74996]: DEBUG nova.network.neutron [req-bba62a86-37be-4078-a177-0a0b64ae0d2e req-cf562130-66df-4e2d-842f-6690e7372fc4 service nova] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Updating instance_info_cache with network_info: [{"id": "dd958dd3-c95f-4f47-9361-d505727a4497", "address": "fa:16:3e:b9:67:bf", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd958dd3-c9", "ovs_interfaceid": "dd958dd3-c95f-4f47-9361-d505727a4497", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:54:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-bba62a86-37be-4078-a177-0a0b64ae0d2e req-cf562130-66df-4e2d-842f-6690e7372fc4 service nova] Releasing lock "refresh_cache-7b264ec1-a5d7-40ef-833c-c68211a041d1" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:54:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "7b264ec1-a5d7-40ef-833c-c68211a041d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:54:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "7b264ec1-a5d7-40ef-833c-c68211a041d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:54:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "7b264ec1-a5d7-40ef-833c-c68211a041d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:54:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "7b264ec1-a5d7-40ef-833c-c68211a041d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:54:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "7b264ec1-a5d7-40ef-833c-c68211a041d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:54:45 user nova-compute[74996]: INFO nova.compute.manager [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Terminating instance
Nov 02 01:54:45 user nova-compute[74996]: DEBUG nova.compute.manager [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG nova.compute.manager [req-d10f17e9-6eed-4dcc-b061-0547269e4d36 req-21ca0695-b576-4da3-bb70-1b494ee43edf service nova] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Received event network-changed-dd958dd3-c95f-4f47-9361-d505727a4497 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG nova.compute.manager [req-d10f17e9-6eed-4dcc-b061-0547269e4d36 req-21ca0695-b576-4da3-bb70-1b494ee43edf service nova] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Refreshing instance network info cache due to event network-changed-dd958dd3-c95f-4f47-9361-d505727a4497. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d10f17e9-6eed-4dcc-b061-0547269e4d36 req-21ca0695-b576-4da3-bb70-1b494ee43edf service nova] Acquiring lock "refresh_cache-7b264ec1-a5d7-40ef-833c-c68211a041d1" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d10f17e9-6eed-4dcc-b061-0547269e4d36 req-21ca0695-b576-4da3-bb70-1b494ee43edf service nova] Acquired lock "refresh_cache-7b264ec1-a5d7-40ef-833c-c68211a041d1" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG nova.network.neutron [req-d10f17e9-6eed-4dcc-b061-0547269e4d36 req-21ca0695-b576-4da3-bb70-1b494ee43edf service nova] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Refreshing network info cache for port dd958dd3-c95f-4f47-9361-d505727a4497 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG nova.network.neutron [req-d10f17e9-6eed-4dcc-b061-0547269e4d36 req-21ca0695-b576-4da3-bb70-1b494ee43edf service nova] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Updated VIF entry in instance network info cache for port dd958dd3-c95f-4f47-9361-d505727a4497. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG nova.network.neutron [req-d10f17e9-6eed-4dcc-b061-0547269e4d36 req-21ca0695-b576-4da3-bb70-1b494ee43edf service nova] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Updating instance_info_cache with network_info: [{"id": "dd958dd3-c95f-4f47-9361-d505727a4497", "address": "fa:16:3e:b9:67:bf", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd958dd3-c9", "ovs_interfaceid": "dd958dd3-c95f-4f47-9361-d505727a4497", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d10f17e9-6eed-4dcc-b061-0547269e4d36 req-21ca0695-b576-4da3-bb70-1b494ee43edf service nova] Releasing lock "refresh_cache-7b264ec1-a5d7-40ef-833c-c68211a041d1" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:54:46 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Instance destroyed successfully.
Nov 02 01:54:46 user nova-compute[74996]: DEBUG nova.objects.instance [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lazy-loading 'resources' on Instance uuid 7b264ec1-a5d7-40ef-833c-c68211a041d1 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:52:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1289502398',display_name='tempest-TestVolumeBootPattern-server-1289502398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1289502398',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqKsx295qdP4lg7887w79wguzwBudaKLS1CaKDMdZBRiyydUejeP/bphRv12kudSVdoUpRoo+kfCoJgBSoxWJoJnZVJJAUy53PGnOOqIVwETBw7ua4uyU/hdtrnp6uX6w==',key_name='tempest-TestVolumeBootPattern-1607904644',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:53:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31965b482eb243a69112a49bf1302779',ramdisk_id='',reservation_id='r-r60bpgjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-216720976',owner_user_name='tempest-TestVolumeBootPattern-216720976-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:53:22Z,user_data=None,user_id='be6bf504c3a649898e8c83399f6fee8e',uuid=7b264ec1-a5d7-40ef-833c-c68211a041d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd958dd3-c95f-4f47-9361-d505727a4497", "address": "fa:16:3e:b9:67:bf", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd958dd3-c9", "ovs_interfaceid": "dd958dd3-c95f-4f47-9361-d505727a4497", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converting VIF {"id": "dd958dd3-c95f-4f47-9361-d505727a4497", "address": "fa:16:3e:b9:67:bf", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd958dd3-c9", "ovs_interfaceid": "dd958dd3-c95f-4f47-9361-d505727a4497", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:67:bf,bridge_name='br-int',has_traffic_filtering=True,id=dd958dd3-c95f-4f47-9361-d505727a4497,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd958dd3-c9') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG os_vif [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:67:bf,bridge_name='br-int',has_traffic_filtering=True,id=dd958dd3-c95f-4f47-9361-d505727a4497,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd958dd3-c9') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd958dd3-c9, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2dc5c01c-3827-40bc-a12e-40739099c2d9) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:54:46 user nova-compute[74996]: INFO os_vif [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:67:bf,bridge_name='br-int',has_traffic_filtering=True,id=dd958dd3-c95f-4f47-9361-d505727a4497,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd958dd3-c9')
Nov 02 01:54:46 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMkoHixF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:54:46 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:54:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[74df5619-2db9-4764-8e49-77080399848d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:54:46 user nova-compute[74996]: No targets found.
Nov 02 01:54:46 user nova-compute[74996]: iSNS:
Nov 02 01:54:46 user nova-compute[74996]: No targets found.
Nov 02 01:54:46 user nova-compute[74996]: STATIC:
Nov 02 01:54:46 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae
Nov 02 01:54:46 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:54:46 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:54:46 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c
Nov 02 01:54:46 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:54:46 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:54:46 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4
Nov 02 01:54:46 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:54:46 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:54:46 user nova-compute[74996]: FIRMWARE:
Nov 02 01:54:46 user nova-compute[74996]: No targets found.
Nov 02 01:54:46 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:54:46 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:54:46 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[95592b56-6da0-4158-8a39-16a88c64762b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e022e29a-0a91-4659-8e00-7a23ac7ac2ae]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:54:46 user nova-compute[74996]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c (non-flash)
Nov 02 01:54:46 user nova-compute[74996]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 (non-flash)
Nov 02 01:54:46 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:54:46 user nova-compute[74996]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c (non-flash)
Nov 02 01:54:46 user nova-compute[74996]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 (non-flash)
Nov 02 01:54:46 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830c61d120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c'): ({'sdd'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Removing single pathed devices sdd {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[245fab20-e844-46d4-8e13-ff76fcb97dba]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b71eb9-c95e-4b31-b446-b0eb2089be8d]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Flushing IO for device /dev/sdd {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5564cf3e-96f8-4ab9-a8ff-643adff09966]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc850fe-7e02-4888-8e93-3ac626fae258]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] SCSI volumes sdd have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIObd9a330f-6fbed885ddc4b7a5', '/dev/disk/by-id/scsi-23666626564383835', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bd9a330f') {{(pid=86449) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e4d0cd-e5de-4fee-803c-829cf1e50a64]: (4, None) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ad36ae-e9c7-4664-8d68-b517b9858522]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:54:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:47 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae17d473-e0a3-42a7-bded-9257da02b4aa]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c, portal: 172.16.0.220,3260]
Nov 02 01:54:47 user nova-compute[74996]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c, portal: 172.16.0.220,3260] successful.
Nov 02 01:54:47 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:54:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:54:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:375c9c0e-b580-44bd-af3d-99e63b2a559c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:54:47 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf19764-d8ac-429f-a0fa-a831ae12068a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:54:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:54:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:54:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] <== disconnect_volume: return (322ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:54:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:54:47 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Deleting instance files /opt/stack/data/nova/instances/7b264ec1-a5d7-40ef-833c-c68211a041d1_del
Nov 02 01:54:47 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Deletion of /opt/stack/data/nova/instances/7b264ec1-a5d7-40ef-833c-c68211a041d1_del complete
Nov 02 01:54:47 user nova-compute[74996]: INFO nova.compute.manager [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 02 01:54:47 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:54:47 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:54:47 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:54:47 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:54:47 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Took 0.44 seconds to deallocate network for instance.
Nov 02 01:54:47 user nova-compute[74996]: DEBUG nova.compute.manager [req-ad0b2af9-6cfd-4c5f-b7a4-ae47e62e0fd2 req-7673fd08-a385-474c-a383-f1f1e69eb2ba service nova] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Received event network-vif-deleted-dd958dd3-c95f-4f47-9361-d505727a4497 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:54:48 user nova-compute[74996]: DEBUG nova.compute.manager [req-f93fc20b-04bc-4d21-bdbf-979f640f1b41 req-a6b6c261-b760-4c35-bed7-1e837070200a service nova] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Received event network-vif-unplugged-dd958dd3-c95f-4f47-9361-d505727a4497 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:54:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f93fc20b-04bc-4d21-bdbf-979f640f1b41 req-a6b6c261-b760-4c35-bed7-1e837070200a service nova] Acquiring lock "7b264ec1-a5d7-40ef-833c-c68211a041d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:54:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f93fc20b-04bc-4d21-bdbf-979f640f1b41 req-a6b6c261-b760-4c35-bed7-1e837070200a service nova] Lock "7b264ec1-a5d7-40ef-833c-c68211a041d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:54:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f93fc20b-04bc-4d21-bdbf-979f640f1b41 req-a6b6c261-b760-4c35-bed7-1e837070200a service nova] Lock "7b264ec1-a5d7-40ef-833c-c68211a041d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:54:48 user nova-compute[74996]: DEBUG nova.compute.manager [req-f93fc20b-04bc-4d21-bdbf-979f640f1b41 req-a6b6c261-b760-4c35-bed7-1e837070200a service nova] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] No waiting events found dispatching network-vif-unplugged-dd958dd3-c95f-4f47-9361-d505727a4497 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:54:48 user nova-compute[74996]: DEBUG nova.compute.manager [req-f93fc20b-04bc-4d21-bdbf-979f640f1b41 req-a6b6c261-b760-4c35-bed7-1e837070200a service nova] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Received event network-vif-unplugged-dd958dd3-c95f-4f47-9361-d505727a4497 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:54:48 user nova-compute[74996]: DEBUG nova.compute.manager [req-f93fc20b-04bc-4d21-bdbf-979f640f1b41 req-a6b6c261-b760-4c35-bed7-1e837070200a service nova] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Received event network-vif-plugged-dd958dd3-c95f-4f47-9361-d505727a4497 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:54:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f93fc20b-04bc-4d21-bdbf-979f640f1b41 req-a6b6c261-b760-4c35-bed7-1e837070200a service nova] Acquiring lock "7b264ec1-a5d7-40ef-833c-c68211a041d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:54:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f93fc20b-04bc-4d21-bdbf-979f640f1b41 req-a6b6c261-b760-4c35-bed7-1e837070200a service nova] Lock "7b264ec1-a5d7-40ef-833c-c68211a041d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:54:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f93fc20b-04bc-4d21-bdbf-979f640f1b41 req-a6b6c261-b760-4c35-bed7-1e837070200a service nova] Lock "7b264ec1-a5d7-40ef-833c-c68211a041d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:54:48 user nova-compute[74996]: DEBUG nova.compute.manager [req-f93fc20b-04bc-4d21-bdbf-979f640f1b41 req-a6b6c261-b760-4c35-bed7-1e837070200a service nova] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] No waiting events found dispatching network-vif-plugged-dd958dd3-c95f-4f47-9361-d505727a4497 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:54:48 user nova-compute[74996]: WARNING nova.compute.manager [req-f93fc20b-04bc-4d21-bdbf-979f640f1b41 req-a6b6c261-b760-4c35-bed7-1e837070200a service nova] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Received unexpected event network-vif-plugged-dd958dd3-c95f-4f47-9361-d505727a4497 for instance with vm_state active and task_state deleting.
Nov 02 01:54:48 user nova-compute[74996]: INFO nova.compute.manager [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 7b264ec1-a5d7-40ef-833c-c68211a041d1] Took 0.91 seconds to detach 1 volumes for instance.
Nov 02 01:54:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:54:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:54:48 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:54:48 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:54:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:54:48 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Deleted allocations for instance 7b264ec1-a5d7-40ef-833c-c68211a041d1
Nov 02 01:54:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-698fc888-7854-4b56-a5d9-64a6f2c233d4 tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "7b264ec1-a5d7-40ef-833c-c68211a041d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.934s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:54:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:54:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:55:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:55:01 user nova-compute[74996]: DEBUG nova.compute.manager [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:55:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:55:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:55:02 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:55:02 user nova-compute[74996]: INFO nova.compute.claims [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Claim successful on node user
Nov 02 01:55:02 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:55:02 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:55:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:55:02 user nova-compute[74996]: DEBUG nova.compute.manager [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:55:02 user nova-compute[74996]: DEBUG nova.compute.manager [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:55:02 user nova-compute[74996]: DEBUG nova.network.neutron [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:55:02 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:55:02 user nova-compute[74996]: DEBUG nova.compute.manager [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:55:02 user nova-compute[74996]: DEBUG nova.policy [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01fc2ea044794374b09741ecaf841ba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22b862880e0c43ab8f5a4d65f6697955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:55:02 user nova-compute[74996]: DEBUG nova.compute.manager [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:55:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:55:02 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Creating image(s)
Nov 02 01:55:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "/opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:55:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "/opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:55:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "/opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:55:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:55:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.177s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:55:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:55:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:55:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:55:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.188s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:55:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:55:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk 1073741824" returned: 0 in 0.044s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:55:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:55:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:55:03 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.175s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:55:03 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:55:03 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:55:03 user nova-compute[74996]: DEBUG nova.network.neutron [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Successfully created port: ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:55:03 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:55:03 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Cannot resize image /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:55:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:55:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Ensure instance console log exists: /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:55:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:55:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:55:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:55:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:03 user nova-compute[74996]: DEBUG nova.network.neutron [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Successfully updated port: ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:55:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "refresh_cache-6fed89e8-a427-4e00-8bba-144dedc9ab1c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:55:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquired lock "refresh_cache-6fed89e8-a427-4e00-8bba-144dedc9ab1c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:55:03 user nova-compute[74996]: DEBUG nova.network.neutron [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:55:03 user nova-compute[74996]: DEBUG nova.compute.manager [req-9a43ebc1-887f-400c-abaa-1cffd21ee6e0 req-77d491cd-9c7f-47d2-bab5-c02567439e6c service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Received event network-changed-ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:55:03 user nova-compute[74996]: DEBUG nova.compute.manager [req-9a43ebc1-887f-400c-abaa-1cffd21ee6e0 req-77d491cd-9c7f-47d2-bab5-c02567439e6c service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Refreshing instance network info cache due to event network-changed-ef383fd9-4ffc-495b-ab4f-732f933a0391. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:55:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9a43ebc1-887f-400c-abaa-1cffd21ee6e0 req-77d491cd-9c7f-47d2-bab5-c02567439e6c service nova] Acquiring lock "refresh_cache-6fed89e8-a427-4e00-8bba-144dedc9ab1c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:55:03 user nova-compute[74996]: DEBUG nova.network.neutron [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.network.neutron [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Updating instance_info_cache with network_info: [{"id": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "address": "fa:16:3e:02:47:7a", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef383fd9-4f", "ovs_interfaceid": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Releasing lock "refresh_cache-6fed89e8-a427-4e00-8bba-144dedc9ab1c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.compute.manager [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Instance network_info: |[{"id": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "address": "fa:16:3e:02:47:7a", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef383fd9-4f", "ovs_interfaceid": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9a43ebc1-887f-400c-abaa-1cffd21ee6e0 req-77d491cd-9c7f-47d2-bab5-c02567439e6c service nova] Acquired lock "refresh_cache-6fed89e8-a427-4e00-8bba-144dedc9ab1c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.network.neutron [req-9a43ebc1-887f-400c-abaa-1cffd21ee6e0 req-77d491cd-9c7f-47d2-bab5-c02567439e6c service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Refreshing network info cache for port ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Start _get_guest_xml network_info=[{"id": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "address": "fa:16:3e:02:47:7a", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef383fd9-4f", "ovs_interfaceid": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:55:04 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:55:04 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:55:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-818920333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-818920333',id=39,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJK2CwSeTpDLIUeMIBLT4PtH5q7fxUV7NAatQGrJ1Lx6MS+E+zjr3mfDsjIyZbP9qqId/6fWYkwaBc/CiiXBZnomBxbD6xFRQ8jZC0ANus4eCWyBhNbF1mQkIftWzwdyUw==',key_name='tempest-keypair-1113388504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22b862880e0c43ab8f5a4d65f6697955',ramdisk_id='',reservation_id='r-2s89a6k1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-701748724',owner_user_name='tempest-AttachVolumeShelveTestJSON-701748724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:55:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01fc2ea044794374b09741ecaf841ba2',uuid=6fed89e8-a427-4e00-8bba-144dedc9ab1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "address": "fa:16:3e:02:47:7a", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef383fd9-4f", "ovs_interfaceid": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Converting VIF {"id": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "address": "fa:16:3e:02:47:7a", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef383fd9-4f", "ovs_interfaceid": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:47:7a,bridge_name='br-int',has_traffic_filtering=True,id=ef383fd9-4ffc-495b-ab4f-732f933a0391,network=Network(936a0e26-8a02-4c7c-9d24-acbb2f438cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef383fd9-4f') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.objects.instance [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lazy-loading 'pci_devices' on Instance uuid 6fed89e8-a427-4e00-8bba-144dedc9ab1c {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:55:04 user nova-compute[74996]:   <uuid>6fed89e8-a427-4e00-8bba-144dedc9ab1c</uuid>
Nov 02 01:55:04 user nova-compute[74996]:   <name>instance-00000027</name>
Nov 02 01:55:04 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:55:04 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:55:04 user nova-compute[74996]:   <metadata>
Nov 02 01:55:04 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:55:04 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:55:04 user nova-compute[74996]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-818920333</nova:name>
Nov 02 01:55:04 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:55:04</nova:creationTime>
Nov 02 01:55:04 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:55:04 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:55:04 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:55:04 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:55:04 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:55:04 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:55:04 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:55:04 user nova-compute[74996]:       <nova:owner>
Nov 02 01:55:04 user nova-compute[74996]:         <nova:user uuid="01fc2ea044794374b09741ecaf841ba2">tempest-AttachVolumeShelveTestJSON-701748724-project-member</nova:user>
Nov 02 01:55:04 user nova-compute[74996]:         <nova:project uuid="22b862880e0c43ab8f5a4d65f6697955">tempest-AttachVolumeShelveTestJSON-701748724</nova:project>
Nov 02 01:55:04 user nova-compute[74996]:       </nova:owner>
Nov 02 01:55:04 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:55:04 user nova-compute[74996]:       <nova:ports>
Nov 02 01:55:04 user nova-compute[74996]:         <nova:port uuid="ef383fd9-4ffc-495b-ab4f-732f933a0391">
Nov 02 01:55:04 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 02 01:55:04 user nova-compute[74996]:         </nova:port>
Nov 02 01:55:04 user nova-compute[74996]:       </nova:ports>
Nov 02 01:55:04 user nova-compute[74996]:     </nova:instance>
Nov 02 01:55:04 user nova-compute[74996]:   </metadata>
Nov 02 01:55:04 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:55:04 user nova-compute[74996]:     <system>
Nov 02 01:55:04 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:55:04 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:55:04 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:55:04 user nova-compute[74996]:       <entry name="serial">6fed89e8-a427-4e00-8bba-144dedc9ab1c</entry>
Nov 02 01:55:04 user nova-compute[74996]:       <entry name="uuid">6fed89e8-a427-4e00-8bba-144dedc9ab1c</entry>
Nov 02 01:55:04 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:55:04 user nova-compute[74996]:     </system>
Nov 02 01:55:04 user nova-compute[74996]:   </sysinfo>
Nov 02 01:55:04 user nova-compute[74996]:   <os>
Nov 02 01:55:04 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:55:04 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:55:04 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:55:04 user nova-compute[74996]:   </os>
Nov 02 01:55:04 user nova-compute[74996]:   <features>
Nov 02 01:55:04 user nova-compute[74996]:     <acpi/>
Nov 02 01:55:04 user nova-compute[74996]:     <apic/>
Nov 02 01:55:04 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:55:04 user nova-compute[74996]:   </features>
Nov 02 01:55:04 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:55:04 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:55:04 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:55:04 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:55:04 user nova-compute[74996]:   </clock>
Nov 02 01:55:04 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:55:04 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:55:04 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:55:04 user nova-compute[74996]:   </cpu>
Nov 02 01:55:04 user nova-compute[74996]:   <devices>
Nov 02 01:55:04 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:55:04 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:55:04 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk"/>
Nov 02 01:55:04 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:55:04 user nova-compute[74996]:     </disk>
Nov 02 01:55:04 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:55:04 user nova-compute[74996]:       <mac address="fa:16:3e:02:47:7a"/>
Nov 02 01:55:04 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:55:04 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:55:04 user nova-compute[74996]:       <target dev="tapef383fd9-4f"/>
Nov 02 01:55:04 user nova-compute[74996]:     </interface>
Nov 02 01:55:04 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:55:04 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/console.log" append="off"/>
Nov 02 01:55:04 user nova-compute[74996]:     </serial>
Nov 02 01:55:04 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:55:04 user nova-compute[74996]:     <video>
Nov 02 01:55:04 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:55:04 user nova-compute[74996]:     </video>
Nov 02 01:55:04 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:55:04 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:55:04 user nova-compute[74996]:     </rng>
Nov 02 01:55:04 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:55:04 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:55:04 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:55:04 user nova-compute[74996]:     </memballoon>
Nov 02 01:55:04 user nova-compute[74996]:   </devices>
Nov 02 01:55:04 user nova-compute[74996]: </domain>
Nov 02 01:55:04 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:55:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-818920333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-818920333',id=39,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJK2CwSeTpDLIUeMIBLT4PtH5q7fxUV7NAatQGrJ1Lx6MS+E+zjr3mfDsjIyZbP9qqId/6fWYkwaBc/CiiXBZnomBxbD6xFRQ8jZC0ANus4eCWyBhNbF1mQkIftWzwdyUw==',key_name='tempest-keypair-1113388504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22b862880e0c43ab8f5a4d65f6697955',ramdisk_id='',reservation_id='r-2s89a6k1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-701748724',owner_user_name='tempest-AttachVolumeShelveTestJSON-701748724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:55:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01fc2ea044794374b09741ecaf841ba2',uuid=6fed89e8-a427-4e00-8bba-144dedc9ab1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "address": "fa:16:3e:02:47:7a", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef383fd9-4f", "ovs_interfaceid": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Converting VIF {"id": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "address": "fa:16:3e:02:47:7a", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef383fd9-4f", "ovs_interfaceid": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:47:7a,bridge_name='br-int',has_traffic_filtering=True,id=ef383fd9-4ffc-495b-ab4f-732f933a0391,network=Network(936a0e26-8a02-4c7c-9d24-acbb2f438cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef383fd9-4f') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG os_vif [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:47:7a,bridge_name='br-int',has_traffic_filtering=True,id=ef383fd9-4ffc-495b-ab4f-732f933a0391,network=Network(936a0e26-8a02-4c7c-9d24-acbb2f438cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef383fd9-4f') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b32a928-9db7-52a0-9eef-978d5fc5037a', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef383fd9-4f, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef383fd9-4f, col_values=(('qos', UUID('1f6fa6fe-0359-442c-9650-3310d68f2a12')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef383fd9-4f, col_values=(('external_ids', {'iface-id': 'ef383fd9-4ffc-495b-ab4f-732f933a0391', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:47:7a', 'vm-uuid': '6fed89e8-a427-4e00-8bba-144dedc9ab1c'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:04 user nova-compute[74996]: INFO os_vif [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:47:7a,bridge_name='br-int',has_traffic_filtering=True,id=ef383fd9-4ffc-495b-ab4f-732f933a0391,network=Network(936a0e26-8a02-4c7c-9d24-acbb2f438cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef383fd9-4f')
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] No VIF found with MAC fa:16:3e:02:47:7a, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.network.neutron [req-9a43ebc1-887f-400c-abaa-1cffd21ee6e0 req-77d491cd-9c7f-47d2-bab5-c02567439e6c service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Updated VIF entry in instance network info cache for port ef383fd9-4ffc-495b-ab4f-732f933a0391. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG nova.network.neutron [req-9a43ebc1-887f-400c-abaa-1cffd21ee6e0 req-77d491cd-9c7f-47d2-bab5-c02567439e6c service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Updating instance_info_cache with network_info: [{"id": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "address": "fa:16:3e:02:47:7a", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef383fd9-4f", "ovs_interfaceid": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:55:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9a43ebc1-887f-400c-abaa-1cffd21ee6e0 req-77d491cd-9c7f-47d2-bab5-c02567439e6c service nova] Releasing lock "refresh_cache-6fed89e8-a427-4e00-8bba-144dedc9ab1c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:55:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:05 user nova-compute[74996]: DEBUG nova.compute.manager [req-c6d2e702-ebb5-44ce-a33c-ffb6c2c8f186 req-a0bb2060-9dcb-405c-9b33-6e9c454c6791 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Received event network-vif-plugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:55:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c6d2e702-ebb5-44ce-a33c-ffb6c2c8f186 req-a0bb2060-9dcb-405c-9b33-6e9c454c6791 service nova] Acquiring lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:55:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c6d2e702-ebb5-44ce-a33c-ffb6c2c8f186 req-a0bb2060-9dcb-405c-9b33-6e9c454c6791 service nova] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:55:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c6d2e702-ebb5-44ce-a33c-ffb6c2c8f186 req-a0bb2060-9dcb-405c-9b33-6e9c454c6791 service nova] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:55:05 user nova-compute[74996]: DEBUG nova.compute.manager [req-c6d2e702-ebb5-44ce-a33c-ffb6c2c8f186 req-a0bb2060-9dcb-405c-9b33-6e9c454c6791 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] No waiting events found dispatching network-vif-plugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:55:05 user nova-compute[74996]: WARNING nova.compute.manager [req-c6d2e702-ebb5-44ce-a33c-ffb6c2c8f186 req-a0bb2060-9dcb-405c-9b33-6e9c454c6791 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Received unexpected event network-vif-plugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 for instance with vm_state building and task_state spawning.
Nov 02 01:55:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:07 user nova-compute[74996]: DEBUG nova.compute.manager [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:55:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:55:07 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Instance spawned successfully.
Nov 02 01:55:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:55:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:55:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:55:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:55:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:55:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:55:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:55:07 user nova-compute[74996]: DEBUG nova.compute.manager [req-13c1b115-4ac3-4bfc-ab61-bfc99f99de07 req-3699c232-66aa-4d1a-b894-3e7523a915ed service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Received event network-vif-plugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:55:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-13c1b115-4ac3-4bfc-ab61-bfc99f99de07 req-3699c232-66aa-4d1a-b894-3e7523a915ed service nova] Acquiring lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:55:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-13c1b115-4ac3-4bfc-ab61-bfc99f99de07 req-3699c232-66aa-4d1a-b894-3e7523a915ed service nova] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:55:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-13c1b115-4ac3-4bfc-ab61-bfc99f99de07 req-3699c232-66aa-4d1a-b894-3e7523a915ed service nova] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:55:07 user nova-compute[74996]: DEBUG nova.compute.manager [req-13c1b115-4ac3-4bfc-ab61-bfc99f99de07 req-3699c232-66aa-4d1a-b894-3e7523a915ed service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] No waiting events found dispatching network-vif-plugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:55:07 user nova-compute[74996]: WARNING nova.compute.manager [req-13c1b115-4ac3-4bfc-ab61-bfc99f99de07 req-3699c232-66aa-4d1a-b894-3e7523a915ed service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Received unexpected event network-vif-plugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 for instance with vm_state building and task_state spawning.
Nov 02 01:55:07 user nova-compute[74996]: INFO nova.compute.manager [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 02 01:55:07 user nova-compute[74996]: DEBUG nova.compute.manager [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:55:07 user nova-compute[74996]: INFO nova.compute.manager [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Took 5.98 seconds to build instance.
Nov 02 01:55:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6638d89d-6377-41f9-afbc-cd119469e7cb tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.079s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:55:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:12 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:55:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:55:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 01:55:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:55:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:55:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:55:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:26 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:55:27 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:55:28 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:55:28 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:55:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:55:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:55:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:55:28 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:55:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:55:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:55:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:55:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:55:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:55:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:55:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:55:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:55:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:55:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:55:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:55:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:55:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:55:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:55:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:55:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:55:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:55:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:55:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:55:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:55:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:55:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:55:30 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:55:30 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:55:30 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8339MB free_disk=25.01748275756836GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:55:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:55:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:55:30 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance e38704a7-f8a0-482c-bd51-26a90d37b71d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:55:30 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7c53e6cc-cf69-485d-b24f-5e113dae0e5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:55:30 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:55:30 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:55:30 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 6fed89e8-a427-4e00-8bba-144dedc9ab1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:55:30 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:55:30 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:55:31 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:55:31 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:55:31 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:55:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.529s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:55:33 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:55:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:34 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:55:34 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:55:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:55:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:55:34 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 01:55:34 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Updating instance_info_cache with network_info: [{"id": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "address": "fa:16:3e:9f:76:66", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016a6c69-a1", "ovs_interfaceid": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:55:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:55:34 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 01:55:34 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:55:34 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:55:34 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:55:36 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:55:37 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:55:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:55:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:55:42 user nova-compute[74996]: DEBUG nova.compute.manager [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:55:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:55:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:55:42 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:55:42 user nova-compute[74996]: INFO nova.compute.claims [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Claim successful on node user
Nov 02 01:55:42 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:55:42 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:55:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.299s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:55:42 user nova-compute[74996]: DEBUG nova.compute.manager [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:55:42 user nova-compute[74996]: DEBUG nova.compute.manager [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:55:42 user nova-compute[74996]: DEBUG nova.network.neutron [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:55:42 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:55:42 user nova-compute[74996]: DEBUG nova.compute.manager [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:55:42 user nova-compute[74996]: DEBUG nova.policy [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '87e5cf8786fe44b5a5305f3be11d64c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89083c24ba475f9159a80fddfe9159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:55:42 user nova-compute[74996]: DEBUG nova.compute.manager [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:55:42 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:55:42 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Creating image(s)
Nov 02 01:55:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "/opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:55:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "/opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:55:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "/opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:55:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:55:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.176s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:55:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:55:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:55:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:55:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.169s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:55:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:55:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk 1073741824" returned: 0 in 0.046s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:55:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:55:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:55:43 user nova-compute[74996]: DEBUG nova.network.neutron [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Successfully created port: 9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:55:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.196s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:55:43 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Checking if we can resize image /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:55:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:55:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:55:43 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Cannot resize image /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:55:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:55:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Ensure instance console log exists: /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:55:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:55:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:55:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:55:43 user nova-compute[74996]: DEBUG nova.network.neutron [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Successfully updated port: 9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:55:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "refresh_cache-27863b45-4dda-4f6d-bd6f-0f332f1fdd52" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:55:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquired lock "refresh_cache-27863b45-4dda-4f6d-bd6f-0f332f1fdd52" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:55:43 user nova-compute[74996]: DEBUG nova.network.neutron [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:55:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-9e2f3857-565e-4072-b4dd-bc2365ae452b req-2654c890-8b64-49e5-8541-dfe35e77ab90 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Received event network-changed-9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:55:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-9e2f3857-565e-4072-b4dd-bc2365ae452b req-2654c890-8b64-49e5-8541-dfe35e77ab90 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Refreshing instance network info cache due to event network-changed-9ffa33b3-7d4c-484c-834b-60c2f888b540. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:55:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9e2f3857-565e-4072-b4dd-bc2365ae452b req-2654c890-8b64-49e5-8541-dfe35e77ab90 service nova] Acquiring lock "refresh_cache-27863b45-4dda-4f6d-bd6f-0f332f1fdd52" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:55:43 user nova-compute[74996]: DEBUG nova.network.neutron [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Cleaning up deleted instances {{(pid=74996) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.network.neutron [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Updating instance_info_cache with network_info: [{"id": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "address": "fa:16:3e:2e:f5:1b", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa33b3-7d", "ovs_interfaceid": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] There are 0 instances to clean {{(pid=74996) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Releasing lock "refresh_cache-27863b45-4dda-4f6d-bd6f-0f332f1fdd52" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.compute.manager [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Instance network_info: |[{"id": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "address": "fa:16:3e:2e:f5:1b", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa33b3-7d", "ovs_interfaceid": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9e2f3857-565e-4072-b4dd-bc2365ae452b req-2654c890-8b64-49e5-8541-dfe35e77ab90 service nova] Acquired lock "refresh_cache-27863b45-4dda-4f6d-bd6f-0f332f1fdd52" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.network.neutron [req-9e2f3857-565e-4072-b4dd-bc2365ae452b req-2654c890-8b64-49e5-8541-dfe35e77ab90 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Refreshing network info cache for port 9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Start _get_guest_xml network_info=[{"id": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "address": "fa:16:3e:2e:f5:1b", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa33b3-7d", "ovs_interfaceid": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:55:44 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:55:44 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:55:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1987643853',display_name='tempest-ServerRescueNegativeTestJSON-server-1987643853',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1987643853',id=40,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKheu8wiqdlC3hH3OAEdws9kSpyqPO541Zoa8GP80tBYxiXZ24s0YcE15PIexh9WjlPW0xLXSXW4RQU/f4sL5hr1y0f0ZWs+SVjjxo1F9di75eqRJG50AOSZORve8JSc/A==',key_name='tempest-keypair-2071253473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d89083c24ba475f9159a80fddfe9159',ramdisk_id='',reservation_id='r-v8max6zc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1433266011',owner_user_name='tempest-ServerRescueNegativeTestJSON-1433266011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:55:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87e5cf8786fe44b5a5305f3be11d64c2',uuid=27863b45-4dda-4f6d-bd6f-0f332f1fdd52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "address": "fa:16:3e:2e:f5:1b", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa33b3-7d", "ovs_interfaceid": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Converting VIF {"id": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "address": "fa:16:3e:2e:f5:1b", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa33b3-7d", "ovs_interfaceid": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:f5:1b,bridge_name='br-int',has_traffic_filtering=True,id=9ffa33b3-7d4c-484c-834b-60c2f888b540,network=Network(81a443a7-0a10-4c81-9903-853291c58596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ffa33b3-7d') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.objects.instance [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lazy-loading 'pci_devices' on Instance uuid 27863b45-4dda-4f6d-bd6f-0f332f1fdd52 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:55:44 user nova-compute[74996]:   <uuid>27863b45-4dda-4f6d-bd6f-0f332f1fdd52</uuid>
Nov 02 01:55:44 user nova-compute[74996]:   <name>instance-00000028</name>
Nov 02 01:55:44 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:55:44 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:55:44 user nova-compute[74996]:   <metadata>
Nov 02 01:55:44 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:55:44 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:55:44 user nova-compute[74996]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1987643853</nova:name>
Nov 02 01:55:44 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:55:44</nova:creationTime>
Nov 02 01:55:44 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:55:44 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:55:44 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:55:44 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:55:44 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:55:44 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:55:44 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:55:44 user nova-compute[74996]:       <nova:owner>
Nov 02 01:55:44 user nova-compute[74996]:         <nova:user uuid="87e5cf8786fe44b5a5305f3be11d64c2">tempest-ServerRescueNegativeTestJSON-1433266011-project-member</nova:user>
Nov 02 01:55:44 user nova-compute[74996]:         <nova:project uuid="6d89083c24ba475f9159a80fddfe9159">tempest-ServerRescueNegativeTestJSON-1433266011</nova:project>
Nov 02 01:55:44 user nova-compute[74996]:       </nova:owner>
Nov 02 01:55:44 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:55:44 user nova-compute[74996]:       <nova:ports>
Nov 02 01:55:44 user nova-compute[74996]:         <nova:port uuid="9ffa33b3-7d4c-484c-834b-60c2f888b540">
Nov 02 01:55:44 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 02 01:55:44 user nova-compute[74996]:         </nova:port>
Nov 02 01:55:44 user nova-compute[74996]:       </nova:ports>
Nov 02 01:55:44 user nova-compute[74996]:     </nova:instance>
Nov 02 01:55:44 user nova-compute[74996]:   </metadata>
Nov 02 01:55:44 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:55:44 user nova-compute[74996]:     <system>
Nov 02 01:55:44 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:55:44 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:55:44 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:55:44 user nova-compute[74996]:       <entry name="serial">27863b45-4dda-4f6d-bd6f-0f332f1fdd52</entry>
Nov 02 01:55:44 user nova-compute[74996]:       <entry name="uuid">27863b45-4dda-4f6d-bd6f-0f332f1fdd52</entry>
Nov 02 01:55:44 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:55:44 user nova-compute[74996]:     </system>
Nov 02 01:55:44 user nova-compute[74996]:   </sysinfo>
Nov 02 01:55:44 user nova-compute[74996]:   <os>
Nov 02 01:55:44 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:55:44 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:55:44 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:55:44 user nova-compute[74996]:   </os>
Nov 02 01:55:44 user nova-compute[74996]:   <features>
Nov 02 01:55:44 user nova-compute[74996]:     <acpi/>
Nov 02 01:55:44 user nova-compute[74996]:     <apic/>
Nov 02 01:55:44 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:55:44 user nova-compute[74996]:   </features>
Nov 02 01:55:44 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:55:44 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:55:44 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:55:44 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:55:44 user nova-compute[74996]:   </clock>
Nov 02 01:55:44 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:55:44 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:55:44 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:55:44 user nova-compute[74996]:   </cpu>
Nov 02 01:55:44 user nova-compute[74996]:   <devices>
Nov 02 01:55:44 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:55:44 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:55:44 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk"/>
Nov 02 01:55:44 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:55:44 user nova-compute[74996]:     </disk>
Nov 02 01:55:44 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:55:44 user nova-compute[74996]:       <mac address="fa:16:3e:2e:f5:1b"/>
Nov 02 01:55:44 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:55:44 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:55:44 user nova-compute[74996]:       <target dev="tap9ffa33b3-7d"/>
Nov 02 01:55:44 user nova-compute[74996]:     </interface>
Nov 02 01:55:44 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:55:44 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/console.log" append="off"/>
Nov 02 01:55:44 user nova-compute[74996]:     </serial>
Nov 02 01:55:44 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:55:44 user nova-compute[74996]:     <video>
Nov 02 01:55:44 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:55:44 user nova-compute[74996]:     </video>
Nov 02 01:55:44 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:55:44 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:55:44 user nova-compute[74996]:     </rng>
Nov 02 01:55:44 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:55:44 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:55:44 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:55:44 user nova-compute[74996]:     </memballoon>
Nov 02 01:55:44 user nova-compute[74996]:   </devices>
Nov 02 01:55:44 user nova-compute[74996]: </domain>
Nov 02 01:55:44 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:55:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1987643853',display_name='tempest-ServerRescueNegativeTestJSON-server-1987643853',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1987643853',id=40,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKheu8wiqdlC3hH3OAEdws9kSpyqPO541Zoa8GP80tBYxiXZ24s0YcE15PIexh9WjlPW0xLXSXW4RQU/f4sL5hr1y0f0ZWs+SVjjxo1F9di75eqRJG50AOSZORve8JSc/A==',key_name='tempest-keypair-2071253473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d89083c24ba475f9159a80fddfe9159',ramdisk_id='',reservation_id='r-v8max6zc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1433266011',owner_user_name='tempest-ServerRescueNegativeTestJSON-1433266011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:55:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87e5cf8786fe44b5a5305f3be11d64c2',uuid=27863b45-4dda-4f6d-bd6f-0f332f1fdd52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "address": "fa:16:3e:2e:f5:1b", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa33b3-7d", "ovs_interfaceid": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Converting VIF {"id": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "address": "fa:16:3e:2e:f5:1b", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa33b3-7d", "ovs_interfaceid": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:f5:1b,bridge_name='br-int',has_traffic_filtering=True,id=9ffa33b3-7d4c-484c-834b-60c2f888b540,network=Network(81a443a7-0a10-4c81-9903-853291c58596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ffa33b3-7d') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG os_vif [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:f5:1b,bridge_name='br-int',has_traffic_filtering=True,id=9ffa33b3-7d4c-484c-834b-60c2f888b540,network=Network(81a443a7-0a10-4c81-9903-853291c58596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ffa33b3-7d') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '40b68c60-4041-55d6-a839-8a8cae8e86e5', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ffa33b3-7d, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ffa33b3-7d, col_values=(('qos', UUID('4f16569c-2c52-4276-a0cf-90e30f7cbd65')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ffa33b3-7d, col_values=(('external_ids', {'iface-id': '9ffa33b3-7d4c-484c-834b-60c2f888b540', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:f5:1b', 'vm-uuid': '27863b45-4dda-4f6d-bd6f-0f332f1fdd52'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:44 user nova-compute[74996]: INFO os_vif [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:f5:1b,bridge_name='br-int',has_traffic_filtering=True,id=9ffa33b3-7d4c-484c-834b-60c2f888b540,network=Network(81a443a7-0a10-4c81-9903-853291c58596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ffa33b3-7d')
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] No VIF found with MAC fa:16:3e:2e:f5:1b, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.network.neutron [req-9e2f3857-565e-4072-b4dd-bc2365ae452b req-2654c890-8b64-49e5-8541-dfe35e77ab90 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Updated VIF entry in instance network info cache for port 9ffa33b3-7d4c-484c-834b-60c2f888b540. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG nova.network.neutron [req-9e2f3857-565e-4072-b4dd-bc2365ae452b req-2654c890-8b64-49e5-8541-dfe35e77ab90 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Updating instance_info_cache with network_info: [{"id": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "address": "fa:16:3e:2e:f5:1b", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa33b3-7d", "ovs_interfaceid": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:55:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9e2f3857-565e-4072-b4dd-bc2365ae452b req-2654c890-8b64-49e5-8541-dfe35e77ab90 service nova] Releasing lock "refresh_cache-27863b45-4dda-4f6d-bd6f-0f332f1fdd52" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:55:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-9e58e811-088d-4870-a5a6-eb449cbc51bf req-5d2fa26b-7323-4025-a7e2-a995c5cf8bfe service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Received event network-vif-plugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:55:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9e58e811-088d-4870-a5a6-eb449cbc51bf req-5d2fa26b-7323-4025-a7e2-a995c5cf8bfe service nova] Acquiring lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:55:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9e58e811-088d-4870-a5a6-eb449cbc51bf req-5d2fa26b-7323-4025-a7e2-a995c5cf8bfe service nova] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:55:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9e58e811-088d-4870-a5a6-eb449cbc51bf req-5d2fa26b-7323-4025-a7e2-a995c5cf8bfe service nova] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:55:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-9e58e811-088d-4870-a5a6-eb449cbc51bf req-5d2fa26b-7323-4025-a7e2-a995c5cf8bfe service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] No waiting events found dispatching network-vif-plugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:55:45 user nova-compute[74996]: WARNING nova.compute.manager [req-9e58e811-088d-4870-a5a6-eb449cbc51bf req-5d2fa26b-7323-4025-a7e2-a995c5cf8bfe service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Received unexpected event network-vif-plugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 for instance with vm_state building and task_state spawning.
Nov 02 01:55:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:46 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:55:46 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74996) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 01:55:47 user nova-compute[74996]: DEBUG nova.compute.manager [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:55:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:55:47 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Instance spawned successfully.
Nov 02 01:55:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:55:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:55:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:55:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:55:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:55:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:55:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:55:47 user nova-compute[74996]: DEBUG nova.compute.manager [req-99889794-0b68-4080-b613-ef1e5095f652 req-352497b4-6d41-48bc-93f7-381730c64649 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Received event network-vif-plugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:55:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-99889794-0b68-4080-b613-ef1e5095f652 req-352497b4-6d41-48bc-93f7-381730c64649 service nova] Acquiring lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:55:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-99889794-0b68-4080-b613-ef1e5095f652 req-352497b4-6d41-48bc-93f7-381730c64649 service nova] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:55:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-99889794-0b68-4080-b613-ef1e5095f652 req-352497b4-6d41-48bc-93f7-381730c64649 service nova] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:55:47 user nova-compute[74996]: DEBUG nova.compute.manager [req-99889794-0b68-4080-b613-ef1e5095f652 req-352497b4-6d41-48bc-93f7-381730c64649 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] No waiting events found dispatching network-vif-plugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:55:47 user nova-compute[74996]: WARNING nova.compute.manager [req-99889794-0b68-4080-b613-ef1e5095f652 req-352497b4-6d41-48bc-93f7-381730c64649 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Received unexpected event network-vif-plugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 for instance with vm_state building and task_state spawning.
Nov 02 01:55:47 user nova-compute[74996]: INFO nova.compute.manager [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 02 01:55:47 user nova-compute[74996]: DEBUG nova.compute.manager [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:55:48 user nova-compute[74996]: INFO nova.compute.manager [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Took 5.97 seconds to build instance.
Nov 02 01:55:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5bf1f0a7-e0ab-4709-84e4-939f2ff200a6 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.068s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:55:48 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:55:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:55:58 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:55:58 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid e38704a7-f8a0-482c-bd51-26a90d37b71d {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 01:55:58 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid 7c53e6cc-cf69-485d-b24f-5e113dae0e5d {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 01:55:58 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 01:55:58 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 01:55:58 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid 6fed89e8-a427-4e00-8bba-144dedc9ab1c {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 01:55:58 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid 27863b45-4dda-4f6d-bd6f-0f332f1fdd52 {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 01:55:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "e38704a7-f8a0-482c-bd51-26a90d37b71d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:55:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:55:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:55:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:55:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "3f80eb60-ba0b-4a4c-8b41-17130ddf51fa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:55:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "3f80eb60-ba0b-4a4c-8b41-17130ddf51fa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:55:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:55:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:55:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:55:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:55:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:55:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:55:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:55:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "3f80eb60-ba0b-4a4c-8b41-17130ddf51fa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:55:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:55:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:55:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:55:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:55:59 user nova-compute[74996]: DEBUG nova.compute.manager [req-abd36845-8bdb-4af5-95b3-5aaa2c21089b req-b7f3eddb-5678-4da7-be6c-2396b48c1456 service nova] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Received event network-changed-3d50920e-49be-4b14-9019-60a286e9f068 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:55:59 user nova-compute[74996]: DEBUG nova.compute.manager [req-abd36845-8bdb-4af5-95b3-5aaa2c21089b req-b7f3eddb-5678-4da7-be6c-2396b48c1456 service nova] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Refreshing instance network info cache due to event network-changed-3d50920e-49be-4b14-9019-60a286e9f068. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:55:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-abd36845-8bdb-4af5-95b3-5aaa2c21089b req-b7f3eddb-5678-4da7-be6c-2396b48c1456 service nova] Acquiring lock "refresh_cache-3f80eb60-ba0b-4a4c-8b41-17130ddf51fa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:55:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-abd36845-8bdb-4af5-95b3-5aaa2c21089b req-b7f3eddb-5678-4da7-be6c-2396b48c1456 service nova] Acquired lock "refresh_cache-3f80eb60-ba0b-4a4c-8b41-17130ddf51fa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:55:59 user nova-compute[74996]: DEBUG nova.network.neutron [req-abd36845-8bdb-4af5-95b3-5aaa2c21089b req-b7f3eddb-5678-4da7-be6c-2396b48c1456 service nova] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Refreshing network info cache for port 3d50920e-49be-4b14-9019-60a286e9f068 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:55:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:55:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 01:55:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:55:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 01:55:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "3f80eb60-ba0b-4a4c-8b41-17130ddf51fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:55:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "3f80eb60-ba0b-4a4c-8b41-17130ddf51fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:55:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "3f80eb60-ba0b-4a4c-8b41-17130ddf51fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:55:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "3f80eb60-ba0b-4a4c-8b41-17130ddf51fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:55:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "3f80eb60-ba0b-4a4c-8b41-17130ddf51fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:55:59 user nova-compute[74996]: INFO nova.compute.manager [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Terminating instance
Nov 02 01:55:59 user nova-compute[74996]: DEBUG nova.compute.manager [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:55:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:55:59 user nova-compute[74996]: DEBUG nova.network.neutron [req-abd36845-8bdb-4af5-95b3-5aaa2c21089b req-b7f3eddb-5678-4da7-be6c-2396b48c1456 service nova] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Updated VIF entry in instance network info cache for port 3d50920e-49be-4b14-9019-60a286e9f068. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:55:59 user nova-compute[74996]: DEBUG nova.network.neutron [req-abd36845-8bdb-4af5-95b3-5aaa2c21089b req-b7f3eddb-5678-4da7-be6c-2396b48c1456 service nova] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Updating instance_info_cache with network_info: [{"id": "3d50920e-49be-4b14-9019-60a286e9f068", "address": "fa:16:3e:ba:b0:00", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d50920e-49", "ovs_interfaceid": "3d50920e-49be-4b14-9019-60a286e9f068", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:55:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-abd36845-8bdb-4af5-95b3-5aaa2c21089b req-b7f3eddb-5678-4da7-be6c-2396b48c1456 service nova] Releasing lock "refresh_cache-3f80eb60-ba0b-4a4c-8b41-17130ddf51fa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:56:00 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Instance destroyed successfully.
Nov 02 01:56:00 user nova-compute[74996]: DEBUG nova.objects.instance [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lazy-loading 'resources' on Instance uuid 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:50:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1742708987',display_name='tempest-TestVolumeBootPattern-server-1742708987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1742708987',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqKsx295qdP4lg7887w79wguzwBudaKLS1CaKDMdZBRiyydUejeP/bphRv12kudSVdoUpRoo+kfCoJgBSoxWJoJnZVJJAUy53PGnOOqIVwETBw7ua4uyU/hdtrnp6uX6w==',key_name='tempest-TestVolumeBootPattern-1607904644',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:51:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31965b482eb243a69112a49bf1302779',ramdisk_id='',reservation_id='r-3hzhkh5s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-216720976',owner_user_name='tempest-TestVolumeBootPattern-216720976-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:51:08Z,user_data=None,user_id='be6bf504c3a649898e8c83399f6fee8e',uuid=3f80eb60-ba0b-4a4c-8b41-17130ddf51fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d50920e-49be-4b14-9019-60a286e9f068", "address": "fa:16:3e:ba:b0:00", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d50920e-49", "ovs_interfaceid": "3d50920e-49be-4b14-9019-60a286e9f068", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converting VIF {"id": "3d50920e-49be-4b14-9019-60a286e9f068", "address": "fa:16:3e:ba:b0:00", "network": {"id": "24043ed5-4498-45bb-946a-809792be0c59", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-533889384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31965b482eb243a69112a49bf1302779", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d50920e-49", "ovs_interfaceid": "3d50920e-49be-4b14-9019-60a286e9f068", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:b0:00,bridge_name='br-int',has_traffic_filtering=True,id=3d50920e-49be-4b14-9019-60a286e9f068,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d50920e-49') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG os_vif [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:b0:00,bridge_name='br-int',has_traffic_filtering=True,id=3d50920e-49be-4b14-9019-60a286e9f068,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d50920e-49') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d50920e-49, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=94a292d0-d20c-49ce-931a-4b31e1679c49) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:56:00 user nova-compute[74996]: INFO os_vif [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:b0:00,bridge_name='br-int',has_traffic_filtering=True,id=3d50920e-49be-4b14-9019-60a286e9f068,network=Network(24043ed5-4498-45bb-946a-809792be0c59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d50920e-49')
Nov 02 01:56:00 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zpiYoRgf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:56:00 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:56:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9630346c-09ed-49e0-ba99-3bca91deedc7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:56:00 user nova-compute[74996]: No targets found.
Nov 02 01:56:00 user nova-compute[74996]: iSNS:
Nov 02 01:56:00 user nova-compute[74996]: No targets found.
Nov 02 01:56:00 user nova-compute[74996]: STATIC:
Nov 02 01:56:00 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae
Nov 02 01:56:00 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:56:00 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:56:00 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4
Nov 02 01:56:00 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:56:00 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:56:00 user nova-compute[74996]: FIRMWARE:
Nov 02 01:56:00 user nova-compute[74996]: No targets found.
Nov 02 01:56:00 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:56:00 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:56:00 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36c584f-32e8-47da-a289-03509108ab98]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[28433491-223b-429b-9e6d-4fae795cc8dc]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:56:00 user nova-compute[74996]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 (non-flash)
Nov 02 01:56:00 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae (non-flash)
Nov 02 01:56:00 user nova-compute[74996]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 (non-flash)
Nov 02 01:56:00 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e86589d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae'): ({'sdb'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Removing single pathed devices sdb {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cba7f5-7feb-40f0-9799-e34c0c4da120]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d424e099-fbda-4e1d-8fdf-c8ea753327d0]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Flushing IO for device /dev/sdb {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec3a643-ea98-43f8-b16e-376323e370c4]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac915b80-e698-4ab6-98f9-038329231133]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO84e0486-013d4f2d85fefdda', '/dev/disk/by-id/scsi-23031336434663264', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_84e0486') {{(pid=86449) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[578890a8-1e53-4567-9500-8dea7e28582c]: (4, None) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[544bd687-b6ae-459c-8301-bbe16427dbb6]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[402ac878-3ce0-4123-b69b-8b3ac63db807]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae, portal: 172.16.0.220,3260]
Nov 02 01:56:00 user nova-compute[74996]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae, portal: 172.16.0.220,3260] successful.
Nov 02 01:56:00 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5a26f9c-f371-4a37-990c-eadd5a9bcfae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f800b2c-7fe2-4576-8ad0-3317a2a7649d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] <== disconnect_volume: return (321ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:56:00 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Deleting instance files /opt/stack/data/nova/instances/3f80eb60-ba0b-4a4c-8b41-17130ddf51fa_del
Nov 02 01:56:00 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Deletion of /opt/stack/data/nova/instances/3f80eb60-ba0b-4a4c-8b41-17130ddf51fa_del complete
Nov 02 01:56:00 user nova-compute[74996]: INFO nova.compute.manager [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 02 01:56:00 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:56:00 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:56:01 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:56:01 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Took 0.60 seconds to deallocate network for instance.
Nov 02 01:56:01 user nova-compute[74996]: DEBUG nova.compute.manager [req-ea2a684a-162b-4bd4-b030-40c9cfc92c7c req-49e0d75b-3813-4bbb-b8d6-465a364f3016 service nova] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Received event network-vif-deleted-3d50920e-49be-4b14-9019-60a286e9f068 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:56:01 user nova-compute[74996]: DEBUG nova.compute.manager [req-b020cae3-a6fa-4dbf-b9d5-dc6efe1bde0d req-26a45e43-8765-4587-93b7-2e17d4ccea4e service nova] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Received event network-vif-unplugged-3d50920e-49be-4b14-9019-60a286e9f068 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:56:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b020cae3-a6fa-4dbf-b9d5-dc6efe1bde0d req-26a45e43-8765-4587-93b7-2e17d4ccea4e service nova] Acquiring lock "3f80eb60-ba0b-4a4c-8b41-17130ddf51fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:56:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b020cae3-a6fa-4dbf-b9d5-dc6efe1bde0d req-26a45e43-8765-4587-93b7-2e17d4ccea4e service nova] Lock "3f80eb60-ba0b-4a4c-8b41-17130ddf51fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:56:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b020cae3-a6fa-4dbf-b9d5-dc6efe1bde0d req-26a45e43-8765-4587-93b7-2e17d4ccea4e service nova] Lock "3f80eb60-ba0b-4a4c-8b41-17130ddf51fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:56:01 user nova-compute[74996]: DEBUG nova.compute.manager [req-b020cae3-a6fa-4dbf-b9d5-dc6efe1bde0d req-26a45e43-8765-4587-93b7-2e17d4ccea4e service nova] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] No waiting events found dispatching network-vif-unplugged-3d50920e-49be-4b14-9019-60a286e9f068 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:56:01 user nova-compute[74996]: DEBUG nova.compute.manager [req-b020cae3-a6fa-4dbf-b9d5-dc6efe1bde0d req-26a45e43-8765-4587-93b7-2e17d4ccea4e service nova] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Received event network-vif-unplugged-3d50920e-49be-4b14-9019-60a286e9f068 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:56:01 user nova-compute[74996]: DEBUG nova.compute.manager [req-b020cae3-a6fa-4dbf-b9d5-dc6efe1bde0d req-26a45e43-8765-4587-93b7-2e17d4ccea4e service nova] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Received event network-vif-plugged-3d50920e-49be-4b14-9019-60a286e9f068 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:56:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b020cae3-a6fa-4dbf-b9d5-dc6efe1bde0d req-26a45e43-8765-4587-93b7-2e17d4ccea4e service nova] Acquiring lock "3f80eb60-ba0b-4a4c-8b41-17130ddf51fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:56:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b020cae3-a6fa-4dbf-b9d5-dc6efe1bde0d req-26a45e43-8765-4587-93b7-2e17d4ccea4e service nova] Lock "3f80eb60-ba0b-4a4c-8b41-17130ddf51fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:56:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b020cae3-a6fa-4dbf-b9d5-dc6efe1bde0d req-26a45e43-8765-4587-93b7-2e17d4ccea4e service nova] Lock "3f80eb60-ba0b-4a4c-8b41-17130ddf51fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:56:01 user nova-compute[74996]: DEBUG nova.compute.manager [req-b020cae3-a6fa-4dbf-b9d5-dc6efe1bde0d req-26a45e43-8765-4587-93b7-2e17d4ccea4e service nova] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] No waiting events found dispatching network-vif-plugged-3d50920e-49be-4b14-9019-60a286e9f068 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:56:01 user nova-compute[74996]: WARNING nova.compute.manager [req-b020cae3-a6fa-4dbf-b9d5-dc6efe1bde0d req-26a45e43-8765-4587-93b7-2e17d4ccea4e service nova] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Received unexpected event network-vif-plugged-3d50920e-49be-4b14-9019-60a286e9f068 for instance with vm_state active and task_state deleting.
Nov 02 01:56:02 user nova-compute[74996]: INFO nova.compute.manager [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] [instance: 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa] Took 0.91 seconds to detach 1 volumes for instance.
Nov 02 01:56:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:56:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:56:02 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:56:02 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:56:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:56:02 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Deleted allocations for instance 3f80eb60-ba0b-4a4c-8b41-17130ddf51fa
Nov 02 01:56:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-25eb60c5-2517-4b34-9569-97298e8b1d9b tempest-TestVolumeBootPattern-216720976 tempest-TestVolumeBootPattern-216720976-project-member] Lock "3f80eb60-ba0b-4a4c-8b41-17130ddf51fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.110s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:56:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:56:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:56:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:56:10 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:56:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:56:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:56:16 user nova-compute[74996]: DEBUG nova.compute.manager [req-979b6221-e06a-43b4-a05c-3c45f4dbc3ec req-8715e021-4895-4b70-9da0-d8ddc1a5e85a service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Received event network-changed-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:56:16 user nova-compute[74996]: DEBUG nova.compute.manager [req-979b6221-e06a-43b4-a05c-3c45f4dbc3ec req-8715e021-4895-4b70-9da0-d8ddc1a5e85a service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Refreshing instance network info cache due to event network-changed-016a6c69-a1ff-45f9-bc61-6b886fbeaea9. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:56:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-979b6221-e06a-43b4-a05c-3c45f4dbc3ec req-8715e021-4895-4b70-9da0-d8ddc1a5e85a service nova] Acquiring lock "refresh_cache-26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:56:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-979b6221-e06a-43b4-a05c-3c45f4dbc3ec req-8715e021-4895-4b70-9da0-d8ddc1a5e85a service nova] Acquired lock "refresh_cache-26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:56:16 user nova-compute[74996]: DEBUG nova.network.neutron [req-979b6221-e06a-43b4-a05c-3c45f4dbc3ec req-8715e021-4895-4b70-9da0-d8ddc1a5e85a service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Refreshing network info cache for port 016a6c69-a1ff-45f9-bc61-6b886fbeaea9 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:56:16 user nova-compute[74996]: DEBUG nova.network.neutron [req-979b6221-e06a-43b4-a05c-3c45f4dbc3ec req-8715e021-4895-4b70-9da0-d8ddc1a5e85a service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Updated VIF entry in instance network info cache for port 016a6c69-a1ff-45f9-bc61-6b886fbeaea9. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:56:16 user nova-compute[74996]: DEBUG nova.network.neutron [req-979b6221-e06a-43b4-a05c-3c45f4dbc3ec req-8715e021-4895-4b70-9da0-d8ddc1a5e85a service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Updating instance_info_cache with network_info: [{"id": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "address": "fa:16:3e:9f:76:66", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016a6c69-a1", "ovs_interfaceid": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:56:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-979b6221-e06a-43b4-a05c-3c45f4dbc3ec req-8715e021-4895-4b70-9da0-d8ddc1a5e85a service nova] Releasing lock "refresh_cache-26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:56:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:56:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:56:17 user nova-compute[74996]: INFO nova.compute.manager [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Detaching volume 73e6dc34-c59d-4469-b2c4-0ba29df6b6c4
Nov 02 01:56:17 user nova-compute[74996]: INFO nova.virt.block_device [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Attempting to driver detach volume 73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 from mountpoint /dev/vdb
Nov 02 01:56:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Attempting to detach device vdb from instance 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 01:56:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 01:56:17 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:56:17 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 01:56:17 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:56:17 user nova-compute[74996]:   <serial>73e6dc34-c59d-4469-b2c4-0ba29df6b6c4</serial>
Nov 02 01:56:17 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 01:56:17 user nova-compute[74996]: </disk>
Nov 02 01:56:17 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:56:17 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Successfully detached device vdb from instance 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea from the persistent domain config.
Nov 02 01:56:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea from the live domain config. {{(pid=74996) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 01:56:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 01:56:17 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:56:17 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 01:56:17 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:56:17 user nova-compute[74996]:   <serial>73e6dc34-c59d-4469-b2c4-0ba29df6b6c4</serial>
Nov 02 01:56:17 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 01:56:17 user nova-compute[74996]: </disk>
Nov 02 01:56:17 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 01:56:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea {{(pid=74996) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 01:56:18 user nova-compute[74996]: DEBUG nova.compute.manager [req-ba238d40-5cdd-4e5f-b862-7d0e34349ad2 req-7c69cb85-a52f-43e0-acf2-fd2ce6d0c868 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Received event network-changed-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:56:18 user nova-compute[74996]: DEBUG nova.compute.manager [req-ba238d40-5cdd-4e5f-b862-7d0e34349ad2 req-7c69cb85-a52f-43e0-acf2-fd2ce6d0c868 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Refreshing instance network info cache due to event network-changed-016a6c69-a1ff-45f9-bc61-6b886fbeaea9. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:56:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ba238d40-5cdd-4e5f-b862-7d0e34349ad2 req-7c69cb85-a52f-43e0-acf2-fd2ce6d0c868 service nova] Acquiring lock "refresh_cache-26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:56:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ba238d40-5cdd-4e5f-b862-7d0e34349ad2 req-7c69cb85-a52f-43e0-acf2-fd2ce6d0c868 service nova] Acquired lock "refresh_cache-26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:56:18 user nova-compute[74996]: DEBUG nova.network.neutron [req-ba238d40-5cdd-4e5f-b862-7d0e34349ad2 req-7c69cb85-a52f-43e0-acf2-fd2ce6d0c868 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Refreshing network info cache for port 016a6c69-a1ff-45f9-bc61-6b886fbeaea9 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:56:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:56:18 user nova-compute[74996]: DEBUG nova.network.neutron [req-ba238d40-5cdd-4e5f-b862-7d0e34349ad2 req-7c69cb85-a52f-43e0-acf2-fd2ce6d0c868 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Updated VIF entry in instance network info cache for port 016a6c69-a1ff-45f9-bc61-6b886fbeaea9. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:56:18 user nova-compute[74996]: DEBUG nova.network.neutron [req-ba238d40-5cdd-4e5f-b862-7d0e34349ad2 req-7c69cb85-a52f-43e0-acf2-fd2ce6d0c868 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Updating instance_info_cache with network_info: [{"id": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "address": "fa:16:3e:9f:76:66", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016a6c69-a1", "ovs_interfaceid": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:56:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ba238d40-5cdd-4e5f-b862-7d0e34349ad2 req-7c69cb85-a52f-43e0-acf2-fd2ce6d0c868 service nova] Releasing lock "refresh_cache-26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:56:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:56:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:56:28 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:56:28 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:56:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:56:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:56:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:56:28 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:56:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:56:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:30 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:56:30 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:56:30 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8276MB free_disk=24.976760864257812GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:56:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:56:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:56:31 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance e38704a7-f8a0-482c-bd51-26a90d37b71d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:56:31 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7c53e6cc-cf69-485d-b24f-5e113dae0e5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:56:31 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:56:31 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 6fed89e8-a427-4e00-8bba-144dedc9ab1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:56:31 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 27863b45-4dda-4f6d-bd6f-0f332f1fdd52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:56:31 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:56:31 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:56:31 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Refreshing inventories for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 01:56:31 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Updating ProviderTree inventory for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 01:56:31 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Updating inventory in ProviderTree for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 01:56:31 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Refreshing aggregate associations for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259, aggregates: None {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 01:56:31 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Refreshing trait associations for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 01:56:31 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:56:31 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:56:31 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:56:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.472s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:56:32 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:56:32 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:56:34 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:56:34 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:56:34 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Didn't find any instances for network info cache update. {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 01:56:34 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:56:34 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:56:34 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:56:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:56:37 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea is timed out.
Nov 02 01:56:37 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Successfully detached device vdb from instance 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea from the live domain config.
Nov 02 01:56:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANIRezLT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:56:37 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:56:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2df3de3-2a89-49a1-b89e-0e9c5c9048cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 01:56:37 user nova-compute[74996]: No targets found.
Nov 02 01:56:37 user nova-compute[74996]: iSNS:
Nov 02 01:56:37 user nova-compute[74996]: No targets found.
Nov 02 01:56:37 user nova-compute[74996]: STATIC:
Nov 02 01:56:37 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4
Nov 02 01:56:37 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 01:56:37 user nova-compute[74996]:                 Iface Name: default
Nov 02 01:56:37 user nova-compute[74996]: FIRMWARE:
Nov 02 01:56:37 user nova-compute[74996]: No targets found.
Nov 02 01:56:37 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 01:56:37 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 01:56:37 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d6cba8-ea0a-4879-9c96-8f138b22f97d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad5ce35-e4c2-4da5-97bb-2af5cf5e5bfb]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 (non-flash)
Nov 02 01:56:37 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 (non-flash)
Nov 02 01:56:37 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e852eef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4'): ({'sdc'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Removing single pathed devices sdc {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[150892d7-b50d-47a4-9280-41faa3629290]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea888a0-fc42-4024-9f41-d79143ec699c]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Flushing IO for device /dev/sdc {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6825894-6fee-4cb4-8481-5b4b683060e0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35fa32d-5e6c-44e7-878f-483ff3654f47]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72afeb9-12cb-4ad4-a389-a786138d6bbc]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[913b6fea-ee5e-492e-9d28-49f7a46a17d2]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4, portal: 172.16.0.220,3260]
Nov 02 01:56:37 user nova-compute[74996]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4, portal: 172.16.0.220,3260] successful.
Nov 02 01:56:37 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e6dc34-c59d-4469-b2c4-0ba29df6b6c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d83bf4-7c03-419e-81be-289a51b01bae]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] <== disconnect_volume: return (314ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:56:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 01:56:38 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:56:38 user nova-compute[74996]: DEBUG nova.objects.instance [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lazy-loading 'flavor' on Instance uuid 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:56:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-b1a6c0ae-588d-4ba9-a135-30ecde42538c tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.874s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:56:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:56:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:56:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:56:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:56:53 user nova-compute[74996]: DEBUG nova.compute.manager [req-d14e8667-5d1b-4923-85a5-0e994486adba req-fd1d1d2a-41c4-4608-9434-a8d80ea7b2d6 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Received event network-changed-ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:56:53 user nova-compute[74996]: DEBUG nova.compute.manager [req-d14e8667-5d1b-4923-85a5-0e994486adba req-fd1d1d2a-41c4-4608-9434-a8d80ea7b2d6 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Refreshing instance network info cache due to event network-changed-ef383fd9-4ffc-495b-ab4f-732f933a0391. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:56:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d14e8667-5d1b-4923-85a5-0e994486adba req-fd1d1d2a-41c4-4608-9434-a8d80ea7b2d6 service nova] Acquiring lock "refresh_cache-6fed89e8-a427-4e00-8bba-144dedc9ab1c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:56:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d14e8667-5d1b-4923-85a5-0e994486adba req-fd1d1d2a-41c4-4608-9434-a8d80ea7b2d6 service nova] Acquired lock "refresh_cache-6fed89e8-a427-4e00-8bba-144dedc9ab1c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:56:53 user nova-compute[74996]: DEBUG nova.network.neutron [req-d14e8667-5d1b-4923-85a5-0e994486adba req-fd1d1d2a-41c4-4608-9434-a8d80ea7b2d6 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Refreshing network info cache for port ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:56:53 user nova-compute[74996]: DEBUG nova.network.neutron [req-d14e8667-5d1b-4923-85a5-0e994486adba req-fd1d1d2a-41c4-4608-9434-a8d80ea7b2d6 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Updated VIF entry in instance network info cache for port ef383fd9-4ffc-495b-ab4f-732f933a0391. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:56:53 user nova-compute[74996]: DEBUG nova.network.neutron [req-d14e8667-5d1b-4923-85a5-0e994486adba req-fd1d1d2a-41c4-4608-9434-a8d80ea7b2d6 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Updating instance_info_cache with network_info: [{"id": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "address": "fa:16:3e:02:47:7a", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef383fd9-4f", "ovs_interfaceid": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:56:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d14e8667-5d1b-4923-85a5-0e994486adba req-fd1d1d2a-41c4-4608-9434-a8d80ea7b2d6 service nova] Releasing lock "refresh_cache-6fed89e8-a427-4e00-8bba-144dedc9ab1c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:56:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:56:55 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:56:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:56:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:56:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:56:59 user nova-compute[74996]: INFO nova.compute.manager [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Shelving
Nov 02 01:56:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:56:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:56:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:56:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:00 user nova-compute[74996]: DEBUG nova.compute.manager [req-0287dcbd-afae-4023-a479-4ab81ae2c804 req-0139a915-7db9-41ea-88c6-d97cc3c5d2be service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Received event network-vif-unplugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:57:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0287dcbd-afae-4023-a479-4ab81ae2c804 req-0139a915-7db9-41ea-88c6-d97cc3c5d2be service nova] Acquiring lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:57:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0287dcbd-afae-4023-a479-4ab81ae2c804 req-0139a915-7db9-41ea-88c6-d97cc3c5d2be service nova] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:57:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0287dcbd-afae-4023-a479-4ab81ae2c804 req-0139a915-7db9-41ea-88c6-d97cc3c5d2be service nova] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:57:00 user nova-compute[74996]: DEBUG nova.compute.manager [req-0287dcbd-afae-4023-a479-4ab81ae2c804 req-0139a915-7db9-41ea-88c6-d97cc3c5d2be service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] No waiting events found dispatching network-vif-unplugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:57:00 user nova-compute[74996]: WARNING nova.compute.manager [req-0287dcbd-afae-4023-a479-4ab81ae2c804 req-0139a915-7db9-41ea-88c6-d97cc3c5d2be service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Received unexpected event network-vif-unplugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 for instance with vm_state active and task_state shelving.
Nov 02 01:57:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:00 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Instance destroyed successfully.
Nov 02 01:57:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:00 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Beginning cold snapshot process
Nov 02 01:57:00 user nova-compute[74996]: DEBUG nova.privsep.utils [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74996) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 01:57:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk /opt/stack/data/nova/instances/snapshots/tmpra2dolz1/7717456eba0c43c590ba8c215c33f4b3 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk /opt/stack/data/nova/instances/snapshots/tmpra2dolz1/7717456eba0c43c590ba8c215c33f4b3" returned: 0 in 0.727s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:01 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Snapshot extracted, beginning image upload
Nov 02 01:57:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:02 user nova-compute[74996]: DEBUG nova.compute.manager [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Received event network-vif-plugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:57:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] Acquiring lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:57:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:57:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:57:02 user nova-compute[74996]: DEBUG nova.compute.manager [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] No waiting events found dispatching network-vif-plugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:57:02 user nova-compute[74996]: WARNING nova.compute.manager [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Received unexpected event network-vif-plugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 for instance with vm_state active and task_state shelving_image_uploading.
Nov 02 01:57:02 user nova-compute[74996]: DEBUG nova.compute.manager [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Received event network-vif-plugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:57:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] Acquiring lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:57:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:57:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:57:02 user nova-compute[74996]: DEBUG nova.compute.manager [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] No waiting events found dispatching network-vif-plugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:57:02 user nova-compute[74996]: WARNING nova.compute.manager [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Received unexpected event network-vif-plugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 for instance with vm_state active and task_state shelving_image_uploading.
Nov 02 01:57:02 user nova-compute[74996]: DEBUG nova.compute.manager [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Received event network-vif-plugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:57:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] Acquiring lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:57:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:57:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:57:02 user nova-compute[74996]: DEBUG nova.compute.manager [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] No waiting events found dispatching network-vif-plugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:57:02 user nova-compute[74996]: WARNING nova.compute.manager [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Received unexpected event network-vif-plugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 for instance with vm_state active and task_state shelving_image_uploading.
Nov 02 01:57:02 user nova-compute[74996]: DEBUG nova.compute.manager [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Received event network-vif-unplugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:57:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] Acquiring lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:57:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:57:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:57:02 user nova-compute[74996]: DEBUG nova.compute.manager [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] No waiting events found dispatching network-vif-unplugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:57:02 user nova-compute[74996]: WARNING nova.compute.manager [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Received unexpected event network-vif-unplugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 for instance with vm_state active and task_state shelving_image_uploading.
Nov 02 01:57:02 user nova-compute[74996]: DEBUG nova.compute.manager [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Received event network-vif-plugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:57:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] Acquiring lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:57:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:57:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:57:02 user nova-compute[74996]: DEBUG nova.compute.manager [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] No waiting events found dispatching network-vif-plugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:57:02 user nova-compute[74996]: WARNING nova.compute.manager [req-5368ec2d-aace-49dc-b24c-1d7bbd58bb45 req-ccbc0520-58d9-4a0d-939a-3371f1984c15 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Received unexpected event network-vif-plugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 for instance with vm_state active and task_state shelving_image_uploading.
Nov 02 01:57:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:04 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Snapshot image upload complete
Nov 02 01:57:04 user nova-compute[74996]: DEBUG nova.compute.manager [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:57:04 user nova-compute[74996]: INFO nova.compute.manager [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Shelve offloading
Nov 02 01:57:04 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Instance destroyed successfully.
Nov 02 01:57:04 user nova-compute[74996]: DEBUG nova.compute.manager [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:57:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "refresh_cache-6fed89e8-a427-4e00-8bba-144dedc9ab1c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:57:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquired lock "refresh_cache-6fed89e8-a427-4e00-8bba-144dedc9ab1c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:57:04 user nova-compute[74996]: DEBUG nova.network.neutron [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:57:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:04 user nova-compute[74996]: DEBUG nova.network.neutron [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Updating instance_info_cache with network_info: [{"id": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "address": "fa:16:3e:02:47:7a", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef383fd9-4f", "ovs_interfaceid": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:57:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Releasing lock "refresh_cache-6fed89e8-a427-4e00-8bba-144dedc9ab1c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:57:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:06 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Instance destroyed successfully.
Nov 02 01:57:06 user nova-compute[74996]: DEBUG nova.objects.instance [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lazy-loading 'resources' on Instance uuid 6fed89e8-a427-4e00-8bba-144dedc9ab1c {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:57:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:55:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-818920333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-818920333',id=39,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJK2CwSeTpDLIUeMIBLT4PtH5q7fxUV7NAatQGrJ1Lx6MS+E+zjr3mfDsjIyZbP9qqId/6fWYkwaBc/CiiXBZnomBxbD6xFRQ8jZC0ANus4eCWyBhNbF1mQkIftWzwdyUw==',key_name='tempest-keypair-1113388504',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:55:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='22b862880e0c43ab8f5a4d65f6697955',ramdisk_id='',reservation_id='r-2s89a6k1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-701748724',owner_user_name='tempest-AttachVolumeShelveTestJSON-701748724-project-member',shelved_at='2023-11-02T01:57:04.119813',shelved_host='user',shelved_image_id='1badc747-d04b-4515-a7b4-b4c514d1f6c4'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:57:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01fc2ea044794374b09741ecaf841ba2',uuid=6fed89e8-a427-4e00-8bba-144dedc9ab1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "address": "fa:16:3e:02:47:7a", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef383fd9-4f", "ovs_interfaceid": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:57:06 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Converting VIF {"id": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "address": "fa:16:3e:02:47:7a", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef383fd9-4f", "ovs_interfaceid": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:57:06 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:47:7a,bridge_name='br-int',has_traffic_filtering=True,id=ef383fd9-4ffc-495b-ab4f-732f933a0391,network=Network(936a0e26-8a02-4c7c-9d24-acbb2f438cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef383fd9-4f') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:57:06 user nova-compute[74996]: DEBUG os_vif [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:47:7a,bridge_name='br-int',has_traffic_filtering=True,id=ef383fd9-4ffc-495b-ab4f-732f933a0391,network=Network(936a0e26-8a02-4c7c-9d24-acbb2f438cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef383fd9-4f') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:57:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef383fd9-4f, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:57:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:06 user nova-compute[74996]: DEBUG nova.compute.manager [req-62fb694b-dbf3-4591-9b9e-69c33716aff9 req-62d68ca7-132a-493d-889c-509ba00f9585 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Received event network-changed-ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:57:06 user nova-compute[74996]: DEBUG nova.compute.manager [req-62fb694b-dbf3-4591-9b9e-69c33716aff9 req-62d68ca7-132a-493d-889c-509ba00f9585 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Refreshing instance network info cache due to event network-changed-ef383fd9-4ffc-495b-ab4f-732f933a0391. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:57:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-62fb694b-dbf3-4591-9b9e-69c33716aff9 req-62d68ca7-132a-493d-889c-509ba00f9585 service nova] Acquiring lock "refresh_cache-6fed89e8-a427-4e00-8bba-144dedc9ab1c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:57:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-62fb694b-dbf3-4591-9b9e-69c33716aff9 req-62d68ca7-132a-493d-889c-509ba00f9585 service nova] Acquired lock "refresh_cache-6fed89e8-a427-4e00-8bba-144dedc9ab1c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:57:06 user nova-compute[74996]: DEBUG nova.network.neutron [req-62fb694b-dbf3-4591-9b9e-69c33716aff9 req-62d68ca7-132a-493d-889c-509ba00f9585 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Refreshing network info cache for port ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:57:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:57:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f6fa6fe-0359-442c-9650-3310d68f2a12) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:57:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:57:06 user nova-compute[74996]: INFO os_vif [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:47:7a,bridge_name='br-int',has_traffic_filtering=True,id=ef383fd9-4ffc-495b-ab4f-732f933a0391,network=Network(936a0e26-8a02-4c7c-9d24-acbb2f438cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef383fd9-4f')
Nov 02 01:57:06 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Deleting instance files /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c_del
Nov 02 01:57:06 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Deletion of /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c_del complete
Nov 02 01:57:06 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Deleted allocations for instance 6fed89e8-a427-4e00-8bba-144dedc9ab1c
Nov 02 01:57:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:57:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:57:06 user nova-compute[74996]: DEBUG nova.objects.instance [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lazy-loading 'numa_topology' on Instance uuid 6fed89e8-a427-4e00-8bba-144dedc9ab1c {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:57:06 user nova-compute[74996]: DEBUG nova.objects.base [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Object Instance<6fed89e8-a427-4e00-8bba-144dedc9ab1c> lazy-loaded attributes: resources,numa_topology {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:57:06 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:57:06 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:57:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.209s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:57:06 user nova-compute[74996]: DEBUG nova.network.neutron [req-62fb694b-dbf3-4591-9b9e-69c33716aff9 req-62d68ca7-132a-493d-889c-509ba00f9585 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Updated VIF entry in instance network info cache for port ef383fd9-4ffc-495b-ab4f-732f933a0391. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:57:06 user nova-compute[74996]: DEBUG nova.network.neutron [req-62fb694b-dbf3-4591-9b9e-69c33716aff9 req-62d68ca7-132a-493d-889c-509ba00f9585 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Updating instance_info_cache with network_info: [{"id": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "address": "fa:16:3e:02:47:7a", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapef383fd9-4f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:57:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-62fb694b-dbf3-4591-9b9e-69c33716aff9 req-62d68ca7-132a-493d-889c-509ba00f9585 service nova] Releasing lock "refresh_cache-6fed89e8-a427-4e00-8bba-144dedc9ab1c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:57:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4a3c23e4-d69f-4021-90ba-ab1108c96687 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.720s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:57:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:16 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-09b05e6b-e001-4169-9e53-aca370e06013 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-09b05e6b-e001-4169-9e53-aca370e06013 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-09b05e6b-e001-4169-9e53-aca370e06013 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-09b05e6b-e001-4169-9e53-aca370e06013 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-09b05e6b-e001-4169-9e53-aca370e06013 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:57:17 user nova-compute[74996]: INFO nova.compute.manager [None req-09b05e6b-e001-4169-9e53-aca370e06013 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Terminating instance
Nov 02 01:57:17 user nova-compute[74996]: DEBUG nova.compute.manager [None req-09b05e6b-e001-4169-9e53-aca370e06013 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG nova.compute.manager [req-af33e982-258c-4f1d-9862-74c1628dbf03 req-6ec83c23-03e8-4239-9a1b-481ca4fe0e0f service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Received event network-vif-unplugged-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-af33e982-258c-4f1d-9862-74c1628dbf03 req-6ec83c23-03e8-4239-9a1b-481ca4fe0e0f service nova] Acquiring lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-af33e982-258c-4f1d-9862-74c1628dbf03 req-6ec83c23-03e8-4239-9a1b-481ca4fe0e0f service nova] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-af33e982-258c-4f1d-9862-74c1628dbf03 req-6ec83c23-03e8-4239-9a1b-481ca4fe0e0f service nova] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG nova.compute.manager [req-af33e982-258c-4f1d-9862-74c1628dbf03 req-6ec83c23-03e8-4239-9a1b-481ca4fe0e0f service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] No waiting events found dispatching network-vif-unplugged-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG nova.compute.manager [req-af33e982-258c-4f1d-9862-74c1628dbf03 req-6ec83c23-03e8-4239-9a1b-481ca4fe0e0f service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Received event network-vif-unplugged-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 01:57:17 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Instance destroyed successfully.
Nov 02 01:57:17 user nova-compute[74996]: DEBUG nova.objects.instance [None req-09b05e6b-e001-4169-9e53-aca370e06013 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lazy-loading 'resources' on Instance uuid 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-09b05e6b-e001-4169-9e53-aca370e06013 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:51:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1075914983',display_name='tempest-TestMinimumBasicScenario-server-1075914983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1075914983',id=37,image_ref='ea004395-87cf-4a65-b2c3-d7209fe6de54',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMvrpfr8DB7QKESZzs371DYHVWv6Cr8QRChW6oecJXHRRCF4YAmNE7fPnrko7Qfal8r86tFHqOSMirgo7DE2B0Ycg1rGJucHkjJ/UjAecASQQZ+T2IhJlejkDf09HPCPQ==',key_name='tempest-TestMinimumBasicScenario-341687183',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:51:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be09717763f448b5a5d1a1e5f62e289b',ramdisk_id='',reservation_id='r-c22faqut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ea004395-87cf-4a65-b2c3-d7209fe6de54',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1426618310',owner_user_name='tempest-TestMinimumBasicScenario-1426618310-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:54:32Z,user_data=None,user_id='e7d9a6e0ced84500aab9759d009f0a49',uuid=26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "address": "fa:16:3e:9f:76:66", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016a6c69-a1", "ovs_interfaceid": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-09b05e6b-e001-4169-9e53-aca370e06013 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Converting VIF {"id": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "address": "fa:16:3e:9f:76:66", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016a6c69-a1", "ovs_interfaceid": "016a6c69-a1ff-45f9-bc61-6b886fbeaea9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-09b05e6b-e001-4169-9e53-aca370e06013 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:76:66,bridge_name='br-int',has_traffic_filtering=True,id=016a6c69-a1ff-45f9-bc61-6b886fbeaea9,network=Network(ab25d1c6-cd19-42dd-abe2-cb20978f06e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap016a6c69-a1') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG os_vif [None req-09b05e6b-e001-4169-9e53-aca370e06013 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:76:66,bridge_name='br-int',has_traffic_filtering=True,id=016a6c69-a1ff-45f9-bc61-6b886fbeaea9,network=Network(ab25d1c6-cd19-42dd-abe2-cb20978f06e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap016a6c69-a1') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap016a6c69-a1, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7dea93fc-206b-42cf-907a-b99b96929fcc) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:17 user nova-compute[74996]: INFO os_vif [None req-09b05e6b-e001-4169-9e53-aca370e06013 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:76:66,bridge_name='br-int',has_traffic_filtering=True,id=016a6c69-a1ff-45f9-bc61-6b886fbeaea9,network=Network(ab25d1c6-cd19-42dd-abe2-cb20978f06e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap016a6c69-a1')
Nov 02 01:57:17 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-09b05e6b-e001-4169-9e53-aca370e06013 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Deleting instance files /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea_del
Nov 02 01:57:17 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-09b05e6b-e001-4169-9e53-aca370e06013 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Deletion of /opt/stack/data/nova/instances/26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea_del complete
Nov 02 01:57:17 user nova-compute[74996]: INFO nova.compute.manager [None req-09b05e6b-e001-4169-9e53-aca370e06013 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 02 01:57:17 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-09b05e6b-e001-4169-9e53-aca370e06013 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 01:57:17 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 01:57:18 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:57:18 user nova-compute[74996]: DEBUG nova.compute.manager [req-f98b9ba3-7fd1-4a5d-bce8-53bb98442928 req-16a0c927-94bf-487e-b8de-690e4c5c70f3 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Received event network-vif-deleted-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:57:18 user nova-compute[74996]: INFO nova.compute.manager [req-f98b9ba3-7fd1-4a5d-bce8-53bb98442928 req-16a0c927-94bf-487e-b8de-690e4c5c70f3 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Neutron deleted interface 016a6c69-a1ff-45f9-bc61-6b886fbeaea9; detaching it from the instance and deleting it from the info cache
Nov 02 01:57:18 user nova-compute[74996]: DEBUG nova.network.neutron [req-f98b9ba3-7fd1-4a5d-bce8-53bb98442928 req-16a0c927-94bf-487e-b8de-690e4c5c70f3 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:57:18 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Took 0.81 seconds to deallocate network for instance.
Nov 02 01:57:18 user nova-compute[74996]: DEBUG nova.compute.manager [req-f98b9ba3-7fd1-4a5d-bce8-53bb98442928 req-16a0c927-94bf-487e-b8de-690e4c5c70f3 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Detach interface failed, port_id=016a6c69-a1ff-45f9-bc61-6b886fbeaea9, reason: Instance 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea could not be found. {{(pid=74996) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 01:57:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-09b05e6b-e001-4169-9e53-aca370e06013 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:57:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-09b05e6b-e001-4169-9e53-aca370e06013 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:57:19 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-09b05e6b-e001-4169-9e53-aca370e06013 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:57:19 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-09b05e6b-e001-4169-9e53-aca370e06013 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:57:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-09b05e6b-e001-4169-9e53-aca370e06013 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:57:19 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-09b05e6b-e001-4169-9e53-aca370e06013 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Deleted allocations for instance 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea
Nov 02 01:57:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-09b05e6b-e001-4169-9e53-aca370e06013 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.052s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:57:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:19 user nova-compute[74996]: DEBUG nova.compute.manager [req-43edc9c4-44d7-4be1-aa6f-0b84d7b1c97b req-d98feb13-d221-479d-8e0c-4f0581ab6744 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Received event network-vif-plugged-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:57:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-43edc9c4-44d7-4be1-aa6f-0b84d7b1c97b req-d98feb13-d221-479d-8e0c-4f0581ab6744 service nova] Acquiring lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:57:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-43edc9c4-44d7-4be1-aa6f-0b84d7b1c97b req-d98feb13-d221-479d-8e0c-4f0581ab6744 service nova] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:57:19 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-43edc9c4-44d7-4be1-aa6f-0b84d7b1c97b req-d98feb13-d221-479d-8e0c-4f0581ab6744 service nova] Lock "26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:57:19 user nova-compute[74996]: DEBUG nova.compute.manager [req-43edc9c4-44d7-4be1-aa6f-0b84d7b1c97b req-d98feb13-d221-479d-8e0c-4f0581ab6744 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] No waiting events found dispatching network-vif-plugged-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:57:19 user nova-compute[74996]: WARNING nova.compute.manager [req-43edc9c4-44d7-4be1-aa6f-0b84d7b1c97b req-d98feb13-d221-479d-8e0c-4f0581ab6744 service nova] [instance: 26d1f38e-f54c-42ca-b1b8-bbcd9a7a3cea] Received unexpected event network-vif-plugged-016a6c69-a1ff-45f9-bc61-6b886fbeaea9 for instance with vm_state deleted and task_state None.
Nov 02 01:57:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:29 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:57:30 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:57:30 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:57:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:57:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:57:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:57:30 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:57:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:32 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:57:32 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:57:32 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8551MB free_disk=24.97216033935547GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:57:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:57:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:57:32 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance e38704a7-f8a0-482c-bd51-26a90d37b71d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:57:32 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7c53e6cc-cf69-485d-b24f-5e113dae0e5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:57:32 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 27863b45-4dda-4f6d-bd6f-0f332f1fdd52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:57:32 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:57:32 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:57:32 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:57:32 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:57:32 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:57:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.249s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:57:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-9bd640a9-fee3-46e4-945b-a7fef2563431 req-93c788a6-f6a8-42e7-bdf0-f59a22330857 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Received event network-changed-9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-9bd640a9-fee3-46e4-945b-a7fef2563431 req-93c788a6-f6a8-42e7-bdf0-f59a22330857 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Refreshing instance network info cache due to event network-changed-9ffa33b3-7d4c-484c-834b-60c2f888b540. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9bd640a9-fee3-46e4-945b-a7fef2563431 req-93c788a6-f6a8-42e7-bdf0-f59a22330857 service nova] Acquiring lock "refresh_cache-27863b45-4dda-4f6d-bd6f-0f332f1fdd52" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9bd640a9-fee3-46e4-945b-a7fef2563431 req-93c788a6-f6a8-42e7-bdf0-f59a22330857 service nova] Acquired lock "refresh_cache-27863b45-4dda-4f6d-bd6f-0f332f1fdd52" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG nova.network.neutron [req-9bd640a9-fee3-46e4-945b-a7fef2563431 req-93c788a6-f6a8-42e7-bdf0-f59a22330857 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Refreshing network info cache for port 9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG nova.objects.instance [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lazy-loading 'flavor' on Instance uuid 27863b45-4dda-4f6d-bd6f-0f332f1fdd52 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG nova.network.neutron [req-9bd640a9-fee3-46e4-945b-a7fef2563431 req-93c788a6-f6a8-42e7-bdf0-f59a22330857 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Updated VIF entry in instance network info cache for port 9ffa33b3-7d4c-484c-834b-60c2f888b540. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG nova.network.neutron [req-9bd640a9-fee3-46e4-945b-a7fef2563431 req-93c788a6-f6a8-42e7-bdf0-f59a22330857 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Updating instance_info_cache with network_info: [{"id": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "address": "fa:16:3e:2e:f5:1b", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa33b3-7d", "ovs_interfaceid": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:57:33 user nova-compute[74996]: INFO nova.compute.manager [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Attaching volume a39d6caa-314c-4622-a23b-7234fbab3348 to /dev/vdb
Nov 02 01:57:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9bd640a9-fee3-46e4-945b-a7fef2563431 req-93c788a6-f6a8-42e7-bdf0-f59a22330857 service nova] Releasing lock "refresh_cache-27863b45-4dda-4f6d-bd6f-0f332f1fdd52" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG os_brick.utils [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[010b507e-0bba-4a87-b86c-1436694cfa6a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc5ffe8-6c27-4be0-9511-53ffe2bf28d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[334dd531-a73a-4c68-b8c1-a3234bc5de09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be194a2-b5d0-43bc-b90a-562fe8b0861d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:57:33 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:57:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcbe7fe-4197-4902-87de-909cc31f1a18]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG os_brick.utils [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:57:33 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Updating existing volume attachment record: eebf8cab-00b6-4a55-b30b-81f06d1f273b {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:57:34 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:57:34 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:57:34 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Rebuilding the list of instances to heal {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 01:57:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-e38704a7-f8a0-482c-bd51-26a90d37b71d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:57:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-e38704a7-f8a0-482c-bd51-26a90d37b71d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:57:34 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 01:57:34 user nova-compute[74996]: DEBUG nova.objects.instance [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lazy-loading 'info_cache' on Instance uuid e38704a7-f8a0-482c-bd51-26a90d37b71d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:57:34 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Updating instance_info_cache with network_info: [{"id": "b5d6eb99-a00c-4440-98d6-6432b493f131", "address": "fa:16:3e:67:64:10", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d6eb99-a0", "ovs_interfaceid": "b5d6eb99-a00c-4440-98d6-6432b493f131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:57:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-e38704a7-f8a0-482c-bd51-26a90d37b71d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:57:34 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 01:57:35 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:57:35 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:57:36 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:57:37 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:57:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:38 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:57:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:57:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:57:45 user nova-compute[74996]: DEBUG nova.compute.manager [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:57:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:57:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:57:45 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:57:45 user nova-compute[74996]: INFO nova.compute.claims [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Claim successful on node user
Nov 02 01:57:45 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:57:45 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:57:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.300s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:57:45 user nova-compute[74996]: DEBUG nova.compute.manager [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:57:45 user nova-compute[74996]: DEBUG nova.compute.manager [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:57:45 user nova-compute[74996]: DEBUG nova.network.neutron [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:57:45 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:57:45 user nova-compute[74996]: DEBUG nova.compute.manager [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:57:45 user nova-compute[74996]: DEBUG nova.policy [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a32baeba9e0491392e9bd9475b1dddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ca9cd14604f619cc269252bdc0983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:57:46 user nova-compute[74996]: DEBUG nova.compute.manager [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:57:46 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:57:46 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Creating image(s)
Nov 02 01:57:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "/opt/stack/data/nova/instances/e460e58e-e7c4-43de-a3b1-efa37430b0c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:57:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "/opt/stack/data/nova/instances/e460e58e-e7c4-43de-a3b1-efa37430b0c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:57:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "/opt/stack/data/nova/instances/e460e58e-e7c4-43de-a3b1-efa37430b0c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:57:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.186s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:57:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:57:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.169s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/e460e58e-e7c4-43de-a3b1-efa37430b0c4/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/e460e58e-e7c4-43de-a3b1-efa37430b0c4/disk 1073741824" returned: 0 in 0.056s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:57:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:46 user nova-compute[74996]: DEBUG nova.network.neutron [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Successfully created port: 8b4a0277-bb35-4b8c-a16d-26b237e17258 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:57:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.210s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:46 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e460e58e-e7c4-43de-a3b1-efa37430b0c4/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:57:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e460e58e-e7c4-43de-a3b1-efa37430b0c4/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e460e58e-e7c4-43de-a3b1-efa37430b0c4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:46 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Cannot resize image /opt/stack/data/nova/instances/e460e58e-e7c4-43de-a3b1-efa37430b0c4/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:57:46 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:57:46 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Ensure instance console log exists: /opt/stack/data/nova/instances/e460e58e-e7c4-43de-a3b1-efa37430b0c4/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:57:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:57:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:57:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.network.neutron [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Successfully updated port: 8b4a0277-bb35-4b8c-a16d-26b237e17258 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "refresh_cache-e460e58e-e7c4-43de-a3b1-efa37430b0c4" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquired lock "refresh_cache-e460e58e-e7c4-43de-a3b1-efa37430b0c4" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.network.neutron [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.compute.manager [req-e947e75f-725d-4de3-a092-e237e16a4e52 req-5301ef5e-0685-4477-9432-3bc10ecc3815 service nova] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Received event network-changed-8b4a0277-bb35-4b8c-a16d-26b237e17258 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.compute.manager [req-e947e75f-725d-4de3-a092-e237e16a4e52 req-5301ef5e-0685-4477-9432-3bc10ecc3815 service nova] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Refreshing instance network info cache due to event network-changed-8b4a0277-bb35-4b8c-a16d-26b237e17258. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-e947e75f-725d-4de3-a092-e237e16a4e52 req-5301ef5e-0685-4477-9432-3bc10ecc3815 service nova] Acquiring lock "refresh_cache-e460e58e-e7c4-43de-a3b1-efa37430b0c4" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.network.neutron [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.network.neutron [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Updating instance_info_cache with network_info: [{"id": "8b4a0277-bb35-4b8c-a16d-26b237e17258", "address": "fa:16:3e:3f:9d:1c", "network": {"id": "5d5d58ab-0d25-4d7e-b535-857923f4a7a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1163860226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "971ca9cd14604f619cc269252bdc0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4a0277-bb", "ovs_interfaceid": "8b4a0277-bb35-4b8c-a16d-26b237e17258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Releasing lock "refresh_cache-e460e58e-e7c4-43de-a3b1-efa37430b0c4" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.compute.manager [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Instance network_info: |[{"id": "8b4a0277-bb35-4b8c-a16d-26b237e17258", "address": "fa:16:3e:3f:9d:1c", "network": {"id": "5d5d58ab-0d25-4d7e-b535-857923f4a7a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1163860226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "971ca9cd14604f619cc269252bdc0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4a0277-bb", "ovs_interfaceid": "8b4a0277-bb35-4b8c-a16d-26b237e17258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-e947e75f-725d-4de3-a092-e237e16a4e52 req-5301ef5e-0685-4477-9432-3bc10ecc3815 service nova] Acquired lock "refresh_cache-e460e58e-e7c4-43de-a3b1-efa37430b0c4" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.network.neutron [req-e947e75f-725d-4de3-a092-e237e16a4e52 req-5301ef5e-0685-4477-9432-3bc10ecc3815 service nova] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Refreshing network info cache for port 8b4a0277-bb35-4b8c-a16d-26b237e17258 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Start _get_guest_xml network_info=[{"id": "8b4a0277-bb35-4b8c-a16d-26b237e17258", "address": "fa:16:3e:3f:9d:1c", "network": {"id": "5d5d58ab-0d25-4d7e-b535-857923f4a7a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1163860226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "971ca9cd14604f619cc269252bdc0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4a0277-bb", "ovs_interfaceid": "8b4a0277-bb35-4b8c-a16d-26b237e17258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:57:47 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:57:47 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-648910713',display_name='tempest-VolumesSnapshotTestJSON-instance-648910713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-648910713',id=41,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4jKDT6KZdhZFque0ft1whvuBbBcCP57NihnfWPGwUhRP9wtabmLGomDfeTQmsnYTHMq3paIphp1FwBykVF2F/pGF8UhwzM9ortDGei22boIMIypPMKTRQGUxCQuAeIcA==',key_name='tempest-keypair-732424982',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='971ca9cd14604f619cc269252bdc0983',ramdisk_id='',reservation_id='r-cl50r292',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1059088146',owner_user_name='tempest-VolumesSnapshotTestJSON-1059088146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:57:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a32baeba9e0491392e9bd9475b1dddd',uuid=e460e58e-e7c4-43de-a3b1-efa37430b0c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b4a0277-bb35-4b8c-a16d-26b237e17258", "address": "fa:16:3e:3f:9d:1c", "network": {"id": "5d5d58ab-0d25-4d7e-b535-857923f4a7a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1163860226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "971ca9cd14604f619cc269252bdc0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4a0277-bb", "ovs_interfaceid": "8b4a0277-bb35-4b8c-a16d-26b237e17258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Converting VIF {"id": "8b4a0277-bb35-4b8c-a16d-26b237e17258", "address": "fa:16:3e:3f:9d:1c", "network": {"id": "5d5d58ab-0d25-4d7e-b535-857923f4a7a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1163860226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "971ca9cd14604f619cc269252bdc0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4a0277-bb", "ovs_interfaceid": "8b4a0277-bb35-4b8c-a16d-26b237e17258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:9d:1c,bridge_name='br-int',has_traffic_filtering=True,id=8b4a0277-bb35-4b8c-a16d-26b237e17258,network=Network(5d5d58ab-0d25-4d7e-b535-857923f4a7a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4a0277-bb') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.objects.instance [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lazy-loading 'pci_devices' on Instance uuid e460e58e-e7c4-43de-a3b1-efa37430b0c4 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:57:47 user nova-compute[74996]:   <uuid>e460e58e-e7c4-43de-a3b1-efa37430b0c4</uuid>
Nov 02 01:57:47 user nova-compute[74996]:   <name>instance-00000029</name>
Nov 02 01:57:47 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:57:47 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:57:47 user nova-compute[74996]:   <metadata>
Nov 02 01:57:47 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:57:47 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:57:47 user nova-compute[74996]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-648910713</nova:name>
Nov 02 01:57:47 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:57:47</nova:creationTime>
Nov 02 01:57:47 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:57:47 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:57:47 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:57:47 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:57:47 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:57:47 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:57:47 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:57:47 user nova-compute[74996]:       <nova:owner>
Nov 02 01:57:47 user nova-compute[74996]:         <nova:user uuid="7a32baeba9e0491392e9bd9475b1dddd">tempest-VolumesSnapshotTestJSON-1059088146-project-member</nova:user>
Nov 02 01:57:47 user nova-compute[74996]:         <nova:project uuid="971ca9cd14604f619cc269252bdc0983">tempest-VolumesSnapshotTestJSON-1059088146</nova:project>
Nov 02 01:57:47 user nova-compute[74996]:       </nova:owner>
Nov 02 01:57:47 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:57:47 user nova-compute[74996]:       <nova:ports>
Nov 02 01:57:47 user nova-compute[74996]:         <nova:port uuid="8b4a0277-bb35-4b8c-a16d-26b237e17258">
Nov 02 01:57:47 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 02 01:57:47 user nova-compute[74996]:         </nova:port>
Nov 02 01:57:47 user nova-compute[74996]:       </nova:ports>
Nov 02 01:57:47 user nova-compute[74996]:     </nova:instance>
Nov 02 01:57:47 user nova-compute[74996]:   </metadata>
Nov 02 01:57:47 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:57:47 user nova-compute[74996]:     <system>
Nov 02 01:57:47 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:57:47 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:57:47 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:57:47 user nova-compute[74996]:       <entry name="serial">e460e58e-e7c4-43de-a3b1-efa37430b0c4</entry>
Nov 02 01:57:47 user nova-compute[74996]:       <entry name="uuid">e460e58e-e7c4-43de-a3b1-efa37430b0c4</entry>
Nov 02 01:57:47 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:57:47 user nova-compute[74996]:     </system>
Nov 02 01:57:47 user nova-compute[74996]:   </sysinfo>
Nov 02 01:57:47 user nova-compute[74996]:   <os>
Nov 02 01:57:47 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:57:47 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:57:47 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:57:47 user nova-compute[74996]:   </os>
Nov 02 01:57:47 user nova-compute[74996]:   <features>
Nov 02 01:57:47 user nova-compute[74996]:     <acpi/>
Nov 02 01:57:47 user nova-compute[74996]:     <apic/>
Nov 02 01:57:47 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:57:47 user nova-compute[74996]:   </features>
Nov 02 01:57:47 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:57:47 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:57:47 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:57:47 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:57:47 user nova-compute[74996]:   </clock>
Nov 02 01:57:47 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:57:47 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:57:47 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:57:47 user nova-compute[74996]:   </cpu>
Nov 02 01:57:47 user nova-compute[74996]:   <devices>
Nov 02 01:57:47 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:57:47 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:57:47 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/e460e58e-e7c4-43de-a3b1-efa37430b0c4/disk"/>
Nov 02 01:57:47 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:57:47 user nova-compute[74996]:     </disk>
Nov 02 01:57:47 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:57:47 user nova-compute[74996]:       <mac address="fa:16:3e:3f:9d:1c"/>
Nov 02 01:57:47 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:57:47 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:57:47 user nova-compute[74996]:       <target dev="tap8b4a0277-bb"/>
Nov 02 01:57:47 user nova-compute[74996]:     </interface>
Nov 02 01:57:47 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:57:47 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/e460e58e-e7c4-43de-a3b1-efa37430b0c4/console.log" append="off"/>
Nov 02 01:57:47 user nova-compute[74996]:     </serial>
Nov 02 01:57:47 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:57:47 user nova-compute[74996]:     <video>
Nov 02 01:57:47 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:57:47 user nova-compute[74996]:     </video>
Nov 02 01:57:47 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:57:47 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:57:47 user nova-compute[74996]:     </rng>
Nov 02 01:57:47 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:57:47 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:57:47 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:57:47 user nova-compute[74996]:     </memballoon>
Nov 02 01:57:47 user nova-compute[74996]:   </devices>
Nov 02 01:57:47 user nova-compute[74996]: </domain>
Nov 02 01:57:47 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-648910713',display_name='tempest-VolumesSnapshotTestJSON-instance-648910713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-648910713',id=41,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4jKDT6KZdhZFque0ft1whvuBbBcCP57NihnfWPGwUhRP9wtabmLGomDfeTQmsnYTHMq3paIphp1FwBykVF2F/pGF8UhwzM9ortDGei22boIMIypPMKTRQGUxCQuAeIcA==',key_name='tempest-keypair-732424982',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='971ca9cd14604f619cc269252bdc0983',ramdisk_id='',reservation_id='r-cl50r292',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1059088146',owner_user_name='tempest-VolumesSnapshotTestJSON-1059088146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:57:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a32baeba9e0491392e9bd9475b1dddd',uuid=e460e58e-e7c4-43de-a3b1-efa37430b0c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b4a0277-bb35-4b8c-a16d-26b237e17258", "address": "fa:16:3e:3f:9d:1c", "network": {"id": "5d5d58ab-0d25-4d7e-b535-857923f4a7a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1163860226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "971ca9cd14604f619cc269252bdc0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4a0277-bb", "ovs_interfaceid": "8b4a0277-bb35-4b8c-a16d-26b237e17258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Converting VIF {"id": "8b4a0277-bb35-4b8c-a16d-26b237e17258", "address": "fa:16:3e:3f:9d:1c", "network": {"id": "5d5d58ab-0d25-4d7e-b535-857923f4a7a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1163860226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "971ca9cd14604f619cc269252bdc0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4a0277-bb", "ovs_interfaceid": "8b4a0277-bb35-4b8c-a16d-26b237e17258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:9d:1c,bridge_name='br-int',has_traffic_filtering=True,id=8b4a0277-bb35-4b8c-a16d-26b237e17258,network=Network(5d5d58ab-0d25-4d7e-b535-857923f4a7a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4a0277-bb') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG os_vif [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:9d:1c,bridge_name='br-int',has_traffic_filtering=True,id=8b4a0277-bb35-4b8c-a16d-26b237e17258,network=Network(5d5d58ab-0d25-4d7e-b535-857923f4a7a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4a0277-bb') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a6e5e8e9-79c0-51ae-8e1b-506bedd99ea2', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b4a0277-bb, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b4a0277-bb, col_values=(('qos', UUID('15b4030e-3f50-4840-a1e0-194bfcebf817')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b4a0277-bb, col_values=(('external_ids', {'iface-id': '8b4a0277-bb35-4b8c-a16d-26b237e17258', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:9d:1c', 'vm-uuid': 'e460e58e-e7c4-43de-a3b1-efa37430b0c4'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:47 user nova-compute[74996]: INFO os_vif [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:9d:1c,bridge_name='br-int',has_traffic_filtering=True,id=8b4a0277-bb35-4b8c-a16d-26b237e17258,network=Network(5d5d58ab-0d25-4d7e-b535-857923f4a7a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4a0277-bb')
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:57:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] No VIF found with MAC fa:16:3e:3f:9d:1c, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:57:48 user nova-compute[74996]: DEBUG nova.network.neutron [req-e947e75f-725d-4de3-a092-e237e16a4e52 req-5301ef5e-0685-4477-9432-3bc10ecc3815 service nova] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Updated VIF entry in instance network info cache for port 8b4a0277-bb35-4b8c-a16d-26b237e17258. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:57:48 user nova-compute[74996]: DEBUG nova.network.neutron [req-e947e75f-725d-4de3-a092-e237e16a4e52 req-5301ef5e-0685-4477-9432-3bc10ecc3815 service nova] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Updating instance_info_cache with network_info: [{"id": "8b4a0277-bb35-4b8c-a16d-26b237e17258", "address": "fa:16:3e:3f:9d:1c", "network": {"id": "5d5d58ab-0d25-4d7e-b535-857923f4a7a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1163860226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "971ca9cd14604f619cc269252bdc0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4a0277-bb", "ovs_interfaceid": "8b4a0277-bb35-4b8c-a16d-26b237e17258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:57:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-e947e75f-725d-4de3-a092-e237e16a4e52 req-5301ef5e-0685-4477-9432-3bc10ecc3815 service nova] Releasing lock "refresh_cache-e460e58e-e7c4-43de-a3b1-efa37430b0c4" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:57:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:49 user nova-compute[74996]: DEBUG nova.compute.manager [req-968ee3f7-185d-43e0-9925-48061e2c9c23 req-6e0bf840-b34a-4ed6-8e10-5af5d405dfe1 service nova] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Received event network-vif-plugged-8b4a0277-bb35-4b8c-a16d-26b237e17258 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:57:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-968ee3f7-185d-43e0-9925-48061e2c9c23 req-6e0bf840-b34a-4ed6-8e10-5af5d405dfe1 service nova] Acquiring lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:57:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-968ee3f7-185d-43e0-9925-48061e2c9c23 req-6e0bf840-b34a-4ed6-8e10-5af5d405dfe1 service nova] Lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:57:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-968ee3f7-185d-43e0-9925-48061e2c9c23 req-6e0bf840-b34a-4ed6-8e10-5af5d405dfe1 service nova] Lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:57:49 user nova-compute[74996]: DEBUG nova.compute.manager [req-968ee3f7-185d-43e0-9925-48061e2c9c23 req-6e0bf840-b34a-4ed6-8e10-5af5d405dfe1 service nova] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] No waiting events found dispatching network-vif-plugged-8b4a0277-bb35-4b8c-a16d-26b237e17258 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:57:49 user nova-compute[74996]: WARNING nova.compute.manager [req-968ee3f7-185d-43e0-9925-48061e2c9c23 req-6e0bf840-b34a-4ed6-8e10-5af5d405dfe1 service nova] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Received unexpected event network-vif-plugged-8b4a0277-bb35-4b8c-a16d-26b237e17258 for instance with vm_state building and task_state spawning.
Nov 02 01:57:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:51 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:57:51 user nova-compute[74996]: DEBUG nova.compute.manager [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:57:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:57:51 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Instance spawned successfully.
Nov 02 01:57:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:57:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:57:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:57:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:57:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:57:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:57:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:57:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-13521cc7-f9b1-408f-a35a-bec2ef6303ba req-a8a8ea4e-d7c7-4ba1-ac90-5036e525c563 service nova] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Received event network-vif-plugged-8b4a0277-bb35-4b8c-a16d-26b237e17258 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:57:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-13521cc7-f9b1-408f-a35a-bec2ef6303ba req-a8a8ea4e-d7c7-4ba1-ac90-5036e525c563 service nova] Acquiring lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:57:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-13521cc7-f9b1-408f-a35a-bec2ef6303ba req-a8a8ea4e-d7c7-4ba1-ac90-5036e525c563 service nova] Lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:57:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-13521cc7-f9b1-408f-a35a-bec2ef6303ba req-a8a8ea4e-d7c7-4ba1-ac90-5036e525c563 service nova] Lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:57:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-13521cc7-f9b1-408f-a35a-bec2ef6303ba req-a8a8ea4e-d7c7-4ba1-ac90-5036e525c563 service nova] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] No waiting events found dispatching network-vif-plugged-8b4a0277-bb35-4b8c-a16d-26b237e17258 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:57:51 user nova-compute[74996]: WARNING nova.compute.manager [req-13521cc7-f9b1-408f-a35a-bec2ef6303ba req-a8a8ea4e-d7c7-4ba1-ac90-5036e525c563 service nova] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Received unexpected event network-vif-plugged-8b4a0277-bb35-4b8c-a16d-26b237e17258 for instance with vm_state building and task_state spawning.
Nov 02 01:57:51 user nova-compute[74996]: INFO nova.compute.manager [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Took 5.34 seconds to spawn the instance on the hypervisor.
Nov 02 01:57:51 user nova-compute[74996]: DEBUG nova.compute.manager [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:57:51 user nova-compute[74996]: INFO nova.compute.manager [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Took 5.98 seconds to build instance.
Nov 02 01:57:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-74405e4f-07a3-431c-aa63-6b5ce43ff461 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.116s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:57:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FagKZchD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:57:53 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:57:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:57:53 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:57:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:57:53 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3847d4-edb2-4151-86a0-039682fe42e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:57:53 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e94f02-12c5-4e5d-ade5-56c371490edb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348] added
Nov 02 01:57:53 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9f2025-6ef2-4cb7-ac24-6a3a1e2f23da]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[38489970-99ad-4cc0-a21d-fba69c1667da]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FagKZchD {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FagKZchD" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a3bd1d-e6f0-498a-b5cb-83ec40bfd137]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FagKZchD'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4cbb4e-9f82-4008-8d28-648085187424]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68021ee-ebf8-4187-a1b4-e84bee986dc1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 01:57:53 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 01:57:53 user nova-compute[74996]:  {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:57:53 user nova-compute[74996]: WARNING os_brick.initiator.connectors.iscsi [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 01:57:53 user nova-compute[74996]: 
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[90991b17-e836-4a44-a4db-97c4ee195c0e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348, portal: 172.16.0.220,3260]
Nov 02 01:57:53 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348, portal: 172.16.0.220,3260] successful.
Nov 02 01:57:53 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e8503e-e597-4065-b0d0-505d88105c89]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9a8a32-c476-4f92-8a11-1bb734df80a5]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)
Nov 02 01:57:53 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)
Nov 02 01:57:53 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5268e1c5-4fb8-45bc-b730-edc69f39befb]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:57:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:54 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:57:54 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FagKZchD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:57:54 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:57:54 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23732313064663861', 'path': '/dev/sdb'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:57:54 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732313064663861', 'path': '/dev/sdb'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:57:54 user nova-compute[74996]: DEBUG nova.objects.instance [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lazy-loading 'flavor' on Instance uuid 27863b45-4dda-4f6d-bd6f-0f332f1fdd52 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:57:54 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 01:57:54 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:57:54 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 01:57:54 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:57:54 user nova-compute[74996]:   <serial>a39d6caa-314c-4622-a23b-7234fbab3348</serial>
Nov 02 01:57:54 user nova-compute[74996]: </disk>
Nov 02 01:57:54 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 01:57:54 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:57:54 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:57:54 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] No VIF found with MAC fa:16:3e:2e:f5:1b, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:57:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-fbb50b02-f2eb-44f5-895f-ce754d9f5461 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.586s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:57:55 user nova-compute[74996]: INFO nova.compute.manager [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Rescuing
Nov 02 01:57:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "refresh_cache-27863b45-4dda-4f6d-bd6f-0f332f1fdd52" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:57:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquired lock "refresh_cache-27863b45-4dda-4f6d-bd6f-0f332f1fdd52" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:57:55 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:57:55 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Updating instance_info_cache with network_info: [{"id": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "address": "fa:16:3e:2e:f5:1b", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa33b3-7d", "ovs_interfaceid": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:57:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Releasing lock "refresh_cache-27863b45-4dda-4f6d-bd6f-0f332f1fdd52" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:57:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:56 user nova-compute[74996]: DEBUG nova.compute.manager [req-2f7b7845-beb0-4b10-b8de-06174719a350 req-216566b0-b128-41d4-8654-65fb127b7394 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Received event network-vif-unplugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:57:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2f7b7845-beb0-4b10-b8de-06174719a350 req-216566b0-b128-41d4-8654-65fb127b7394 service nova] Acquiring lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:57:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2f7b7845-beb0-4b10-b8de-06174719a350 req-216566b0-b128-41d4-8654-65fb127b7394 service nova] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:57:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2f7b7845-beb0-4b10-b8de-06174719a350 req-216566b0-b128-41d4-8654-65fb127b7394 service nova] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:57:56 user nova-compute[74996]: DEBUG nova.compute.manager [req-2f7b7845-beb0-4b10-b8de-06174719a350 req-216566b0-b128-41d4-8654-65fb127b7394 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] No waiting events found dispatching network-vif-unplugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:57:56 user nova-compute[74996]: WARNING nova.compute.manager [req-2f7b7845-beb0-4b10-b8de-06174719a350 req-216566b0-b128-41d4-8654-65fb127b7394 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Received unexpected event network-vif-unplugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 for instance with vm_state active and task_state rescuing.
Nov 02 01:57:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:56 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Instance destroyed successfully.
Nov 02 01:57:56 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Attempting rescue
Nov 02 01:57:56 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74996) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 02 01:57:56 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Instance directory exists: not creating {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 02 01:57:56 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Creating image(s)
Nov 02 01:57:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "/opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:57:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "/opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:57:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "/opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:57:56 user nova-compute[74996]: DEBUG nova.objects.instance [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lazy-loading 'trusted_certs' on Instance uuid 27863b45-4dda-4f6d-bd6f-0f332f1fdd52 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:57:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:57:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:57:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.188s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk.rescue {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk.rescue" returned: 0 in 0.049s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.objects.instance [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lazy-loading 'migration_context' on Instance uuid 27863b45-4dda-4f6d-bd6f-0f332f1fdd52 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.objects.base [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Object Instance<27863b45-4dda-4f6d-bd6f-0f332f1fdd52> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Start _get_guest_xml network_info=[{"id": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "address": "fa:16:3e:2e:f5:1b", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "vif_mac": "fa:16:3e:2e:f5:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa33b3-7d", "ovs_interfaceid": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.objects.instance [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lazy-loading 'resources' on Instance uuid 27863b45-4dda-4f6d-bd6f-0f332f1fdd52 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.objects.base [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Object Instance<27863b45-4dda-4f6d-bd6f-0f332f1fdd52> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.objects.instance [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lazy-loading 'numa_topology' on Instance uuid 27863b45-4dda-4f6d-bd6f-0f332f1fdd52 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.objects.base [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Object Instance<27863b45-4dda-4f6d-bd6f-0f332f1fdd52> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:57:57 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:57:57 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.objects.instance [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lazy-loading 'vcpu_model' on Instance uuid 27863b45-4dda-4f6d-bd6f-0f332f1fdd52 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.objects.base [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Object Instance<27863b45-4dda-4f6d-bd6f-0f332f1fdd52> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:55:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1987643853',display_name='tempest-ServerRescueNegativeTestJSON-server-1987643853',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1987643853',id=40,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKheu8wiqdlC3hH3OAEdws9kSpyqPO541Zoa8GP80tBYxiXZ24s0YcE15PIexh9WjlPW0xLXSXW4RQU/f4sL5hr1y0f0ZWs+SVjjxo1F9di75eqRJG50AOSZORve8JSc/A==',key_name='tempest-keypair-2071253473',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:55:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d89083c24ba475f9159a80fddfe9159',ramdisk_id='',reservation_id='r-v8max6zc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1433266011',owner_user_name='tempest-ServerRescueNegativeTestJSON-1433266011-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:55:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87e5cf8786fe44b5a5305f3be11d64c2',uuid=27863b45-4dda-4f6d-bd6f-0f332f1fdd52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "address": "fa:16:3e:2e:f5:1b", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "vif_mac": "fa:16:3e:2e:f5:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa33b3-7d", "ovs_interfaceid": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Converting VIF {"id": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "address": "fa:16:3e:2e:f5:1b", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "vif_mac": "fa:16:3e:2e:f5:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa33b3-7d", "ovs_interfaceid": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:f5:1b,bridge_name='br-int',has_traffic_filtering=True,id=9ffa33b3-7d4c-484c-834b-60c2f888b540,network=Network(81a443a7-0a10-4c81-9903-853291c58596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ffa33b3-7d') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.objects.instance [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lazy-loading 'pci_devices' on Instance uuid 27863b45-4dda-4f6d-bd6f-0f332f1fdd52 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.objects.base [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Object Instance<27863b45-4dda-4f6d-bd6f-0f332f1fdd52> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:57:57 user nova-compute[74996]:   <uuid>27863b45-4dda-4f6d-bd6f-0f332f1fdd52</uuid>
Nov 02 01:57:57 user nova-compute[74996]:   <name>instance-00000028</name>
Nov 02 01:57:57 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:57:57 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:57:57 user nova-compute[74996]:   <metadata>
Nov 02 01:57:57 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:57:57 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:57:57 user nova-compute[74996]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1987643853</nova:name>
Nov 02 01:57:57 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:57:57</nova:creationTime>
Nov 02 01:57:57 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:57:57 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:57:57 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:57:57 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:57:57 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:57:57 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:57:57 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:57:57 user nova-compute[74996]:       <nova:owner>
Nov 02 01:57:57 user nova-compute[74996]:         <nova:user uuid="87e5cf8786fe44b5a5305f3be11d64c2">tempest-ServerRescueNegativeTestJSON-1433266011-project-member</nova:user>
Nov 02 01:57:57 user nova-compute[74996]:         <nova:project uuid="6d89083c24ba475f9159a80fddfe9159">tempest-ServerRescueNegativeTestJSON-1433266011</nova:project>
Nov 02 01:57:57 user nova-compute[74996]:       </nova:owner>
Nov 02 01:57:57 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:57:57 user nova-compute[74996]:       <nova:ports>
Nov 02 01:57:57 user nova-compute[74996]:         <nova:port uuid="9ffa33b3-7d4c-484c-834b-60c2f888b540">
Nov 02 01:57:57 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 02 01:57:57 user nova-compute[74996]:         </nova:port>
Nov 02 01:57:57 user nova-compute[74996]:       </nova:ports>
Nov 02 01:57:57 user nova-compute[74996]:     </nova:instance>
Nov 02 01:57:57 user nova-compute[74996]:   </metadata>
Nov 02 01:57:57 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:57:57 user nova-compute[74996]:     <system>
Nov 02 01:57:57 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:57:57 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:57:57 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:57:57 user nova-compute[74996]:       <entry name="serial">27863b45-4dda-4f6d-bd6f-0f332f1fdd52</entry>
Nov 02 01:57:57 user nova-compute[74996]:       <entry name="uuid">27863b45-4dda-4f6d-bd6f-0f332f1fdd52</entry>
Nov 02 01:57:57 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:57:57 user nova-compute[74996]:     </system>
Nov 02 01:57:57 user nova-compute[74996]:   </sysinfo>
Nov 02 01:57:57 user nova-compute[74996]:   <os>
Nov 02 01:57:57 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:57:57 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:57:57 user nova-compute[74996]:   </os>
Nov 02 01:57:57 user nova-compute[74996]:   <features>
Nov 02 01:57:57 user nova-compute[74996]:     <acpi/>
Nov 02 01:57:57 user nova-compute[74996]:     <apic/>
Nov 02 01:57:57 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:57:57 user nova-compute[74996]:   </features>
Nov 02 01:57:57 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:57:57 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:57:57 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:57:57 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:57:57 user nova-compute[74996]:   </clock>
Nov 02 01:57:57 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:57:57 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:57:57 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:57:57 user nova-compute[74996]:   </cpu>
Nov 02 01:57:57 user nova-compute[74996]:   <devices>
Nov 02 01:57:57 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:57:57 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:57:57 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk.rescue"/>
Nov 02 01:57:57 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:57:57 user nova-compute[74996]:     </disk>
Nov 02 01:57:57 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:57:57 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:57:57 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk"/>
Nov 02 01:57:57 user nova-compute[74996]:       <target dev="vdb" bus="virtio"/>
Nov 02 01:57:57 user nova-compute[74996]:     </disk>
Nov 02 01:57:57 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:57:57 user nova-compute[74996]:       <mac address="fa:16:3e:2e:f5:1b"/>
Nov 02 01:57:57 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:57:57 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:57:57 user nova-compute[74996]:       <target dev="tap9ffa33b3-7d"/>
Nov 02 01:57:57 user nova-compute[74996]:     </interface>
Nov 02 01:57:57 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:57:57 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/console.log" append="off"/>
Nov 02 01:57:57 user nova-compute[74996]:     </serial>
Nov 02 01:57:57 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:57:57 user nova-compute[74996]:     <video>
Nov 02 01:57:57 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:57:57 user nova-compute[74996]:     </video>
Nov 02 01:57:57 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:57:57 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:57:57 user nova-compute[74996]:     </rng>
Nov 02 01:57:57 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:57:57 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:57:57 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:57:57 user nova-compute[74996]:     </memballoon>
Nov 02 01:57:57 user nova-compute[74996]:   </devices>
Nov 02 01:57:57 user nova-compute[74996]: </domain>
Nov 02 01:57:57 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:57:57 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Instance destroyed successfully.
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] No VIF found with MAC fa:16:3e:2e:f5:1b, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:57:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:58 user nova-compute[74996]: DEBUG nova.compute.manager [req-9010b0c5-0c13-45ae-ab45-7d06ddbdedec req-107fd9fa-8729-4585-8d88-2f9d5113de20 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Received event network-vif-plugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:57:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9010b0c5-0c13-45ae-ab45-7d06ddbdedec req-107fd9fa-8729-4585-8d88-2f9d5113de20 service nova] Acquiring lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:57:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9010b0c5-0c13-45ae-ab45-7d06ddbdedec req-107fd9fa-8729-4585-8d88-2f9d5113de20 service nova] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:57:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9010b0c5-0c13-45ae-ab45-7d06ddbdedec req-107fd9fa-8729-4585-8d88-2f9d5113de20 service nova] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:57:58 user nova-compute[74996]: DEBUG nova.compute.manager [req-9010b0c5-0c13-45ae-ab45-7d06ddbdedec req-107fd9fa-8729-4585-8d88-2f9d5113de20 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] No waiting events found dispatching network-vif-plugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:57:58 user nova-compute[74996]: WARNING nova.compute.manager [req-9010b0c5-0c13-45ae-ab45-7d06ddbdedec req-107fd9fa-8729-4585-8d88-2f9d5113de20 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Received unexpected event network-vif-plugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 for instance with vm_state active and task_state rescuing.
Nov 02 01:57:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:57:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:00 user nova-compute[74996]: DEBUG nova.compute.manager [req-2dc7224c-7a40-4b11-b732-2189115c0b06 req-8ec0c398-ced4-4fcf-af15-50d795def339 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Received event network-vif-plugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:58:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2dc7224c-7a40-4b11-b732-2189115c0b06 req-8ec0c398-ced4-4fcf-af15-50d795def339 service nova] Acquiring lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:58:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2dc7224c-7a40-4b11-b732-2189115c0b06 req-8ec0c398-ced4-4fcf-af15-50d795def339 service nova] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:58:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2dc7224c-7a40-4b11-b732-2189115c0b06 req-8ec0c398-ced4-4fcf-af15-50d795def339 service nova] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:58:00 user nova-compute[74996]: DEBUG nova.compute.manager [req-2dc7224c-7a40-4b11-b732-2189115c0b06 req-8ec0c398-ced4-4fcf-af15-50d795def339 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] No waiting events found dispatching network-vif-plugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:58:00 user nova-compute[74996]: WARNING nova.compute.manager [req-2dc7224c-7a40-4b11-b732-2189115c0b06 req-8ec0c398-ced4-4fcf-af15-50d795def339 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Received unexpected event network-vif-plugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 for instance with vm_state active and task_state rescuing.
Nov 02 01:58:00 user nova-compute[74996]: DEBUG nova.compute.manager [req-2dc7224c-7a40-4b11-b732-2189115c0b06 req-8ec0c398-ced4-4fcf-af15-50d795def339 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Received event network-vif-plugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:58:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2dc7224c-7a40-4b11-b732-2189115c0b06 req-8ec0c398-ced4-4fcf-af15-50d795def339 service nova] Acquiring lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:58:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2dc7224c-7a40-4b11-b732-2189115c0b06 req-8ec0c398-ced4-4fcf-af15-50d795def339 service nova] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:58:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2dc7224c-7a40-4b11-b732-2189115c0b06 req-8ec0c398-ced4-4fcf-af15-50d795def339 service nova] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:58:00 user nova-compute[74996]: DEBUG nova.compute.manager [req-2dc7224c-7a40-4b11-b732-2189115c0b06 req-8ec0c398-ced4-4fcf-af15-50d795def339 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] No waiting events found dispatching network-vif-plugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:58:00 user nova-compute[74996]: WARNING nova.compute.manager [req-2dc7224c-7a40-4b11-b732-2189115c0b06 req-8ec0c398-ced4-4fcf-af15-50d795def339 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Received unexpected event network-vif-plugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 for instance with vm_state active and task_state rescuing.
Nov 02 01:58:00 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7fda1001-dd8b-472f-a297-1b0fa4b11c3f tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:58:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "4f56890c-d135-42a1-b862-7ac5f9076654" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:58:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "4f56890c-d135-42a1-b862-7ac5f9076654" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:58:11 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:58:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:58:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:58:11 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:58:11 user nova-compute[74996]: INFO nova.compute.claims [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Claim successful on node user
Nov 02 01:58:11 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:58:11 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:58:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.299s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:58:11 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:58:11 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:58:11 user nova-compute[74996]: DEBUG nova.network.neutron [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:58:11 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:58:11 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:58:11 user nova-compute[74996]: DEBUG nova.policy [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7d9a6e0ced84500aab9759d009f0a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be09717763f448b5a5d1a1e5f62e289b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:58:11 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:58:11 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:58:11 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Creating image(s)
Nov 02 01:58:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:58:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "/opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:58:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "/opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:58:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "70e5486255d0a2eca2d4ae726d067be83d3f6a58" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:58:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "70e5486255d0a2eca2d4ae726d067be83d3f6a58" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:58:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/70e5486255d0a2eca2d4ae726d067be83d3f6a58.part --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:58:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/70e5486255d0a2eca2d4ae726d067be83d3f6a58.part --force-share --output=json" returned: 0 in 0.172s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:58:12 user nova-compute[74996]: DEBUG nova.virt.images [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] b6b6767e-ba8a-4dbd-aa21-d75b3d3ffd27 was qcow2, converting to raw {{(pid=74996) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 01:58:12 user nova-compute[74996]: DEBUG nova.privsep.utils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74996) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 01:58:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/70e5486255d0a2eca2d4ae726d067be83d3f6a58.part /opt/stack/data/nova/instances/_base/70e5486255d0a2eca2d4ae726d067be83d3f6a58.converted {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:58:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/70e5486255d0a2eca2d4ae726d067be83d3f6a58.part /opt/stack/data/nova/instances/_base/70e5486255d0a2eca2d4ae726d067be83d3f6a58.converted" returned: 0 in 0.204s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:58:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/70e5486255d0a2eca2d4ae726d067be83d3f6a58.converted --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:58:12 user nova-compute[74996]: DEBUG nova.network.neutron [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Successfully created port: 78937d9b-197e-4ff7-8e1c-c26daa12fcc8 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:58:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/70e5486255d0a2eca2d4ae726d067be83d3f6a58.converted --force-share --output=json" returned: 0 in 0.205s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:58:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "70e5486255d0a2eca2d4ae726d067be83d3f6a58" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.034s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:58:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/70e5486255d0a2eca2d4ae726d067be83d3f6a58 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:58:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/70e5486255d0a2eca2d4ae726d067be83d3f6a58 --force-share --output=json" returned: 0 in 0.172s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:58:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "70e5486255d0a2eca2d4ae726d067be83d3f6a58" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:58:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "70e5486255d0a2eca2d4ae726d067be83d3f6a58" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:58:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/70e5486255d0a2eca2d4ae726d067be83d3f6a58 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/70e5486255d0a2eca2d4ae726d067be83d3f6a58 --force-share --output=json" returned: 0 in 0.187s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/70e5486255d0a2eca2d4ae726d067be83d3f6a58,backing_fmt=raw /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/70e5486255d0a2eca2d4ae726d067be83d3f6a58,backing_fmt=raw /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk 1073741824" returned: 0 in 0.049s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "70e5486255d0a2eca2d4ae726d067be83d3f6a58" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/70e5486255d0a2eca2d4ae726d067be83d3f6a58 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.network.neutron [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Successfully updated port: 78937d9b-197e-4ff7-8e1c-c26daa12fcc8 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "refresh_cache-4f56890c-d135-42a1-b862-7ac5f9076654" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquired lock "refresh_cache-4f56890c-d135-42a1-b862-7ac5f9076654" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.network.neutron [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.compute.manager [req-82315384-fdab-487d-82af-5761f017ce03 req-08f8683c-b07a-4999-8377-d882bab93392 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Received event network-changed-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.compute.manager [req-82315384-fdab-487d-82af-5761f017ce03 req-08f8683c-b07a-4999-8377-d882bab93392 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Refreshing instance network info cache due to event network-changed-78937d9b-197e-4ff7-8e1c-c26daa12fcc8. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-82315384-fdab-487d-82af-5761f017ce03 req-08f8683c-b07a-4999-8377-d882bab93392 service nova] Acquiring lock "refresh_cache-4f56890c-d135-42a1-b862-7ac5f9076654" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/70e5486255d0a2eca2d4ae726d067be83d3f6a58 --force-share --output=json" returned: 0 in 0.181s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.network.neutron [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Cannot resize image /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Ensure instance console log exists: /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.network.neutron [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Updating instance_info_cache with network_info: [{"id": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "address": "fa:16:3e:ef:c5:84", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78937d9b-19", "ovs_interfaceid": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Releasing lock "refresh_cache-4f56890c-d135-42a1-b862-7ac5f9076654" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Instance network_info: |[{"id": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "address": "fa:16:3e:ef:c5:84", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78937d9b-19", "ovs_interfaceid": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-82315384-fdab-487d-82af-5761f017ce03 req-08f8683c-b07a-4999-8377-d882bab93392 service nova] Acquired lock "refresh_cache-4f56890c-d135-42a1-b862-7ac5f9076654" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.network.neutron [req-82315384-fdab-487d-82af-5761f017ce03 req-08f8683c-b07a-4999-8377-d882bab93392 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Refreshing network info cache for port 78937d9b-197e-4ff7-8e1c-c26daa12fcc8 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Start _get_guest_xml network_info=[{"id": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "address": "fa:16:3e:ef:c5:84", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78937d9b-19", "ovs_interfaceid": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:58:08Z,direct_url=<?>,disk_format='qcow2',id=b6b6767e-ba8a-4dbd-aa21-d75b3d3ffd27,min_disk=0,min_ram=0,name='tempest-scenario-img--1683124500',owner='be09717763f448b5a5d1a1e5f62e289b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:58:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'b6b6767e-ba8a-4dbd-aa21-d75b3d3ffd27'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:58:13 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:58:13 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:58:08Z,direct_url=<?>,disk_format='qcow2',id=b6b6767e-ba8a-4dbd-aa21-d75b3d3ffd27,min_disk=0,min_ram=0,name='tempest-scenario-img--1683124500',owner='be09717763f448b5a5d1a1e5f62e289b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:58:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1728348689',display_name='tempest-TestMinimumBasicScenario-server-1728348689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1728348689',id=42,image_ref='b6b6767e-ba8a-4dbd-aa21-d75b3d3ffd27',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH899TM/rBHcQE1n0n3iCloLlovOhyXsE7Y6f0ED7vrwer1ehja7sJDRxPgSKSJjSIaDq9WEKp13S7pOXfa5vGtZvBJ7xoD8MRo1oFT6Yoh8qcqYRhJ3CeJeY21s4N23CQ==',key_name='tempest-TestMinimumBasicScenario-320891136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be09717763f448b5a5d1a1e5f62e289b',ramdisk_id='',reservation_id='r-mrxi90op',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6b6767e-ba8a-4dbd-aa21-d75b3d3ffd27',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1426618310',owner_user_name='tempest-TestMinimumBasicScenario-1426618310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:58:12Z,user_data=None,user_id='e7d9a6e0ced84500aab9759d009f0a49',uuid=4f56890c-d135-42a1-b862-7ac5f9076654,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "address": "fa:16:3e:ef:c5:84", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78937d9b-19", "ovs_interfaceid": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Converting VIF {"id": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "address": "fa:16:3e:ef:c5:84", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78937d9b-19", "ovs_interfaceid": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c5:84,bridge_name='br-int',has_traffic_filtering=True,id=78937d9b-197e-4ff7-8e1c-c26daa12fcc8,network=Network(ab25d1c6-cd19-42dd-abe2-cb20978f06e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78937d9b-19') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.objects.instance [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f56890c-d135-42a1-b862-7ac5f9076654 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:58:13 user nova-compute[74996]:   <uuid>4f56890c-d135-42a1-b862-7ac5f9076654</uuid>
Nov 02 01:58:13 user nova-compute[74996]:   <name>instance-0000002a</name>
Nov 02 01:58:13 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:58:13 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:58:13 user nova-compute[74996]:   <metadata>
Nov 02 01:58:13 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:58:13 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:58:13 user nova-compute[74996]:       <nova:name>tempest-TestMinimumBasicScenario-server-1728348689</nova:name>
Nov 02 01:58:13 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:58:13</nova:creationTime>
Nov 02 01:58:13 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:58:13 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:58:13 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:58:13 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:58:13 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:58:13 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:58:13 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:58:13 user nova-compute[74996]:       <nova:owner>
Nov 02 01:58:13 user nova-compute[74996]:         <nova:user uuid="e7d9a6e0ced84500aab9759d009f0a49">tempest-TestMinimumBasicScenario-1426618310-project-member</nova:user>
Nov 02 01:58:13 user nova-compute[74996]:         <nova:project uuid="be09717763f448b5a5d1a1e5f62e289b">tempest-TestMinimumBasicScenario-1426618310</nova:project>
Nov 02 01:58:13 user nova-compute[74996]:       </nova:owner>
Nov 02 01:58:13 user nova-compute[74996]:       <nova:root type="image" uuid="b6b6767e-ba8a-4dbd-aa21-d75b3d3ffd27"/>
Nov 02 01:58:13 user nova-compute[74996]:       <nova:ports>
Nov 02 01:58:13 user nova-compute[74996]:         <nova:port uuid="78937d9b-197e-4ff7-8e1c-c26daa12fcc8">
Nov 02 01:58:13 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 02 01:58:13 user nova-compute[74996]:         </nova:port>
Nov 02 01:58:13 user nova-compute[74996]:       </nova:ports>
Nov 02 01:58:13 user nova-compute[74996]:     </nova:instance>
Nov 02 01:58:13 user nova-compute[74996]:   </metadata>
Nov 02 01:58:13 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:58:13 user nova-compute[74996]:     <system>
Nov 02 01:58:13 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:58:13 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:58:13 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:58:13 user nova-compute[74996]:       <entry name="serial">4f56890c-d135-42a1-b862-7ac5f9076654</entry>
Nov 02 01:58:13 user nova-compute[74996]:       <entry name="uuid">4f56890c-d135-42a1-b862-7ac5f9076654</entry>
Nov 02 01:58:13 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:58:13 user nova-compute[74996]:     </system>
Nov 02 01:58:13 user nova-compute[74996]:   </sysinfo>
Nov 02 01:58:13 user nova-compute[74996]:   <os>
Nov 02 01:58:13 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:58:13 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:58:13 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:58:13 user nova-compute[74996]:   </os>
Nov 02 01:58:13 user nova-compute[74996]:   <features>
Nov 02 01:58:13 user nova-compute[74996]:     <acpi/>
Nov 02 01:58:13 user nova-compute[74996]:     <apic/>
Nov 02 01:58:13 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:58:13 user nova-compute[74996]:   </features>
Nov 02 01:58:13 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:58:13 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:58:13 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:58:13 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:58:13 user nova-compute[74996]:   </clock>
Nov 02 01:58:13 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:58:13 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:58:13 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:58:13 user nova-compute[74996]:   </cpu>
Nov 02 01:58:13 user nova-compute[74996]:   <devices>
Nov 02 01:58:13 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:58:13 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:58:13 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk"/>
Nov 02 01:58:13 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:58:13 user nova-compute[74996]:     </disk>
Nov 02 01:58:13 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:58:13 user nova-compute[74996]:       <mac address="fa:16:3e:ef:c5:84"/>
Nov 02 01:58:13 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:58:13 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:58:13 user nova-compute[74996]:       <target dev="tap78937d9b-19"/>
Nov 02 01:58:13 user nova-compute[74996]:     </interface>
Nov 02 01:58:13 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:58:13 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/console.log" append="off"/>
Nov 02 01:58:13 user nova-compute[74996]:     </serial>
Nov 02 01:58:13 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:58:13 user nova-compute[74996]:     <video>
Nov 02 01:58:13 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:58:13 user nova-compute[74996]:     </video>
Nov 02 01:58:13 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:58:13 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:58:13 user nova-compute[74996]:     </rng>
Nov 02 01:58:13 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:58:13 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:58:13 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:58:13 user nova-compute[74996]:     </memballoon>
Nov 02 01:58:13 user nova-compute[74996]:   </devices>
Nov 02 01:58:13 user nova-compute[74996]: </domain>
Nov 02 01:58:13 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1728348689',display_name='tempest-TestMinimumBasicScenario-server-1728348689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1728348689',id=42,image_ref='b6b6767e-ba8a-4dbd-aa21-d75b3d3ffd27',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH899TM/rBHcQE1n0n3iCloLlovOhyXsE7Y6f0ED7vrwer1ehja7sJDRxPgSKSJjSIaDq9WEKp13S7pOXfa5vGtZvBJ7xoD8MRo1oFT6Yoh8qcqYRhJ3CeJeY21s4N23CQ==',key_name='tempest-TestMinimumBasicScenario-320891136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be09717763f448b5a5d1a1e5f62e289b',ramdisk_id='',reservation_id='r-mrxi90op',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6b6767e-ba8a-4dbd-aa21-d75b3d3ffd27',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1426618310',owner_user_name='tempest-TestMinimumBasicScenario-1426618310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:58:12Z,user_data=None,user_id='e7d9a6e0ced84500aab9759d009f0a49',uuid=4f56890c-d135-42a1-b862-7ac5f9076654,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "address": "fa:16:3e:ef:c5:84", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78937d9b-19", "ovs_interfaceid": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Converting VIF {"id": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "address": "fa:16:3e:ef:c5:84", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78937d9b-19", "ovs_interfaceid": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c5:84,bridge_name='br-int',has_traffic_filtering=True,id=78937d9b-197e-4ff7-8e1c-c26daa12fcc8,network=Network(ab25d1c6-cd19-42dd-abe2-cb20978f06e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78937d9b-19') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG os_vif [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c5:84,bridge_name='br-int',has_traffic_filtering=True,id=78937d9b-197e-4ff7-8e1c-c26daa12fcc8,network=Network(ab25d1c6-cd19-42dd-abe2-cb20978f06e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78937d9b-19') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c61ef754-1904-5fb6-9036-d266e857b85d', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78937d9b-19, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78937d9b-19, col_values=(('qos', UUID('0513ce59-5e8a-49e2-89aa-dd3ab3071d0a')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78937d9b-19, col_values=(('external_ids', {'iface-id': '78937d9b-197e-4ff7-8e1c-c26daa12fcc8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:c5:84', 'vm-uuid': '4f56890c-d135-42a1-b862-7ac5f9076654'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:13 user nova-compute[74996]: INFO os_vif [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c5:84,bridge_name='br-int',has_traffic_filtering=True,id=78937d9b-197e-4ff7-8e1c-c26daa12fcc8,network=Network(ab25d1c6-cd19-42dd-abe2-cb20978f06e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78937d9b-19')
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:58:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] No VIF found with MAC fa:16:3e:ef:c5:84, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:58:14 user nova-compute[74996]: DEBUG nova.network.neutron [req-82315384-fdab-487d-82af-5761f017ce03 req-08f8683c-b07a-4999-8377-d882bab93392 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Updated VIF entry in instance network info cache for port 78937d9b-197e-4ff7-8e1c-c26daa12fcc8. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:58:14 user nova-compute[74996]: DEBUG nova.network.neutron [req-82315384-fdab-487d-82af-5761f017ce03 req-08f8683c-b07a-4999-8377-d882bab93392 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Updating instance_info_cache with network_info: [{"id": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "address": "fa:16:3e:ef:c5:84", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78937d9b-19", "ovs_interfaceid": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:58:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-82315384-fdab-487d-82af-5761f017ce03 req-08f8683c-b07a-4999-8377-d882bab93392 service nova] Releasing lock "refresh_cache-4f56890c-d135-42a1-b862-7ac5f9076654" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:58:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:15 user nova-compute[74996]: DEBUG nova.compute.manager [req-426e18a2-dfd8-45bf-814f-b5d56862b046 req-aabfe1c6-1fa5-4870-89dc-374b9d2ff026 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Received event network-vif-plugged-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:58:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-426e18a2-dfd8-45bf-814f-b5d56862b046 req-aabfe1c6-1fa5-4870-89dc-374b9d2ff026 service nova] Acquiring lock "4f56890c-d135-42a1-b862-7ac5f9076654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:58:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-426e18a2-dfd8-45bf-814f-b5d56862b046 req-aabfe1c6-1fa5-4870-89dc-374b9d2ff026 service nova] Lock "4f56890c-d135-42a1-b862-7ac5f9076654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:58:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-426e18a2-dfd8-45bf-814f-b5d56862b046 req-aabfe1c6-1fa5-4870-89dc-374b9d2ff026 service nova] Lock "4f56890c-d135-42a1-b862-7ac5f9076654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:58:15 user nova-compute[74996]: DEBUG nova.compute.manager [req-426e18a2-dfd8-45bf-814f-b5d56862b046 req-aabfe1c6-1fa5-4870-89dc-374b9d2ff026 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] No waiting events found dispatching network-vif-plugged-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:58:15 user nova-compute[74996]: WARNING nova.compute.manager [req-426e18a2-dfd8-45bf-814f-b5d56862b046 req-aabfe1c6-1fa5-4870-89dc-374b9d2ff026 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Received unexpected event network-vif-plugged-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 for instance with vm_state building and task_state spawning.
Nov 02 01:58:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:17 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:58:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:58:17 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Instance spawned successfully.
Nov 02 01:58:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:58:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:58:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:58:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:58:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:58:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:58:17 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:58:17 user nova-compute[74996]: DEBUG nova.compute.manager [req-0242ac70-ded6-4915-a8b1-98eb6e5b2764 req-f9dcac0b-3706-4576-8ab3-4b4673d33414 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Received event network-vif-plugged-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:58:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0242ac70-ded6-4915-a8b1-98eb6e5b2764 req-f9dcac0b-3706-4576-8ab3-4b4673d33414 service nova] Acquiring lock "4f56890c-d135-42a1-b862-7ac5f9076654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:58:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0242ac70-ded6-4915-a8b1-98eb6e5b2764 req-f9dcac0b-3706-4576-8ab3-4b4673d33414 service nova] Lock "4f56890c-d135-42a1-b862-7ac5f9076654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:58:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0242ac70-ded6-4915-a8b1-98eb6e5b2764 req-f9dcac0b-3706-4576-8ab3-4b4673d33414 service nova] Lock "4f56890c-d135-42a1-b862-7ac5f9076654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:58:17 user nova-compute[74996]: DEBUG nova.compute.manager [req-0242ac70-ded6-4915-a8b1-98eb6e5b2764 req-f9dcac0b-3706-4576-8ab3-4b4673d33414 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] No waiting events found dispatching network-vif-plugged-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:58:17 user nova-compute[74996]: WARNING nova.compute.manager [req-0242ac70-ded6-4915-a8b1-98eb6e5b2764 req-f9dcac0b-3706-4576-8ab3-4b4673d33414 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Received unexpected event network-vif-plugged-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 for instance with vm_state building and task_state spawning.
Nov 02 01:58:17 user nova-compute[74996]: INFO nova.compute.manager [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Took 5.73 seconds to spawn the instance on the hypervisor.
Nov 02 01:58:17 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:58:17 user nova-compute[74996]: INFO nova.compute.manager [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Took 6.40 seconds to build instance.
Nov 02 01:58:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1bef8148-1593-4eee-922c-5fe0b6e7b45e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "4f56890c-d135-42a1-b862-7ac5f9076654" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.502s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:58:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:31 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:58:31 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:58:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:58:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:58:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:58:31 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:58:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:58:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:58:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:58:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:58:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:58:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:58:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:58:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:58:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:58:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:58:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:58:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:58:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e460e58e-e7c4-43de-a3b1-efa37430b0c4/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:58:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e460e58e-e7c4-43de-a3b1-efa37430b0c4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:58:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e460e58e-e7c4-43de-a3b1-efa37430b0c4/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:58:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e460e58e-e7c4-43de-a3b1-efa37430b0c4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:58:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:58:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:58:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:58:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:58:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:58:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:58:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:58:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:58:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:58:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:34 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:58:34 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:58:34 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8251MB free_disk=24.892230987548828GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:58:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:58:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:58:34 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance e38704a7-f8a0-482c-bd51-26a90d37b71d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:58:34 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7c53e6cc-cf69-485d-b24f-5e113dae0e5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:58:34 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 27863b45-4dda-4f6d-bd6f-0f332f1fdd52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:58:34 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance e460e58e-e7c4-43de-a3b1-efa37430b0c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:58:34 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 4f56890c-d135-42a1-b862-7ac5f9076654 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:58:34 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:58:34 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:58:34 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:58:34 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:58:34 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:58:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.310s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:58:35 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:58:35 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:58:35 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:58:35 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:58:36 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:58:36 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:58:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-7c53e6cc-cf69-485d-b24f-5e113dae0e5d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:58:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-7c53e6cc-cf69-485d-b24f-5e113dae0e5d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:58:36 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 01:58:36 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Updating instance_info_cache with network_info: [{"id": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "address": "fa:16:3e:9b:c8:b7", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391c1ab0-6a", "ovs_interfaceid": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:58:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-7c53e6cc-cf69-485d-b24f-5e113dae0e5d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:58:36 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 01:58:37 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:58:38 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:58:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:40 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:58:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:58:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:58:52 user nova-compute[74996]: INFO nova.compute.manager [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Unshelving
Nov 02 01:58:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:58:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:58:52 user nova-compute[74996]: DEBUG nova.objects.instance [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lazy-loading 'pci_requests' on Instance uuid 6fed89e8-a427-4e00-8bba-144dedc9ab1c {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:58:52 user nova-compute[74996]: DEBUG nova.objects.instance [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lazy-loading 'numa_topology' on Instance uuid 6fed89e8-a427-4e00-8bba-144dedc9ab1c {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:58:52 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:58:52 user nova-compute[74996]: INFO nova.compute.claims [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Claim successful on node user
Nov 02 01:58:53 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:58:53 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:58:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:58:53 user nova-compute[74996]: INFO nova.network.neutron [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Updating port ef383fd9-4ffc-495b-ab4f-732f933a0391 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 02 01:58:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "refresh_cache-6fed89e8-a427-4e00-8bba-144dedc9ab1c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:58:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquired lock "refresh_cache-6fed89e8-a427-4e00-8bba-144dedc9ab1c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:58:54 user nova-compute[74996]: DEBUG nova.network.neutron [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:58:54 user nova-compute[74996]: DEBUG nova.compute.manager [req-36b34a65-6472-43ce-a7e3-f52dfbed6f8d req-a0e46159-725f-4538-b41f-5480d83088f8 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Received event network-changed-ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:58:54 user nova-compute[74996]: DEBUG nova.compute.manager [req-36b34a65-6472-43ce-a7e3-f52dfbed6f8d req-a0e46159-725f-4538-b41f-5480d83088f8 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Refreshing instance network info cache due to event network-changed-ef383fd9-4ffc-495b-ab4f-732f933a0391. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:58:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-36b34a65-6472-43ce-a7e3-f52dfbed6f8d req-a0e46159-725f-4538-b41f-5480d83088f8 service nova] Acquiring lock "refresh_cache-6fed89e8-a427-4e00-8bba-144dedc9ab1c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:58:55 user nova-compute[74996]: DEBUG nova.network.neutron [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Updating instance_info_cache with network_info: [{"id": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "address": "fa:16:3e:02:47:7a", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef383fd9-4f", "ovs_interfaceid": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:58:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Releasing lock "refresh_cache-6fed89e8-a427-4e00-8bba-144dedc9ab1c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:58:55 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:58:55 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Creating image(s)
Nov 02 01:58:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "/opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:58:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "/opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:58:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "/opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:58:55 user nova-compute[74996]: DEBUG nova.objects.instance [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6fed89e8-a427-4e00-8bba-144dedc9ab1c {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:58:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-36b34a65-6472-43ce-a7e3-f52dfbed6f8d req-a0e46159-725f-4538-b41f-5480d83088f8 service nova] Acquired lock "refresh_cache-6fed89e8-a427-4e00-8bba-144dedc9ab1c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:58:55 user nova-compute[74996]: DEBUG nova.network.neutron [req-36b34a65-6472-43ce-a7e3-f52dfbed6f8d req-a0e46159-725f-4538-b41f-5480d83088f8 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Refreshing network info cache for port ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:58:55 user nova-compute[74996]: DEBUG nova.objects.base [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Object Instance<6fed89e8-a427-4e00-8bba-144dedc9ab1c> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:58:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "69ec96197ba9723fd3445b24df2ed1658bfc0275" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:58:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "69ec96197ba9723fd3445b24df2ed1658bfc0275" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:58:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69ec96197ba9723fd3445b24df2ed1658bfc0275.part --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:58:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69ec96197ba9723fd3445b24df2ed1658bfc0275.part --force-share --output=json" returned: 0 in 0.192s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:58:56 user nova-compute[74996]: DEBUG nova.virt.images [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] 1badc747-d04b-4515-a7b4-b4c514d1f6c4 was qcow2, converting to raw {{(pid=74996) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 01:58:56 user nova-compute[74996]: DEBUG nova.privsep.utils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74996) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 01:58:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/69ec96197ba9723fd3445b24df2ed1658bfc0275.part /opt/stack/data/nova/instances/_base/69ec96197ba9723fd3445b24df2ed1658bfc0275.converted {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:58:56 user nova-compute[74996]: DEBUG nova.network.neutron [req-36b34a65-6472-43ce-a7e3-f52dfbed6f8d req-a0e46159-725f-4538-b41f-5480d83088f8 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Updated VIF entry in instance network info cache for port ef383fd9-4ffc-495b-ab4f-732f933a0391. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:58:56 user nova-compute[74996]: DEBUG nova.network.neutron [req-36b34a65-6472-43ce-a7e3-f52dfbed6f8d req-a0e46159-725f-4538-b41f-5480d83088f8 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Updating instance_info_cache with network_info: [{"id": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "address": "fa:16:3e:02:47:7a", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef383fd9-4f", "ovs_interfaceid": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:58:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-36b34a65-6472-43ce-a7e3-f52dfbed6f8d req-a0e46159-725f-4538-b41f-5480d83088f8 service nova] Releasing lock "refresh_cache-6fed89e8-a427-4e00-8bba-144dedc9ab1c" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:58:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/69ec96197ba9723fd3445b24df2ed1658bfc0275.part /opt/stack/data/nova/instances/_base/69ec96197ba9723fd3445b24df2ed1658bfc0275.converted" returned: 0 in 0.488s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:58:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69ec96197ba9723fd3445b24df2ed1658bfc0275.converted --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:58:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69ec96197ba9723fd3445b24df2ed1658bfc0275.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:58:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "69ec96197ba9723fd3445b24df2ed1658bfc0275" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.979s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:58:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69ec96197ba9723fd3445b24df2ed1658bfc0275 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:58:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69ec96197ba9723fd3445b24df2ed1658bfc0275 --force-share --output=json" returned: 0 in 0.188s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:58:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "69ec96197ba9723fd3445b24df2ed1658bfc0275" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:58:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "69ec96197ba9723fd3445b24df2ed1658bfc0275" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:58:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69ec96197ba9723fd3445b24df2ed1658bfc0275 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:58:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69ec96197ba9723fd3445b24df2ed1658bfc0275 --force-share --output=json" returned: 0 in 0.178s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:58:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69ec96197ba9723fd3445b24df2ed1658bfc0275,backing_fmt=raw /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:58:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69ec96197ba9723fd3445b24df2ed1658bfc0275,backing_fmt=raw /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk 1073741824" returned: 0 in 0.050s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:58:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "69ec96197ba9723fd3445b24df2ed1658bfc0275" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:58:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69ec96197ba9723fd3445b24df2ed1658bfc0275 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:58:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69ec96197ba9723fd3445b24df2ed1658bfc0275 --force-share --output=json" returned: 0 in 0.172s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:58:57 user nova-compute[74996]: DEBUG nova.objects.instance [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lazy-loading 'migration_context' on Instance uuid 6fed89e8-a427-4e00-8bba-144dedc9ab1c {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:58:57 user nova-compute[74996]: DEBUG nova.objects.base [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Object Instance<6fed89e8-a427-4e00-8bba-144dedc9ab1c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:58:57 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Rebasing disk image.
Nov 02 01:58:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:58:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.214s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:58:57 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 -F raw /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:58:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:58:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 -F raw /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk" returned: 0 in 2.266s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Ensure instance console log exists: /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Start _get_guest_xml network_info=[{"id": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "address": "fa:16:3e:02:47:7a", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef383fd9-4f", "ovs_interfaceid": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='aa2b44f853ef8aa1a7037ff2a73f39b4',container_format='bare',created_at=2023-11-02T01:57:00Z,direct_url=<?>,disk_format='qcow2',id=1badc747-d04b-4515-a7b4-b4c514d1f6c4,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-818920333-shelved',owner='22b862880e0c43ab8f5a4d65f6697955',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-02T01:57:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:59:00 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:59:00 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='aa2b44f853ef8aa1a7037ff2a73f39b4',container_format='bare',created_at=2023-11-02T01:57:00Z,direct_url=<?>,disk_format='qcow2',id=1badc747-d04b-4515-a7b4-b4c514d1f6c4,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-818920333-shelved',owner='22b862880e0c43ab8f5a4d65f6697955',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-02T01:57:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.objects.instance [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6fed89e8-a427-4e00-8bba-144dedc9ab1c {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.objects.base [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Object Instance<6fed89e8-a427-4e00-8bba-144dedc9ab1c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T01:55:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-818920333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-818920333',id=39,image_ref='1badc747-d04b-4515-a7b4-b4c514d1f6c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1113388504',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:55:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='22b862880e0c43ab8f5a4d65f6697955',ramdisk_id='',reservation_id='r-2s89a6k1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-701748724',owner_user_name='tempest-AttachVolumeShelveTestJSON-701748724-project-member',shelved_at='2023-11-02T01:57:04.119813',shelved_host='user',shelved_image_id='1badc747-d04b-4515-a7b4-b4c514d1f6c4'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:58:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01fc2ea044794374b09741ecaf841ba2',uuid=6fed89e8-a427-4e00-8bba-144dedc9ab1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "address": "fa:16:3e:02:47:7a", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef383fd9-4f", "ovs_interfaceid": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Converting VIF {"id": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "address": "fa:16:3e:02:47:7a", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef383fd9-4f", "ovs_interfaceid": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:47:7a,bridge_name='br-int',has_traffic_filtering=True,id=ef383fd9-4ffc-495b-ab4f-732f933a0391,network=Network(936a0e26-8a02-4c7c-9d24-acbb2f438cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef383fd9-4f') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.objects.instance [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lazy-loading 'pci_devices' on Instance uuid 6fed89e8-a427-4e00-8bba-144dedc9ab1c {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.objects.base [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Object Instance<6fed89e8-a427-4e00-8bba-144dedc9ab1c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:59:00 user nova-compute[74996]:   <uuid>6fed89e8-a427-4e00-8bba-144dedc9ab1c</uuid>
Nov 02 01:59:00 user nova-compute[74996]:   <name>instance-00000027</name>
Nov 02 01:59:00 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:59:00 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:59:00 user nova-compute[74996]:   <metadata>
Nov 02 01:59:00 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:59:00 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:59:00 user nova-compute[74996]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-818920333</nova:name>
Nov 02 01:59:00 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:59:00</nova:creationTime>
Nov 02 01:59:00 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:59:00 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:59:00 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:59:00 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:59:00 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:59:00 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:59:00 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:59:00 user nova-compute[74996]:       <nova:owner>
Nov 02 01:59:00 user nova-compute[74996]:         <nova:user uuid="01fc2ea044794374b09741ecaf841ba2">tempest-AttachVolumeShelveTestJSON-701748724-project-member</nova:user>
Nov 02 01:59:00 user nova-compute[74996]:         <nova:project uuid="22b862880e0c43ab8f5a4d65f6697955">tempest-AttachVolumeShelveTestJSON-701748724</nova:project>
Nov 02 01:59:00 user nova-compute[74996]:       </nova:owner>
Nov 02 01:59:00 user nova-compute[74996]:       <nova:root type="image" uuid="1badc747-d04b-4515-a7b4-b4c514d1f6c4"/>
Nov 02 01:59:00 user nova-compute[74996]:       <nova:ports>
Nov 02 01:59:00 user nova-compute[74996]:         <nova:port uuid="ef383fd9-4ffc-495b-ab4f-732f933a0391">
Nov 02 01:59:00 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 02 01:59:00 user nova-compute[74996]:         </nova:port>
Nov 02 01:59:00 user nova-compute[74996]:       </nova:ports>
Nov 02 01:59:00 user nova-compute[74996]:     </nova:instance>
Nov 02 01:59:00 user nova-compute[74996]:   </metadata>
Nov 02 01:59:00 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:59:00 user nova-compute[74996]:     <system>
Nov 02 01:59:00 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:59:00 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:59:00 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:59:00 user nova-compute[74996]:       <entry name="serial">6fed89e8-a427-4e00-8bba-144dedc9ab1c</entry>
Nov 02 01:59:00 user nova-compute[74996]:       <entry name="uuid">6fed89e8-a427-4e00-8bba-144dedc9ab1c</entry>
Nov 02 01:59:00 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:59:00 user nova-compute[74996]:     </system>
Nov 02 01:59:00 user nova-compute[74996]:   </sysinfo>
Nov 02 01:59:00 user nova-compute[74996]:   <os>
Nov 02 01:59:00 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:59:00 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:59:00 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:59:00 user nova-compute[74996]:   </os>
Nov 02 01:59:00 user nova-compute[74996]:   <features>
Nov 02 01:59:00 user nova-compute[74996]:     <acpi/>
Nov 02 01:59:00 user nova-compute[74996]:     <apic/>
Nov 02 01:59:00 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:59:00 user nova-compute[74996]:   </features>
Nov 02 01:59:00 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:59:00 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:59:00 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:59:00 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:59:00 user nova-compute[74996]:   </clock>
Nov 02 01:59:00 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:59:00 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:59:00 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:59:00 user nova-compute[74996]:   </cpu>
Nov 02 01:59:00 user nova-compute[74996]:   <devices>
Nov 02 01:59:00 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:59:00 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:59:00 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk"/>
Nov 02 01:59:00 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:59:00 user nova-compute[74996]:     </disk>
Nov 02 01:59:00 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:59:00 user nova-compute[74996]:       <mac address="fa:16:3e:02:47:7a"/>
Nov 02 01:59:00 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:59:00 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:59:00 user nova-compute[74996]:       <target dev="tapef383fd9-4f"/>
Nov 02 01:59:00 user nova-compute[74996]:     </interface>
Nov 02 01:59:00 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:59:00 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/console.log" append="off"/>
Nov 02 01:59:00 user nova-compute[74996]:     </serial>
Nov 02 01:59:00 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:59:00 user nova-compute[74996]:     <video>
Nov 02 01:59:00 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:59:00 user nova-compute[74996]:     </video>
Nov 02 01:59:00 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:59:00 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:59:00 user nova-compute[74996]:     </rng>
Nov 02 01:59:00 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:59:00 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:59:00 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:59:00 user nova-compute[74996]:     </memballoon>
Nov 02 01:59:00 user nova-compute[74996]:   </devices>
Nov 02 01:59:00 user nova-compute[74996]: </domain>
Nov 02 01:59:00 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T01:55:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-818920333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-818920333',id=39,image_ref='1badc747-d04b-4515-a7b4-b4c514d1f6c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1113388504',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:55:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='22b862880e0c43ab8f5a4d65f6697955',ramdisk_id='',reservation_id='r-2s89a6k1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-701748724',owner_user_name='tempest-AttachVolumeShelveTestJSON-701748724-project-member',shelved_at='2023-11-02T01:57:04.119813',shelved_host='user',shelved_image_id='1badc747-d04b-4515-a7b4-b4c514d1f6c4'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:58:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01fc2ea044794374b09741ecaf841ba2',uuid=6fed89e8-a427-4e00-8bba-144dedc9ab1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "address": "fa:16:3e:02:47:7a", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef383fd9-4f", "ovs_interfaceid": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Converting VIF {"id": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "address": "fa:16:3e:02:47:7a", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef383fd9-4f", "ovs_interfaceid": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:47:7a,bridge_name='br-int',has_traffic_filtering=True,id=ef383fd9-4ffc-495b-ab4f-732f933a0391,network=Network(936a0e26-8a02-4c7c-9d24-acbb2f438cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef383fd9-4f') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG os_vif [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:47:7a,bridge_name='br-int',has_traffic_filtering=True,id=ef383fd9-4ffc-495b-ab4f-732f933a0391,network=Network(936a0e26-8a02-4c7c-9d24-acbb2f438cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef383fd9-4f') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b32a928-9db7-52a0-9eef-978d5fc5037a', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef383fd9-4f, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef383fd9-4f, col_values=(('qos', UUID('e2058058-0bf1-48f8-9a90-c5e5099b5344')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef383fd9-4f, col_values=(('external_ids', {'iface-id': 'ef383fd9-4ffc-495b-ab4f-732f933a0391', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:47:7a', 'vm-uuid': '6fed89e8-a427-4e00-8bba-144dedc9ab1c'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:00 user nova-compute[74996]: INFO os_vif [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:47:7a,bridge_name='br-int',has_traffic_filtering=True,id=ef383fd9-4ffc-495b-ab4f-732f933a0391,network=Network(936a0e26-8a02-4c7c-9d24-acbb2f438cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef383fd9-4f')
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:59:00 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] No VIF found with MAC fa:16:3e:02:47:7a, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:59:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:02 user nova-compute[74996]: DEBUG nova.compute.manager [req-d73e5214-af0b-4c00-aed1-e7769b05fb06 req-e5c259c2-79c4-46f4-8fe1-7c2e61e70f2d service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Received event network-vif-plugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:59:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d73e5214-af0b-4c00-aed1-e7769b05fb06 req-e5c259c2-79c4-46f4-8fe1-7c2e61e70f2d service nova] Acquiring lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:59:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d73e5214-af0b-4c00-aed1-e7769b05fb06 req-e5c259c2-79c4-46f4-8fe1-7c2e61e70f2d service nova] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:59:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d73e5214-af0b-4c00-aed1-e7769b05fb06 req-e5c259c2-79c4-46f4-8fe1-7c2e61e70f2d service nova] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:59:02 user nova-compute[74996]: DEBUG nova.compute.manager [req-d73e5214-af0b-4c00-aed1-e7769b05fb06 req-e5c259c2-79c4-46f4-8fe1-7c2e61e70f2d service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] No waiting events found dispatching network-vif-plugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:59:02 user nova-compute[74996]: WARNING nova.compute.manager [req-d73e5214-af0b-4c00-aed1-e7769b05fb06 req-e5c259c2-79c4-46f4-8fe1-7c2e61e70f2d service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Received unexpected event network-vif-plugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 02 01:59:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:04 user nova-compute[74996]: DEBUG nova.compute.manager [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:59:04 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:59:04 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Instance spawned successfully.
Nov 02 01:59:04 user nova-compute[74996]: DEBUG nova.compute.manager [req-67ef461e-35a7-445d-854f-1d5cfbd780cb req-2fe22b28-8bec-45ca-9f18-7947fa0c9296 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Received event network-vif-plugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:59:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-67ef461e-35a7-445d-854f-1d5cfbd780cb req-2fe22b28-8bec-45ca-9f18-7947fa0c9296 service nova] Acquiring lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:59:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-67ef461e-35a7-445d-854f-1d5cfbd780cb req-2fe22b28-8bec-45ca-9f18-7947fa0c9296 service nova] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:59:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-67ef461e-35a7-445d-854f-1d5cfbd780cb req-2fe22b28-8bec-45ca-9f18-7947fa0c9296 service nova] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:59:04 user nova-compute[74996]: DEBUG nova.compute.manager [req-67ef461e-35a7-445d-854f-1d5cfbd780cb req-2fe22b28-8bec-45ca-9f18-7947fa0c9296 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] No waiting events found dispatching network-vif-plugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:59:04 user nova-compute[74996]: WARNING nova.compute.manager [req-67ef461e-35a7-445d-854f-1d5cfbd780cb req-2fe22b28-8bec-45ca-9f18-7947fa0c9296 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Received unexpected event network-vif-plugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 02 01:59:04 user nova-compute[74996]: DEBUG nova.compute.manager [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:59:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-58457f7f-4cec-4a02-acd6-aa2d73a2d8d7 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.812s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:59:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "17b25747-b89d-43f0-a28a-afcf40d35e70" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:59:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:59:07 user nova-compute[74996]: DEBUG nova.compute.manager [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 01:59:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:59:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:59:07 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 01:59:07 user nova-compute[74996]: INFO nova.compute.claims [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Claim successful on node user
Nov 02 01:59:07 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:59:07 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:59:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:59:07 user nova-compute[74996]: DEBUG nova.compute.manager [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 01:59:07 user nova-compute[74996]: DEBUG nova.compute.manager [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 01:59:07 user nova-compute[74996]: DEBUG nova.network.neutron [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 01:59:07 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 01:59:07 user nova-compute[74996]: DEBUG nova.compute.manager [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 01:59:07 user nova-compute[74996]: DEBUG nova.policy [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2876f617a1b948afb52ccb54d3d37a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3ff0532d194b0c9181d9dde14227b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 01:59:07 user nova-compute[74996]: DEBUG nova.compute.manager [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 01:59:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 01:59:07 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Creating image(s)
Nov 02 01:59:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "/opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:59:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "/opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:59:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "/opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:59:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.192s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:59:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:59:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.185s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk 1073741824" returned: 0 in 0.054s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:59:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:08 user nova-compute[74996]: DEBUG nova.network.neutron [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Successfully created port: dffb12c9-41c5-480c-bb0f-f2a3fab03b8c {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 01:59:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.192s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:08 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Checking if we can resize image /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 01:59:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:08 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Cannot resize image /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 01:59:08 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 01:59:08 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Ensure instance console log exists: /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 01:59:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:59:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:59:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.network.neutron [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Successfully updated port: dffb12c9-41c5-480c-bb0f-f2a3fab03b8c {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "refresh_cache-17b25747-b89d-43f0-a28a-afcf40d35e70" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquired lock "refresh_cache-17b25747-b89d-43f0-a28a-afcf40d35e70" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.network.neutron [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.compute.manager [req-ce6f3d26-f82e-4110-8303-042eb135a7e3 req-5a3492c0-e3f2-4c36-83fe-89c23c45626b service nova] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Received event network-changed-dffb12c9-41c5-480c-bb0f-f2a3fab03b8c {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.compute.manager [req-ce6f3d26-f82e-4110-8303-042eb135a7e3 req-5a3492c0-e3f2-4c36-83fe-89c23c45626b service nova] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Refreshing instance network info cache due to event network-changed-dffb12c9-41c5-480c-bb0f-f2a3fab03b8c. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ce6f3d26-f82e-4110-8303-042eb135a7e3 req-5a3492c0-e3f2-4c36-83fe-89c23c45626b service nova] Acquiring lock "refresh_cache-17b25747-b89d-43f0-a28a-afcf40d35e70" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.network.neutron [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.network.neutron [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Updating instance_info_cache with network_info: [{"id": "dffb12c9-41c5-480c-bb0f-f2a3fab03b8c", "address": "fa:16:3e:9e:8e:1e", "network": {"id": "aea5e8b6-0fff-4614-b29c-d62929cce6ab", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1836711877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3ff0532d194b0c9181d9dde14227b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffb12c9-41", "ovs_interfaceid": "dffb12c9-41c5-480c-bb0f-f2a3fab03b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Releasing lock "refresh_cache-17b25747-b89d-43f0-a28a-afcf40d35e70" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.compute.manager [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Instance network_info: |[{"id": "dffb12c9-41c5-480c-bb0f-f2a3fab03b8c", "address": "fa:16:3e:9e:8e:1e", "network": {"id": "aea5e8b6-0fff-4614-b29c-d62929cce6ab", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1836711877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3ff0532d194b0c9181d9dde14227b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffb12c9-41", "ovs_interfaceid": "dffb12c9-41c5-480c-bb0f-f2a3fab03b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ce6f3d26-f82e-4110-8303-042eb135a7e3 req-5a3492c0-e3f2-4c36-83fe-89c23c45626b service nova] Acquired lock "refresh_cache-17b25747-b89d-43f0-a28a-afcf40d35e70" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.network.neutron [req-ce6f3d26-f82e-4110-8303-042eb135a7e3 req-5a3492c0-e3f2-4c36-83fe-89c23c45626b service nova] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Refreshing network info cache for port dffb12c9-41c5-480c-bb0f-f2a3fab03b8c {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Start _get_guest_xml network_info=[{"id": "dffb12c9-41c5-480c-bb0f-f2a3fab03b8c", "address": "fa:16:3e:9e:8e:1e", "network": {"id": "aea5e8b6-0fff-4614-b29c-d62929cce6ab", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1836711877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3ff0532d194b0c9181d9dde14227b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffb12c9-41", "ovs_interfaceid": "dffb12c9-41c5-480c-bb0f-f2a3fab03b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 01:59:09 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:59:09 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:59:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-612943796',display_name='tempest-SnapshotDataIntegrityTests-server-612943796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-612943796',id=43,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESrUC6mYWrWUNIBk1I0dgZ3j1zVhLZEHffFd3VUO4GyGOr1bM1s3UwSaWBLKK8sjdfcErihkdQnX31z965uf1VCh93Cufutq41Bt4TQ5V8+UP/pF5fBiR9wLl4H/hdGVw==',key_name='tempest-keypair-1292055540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca3ff0532d194b0c9181d9dde14227b8',ramdisk_id='',reservation_id='r-ac2luzd2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1802508939',owner_user_name='tempest-SnapshotDataIntegrityTests-1802508939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:59:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2876f617a1b948afb52ccb54d3d37a38',uuid=17b25747-b89d-43f0-a28a-afcf40d35e70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dffb12c9-41c5-480c-bb0f-f2a3fab03b8c", "address": "fa:16:3e:9e:8e:1e", "network": {"id": "aea5e8b6-0fff-4614-b29c-d62929cce6ab", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1836711877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3ff0532d194b0c9181d9dde14227b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffb12c9-41", "ovs_interfaceid": "dffb12c9-41c5-480c-bb0f-f2a3fab03b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Converting VIF {"id": "dffb12c9-41c5-480c-bb0f-f2a3fab03b8c", "address": "fa:16:3e:9e:8e:1e", "network": {"id": "aea5e8b6-0fff-4614-b29c-d62929cce6ab", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1836711877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3ff0532d194b0c9181d9dde14227b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffb12c9-41", "ovs_interfaceid": "dffb12c9-41c5-480c-bb0f-f2a3fab03b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:8e:1e,bridge_name='br-int',has_traffic_filtering=True,id=dffb12c9-41c5-480c-bb0f-f2a3fab03b8c,network=Network(aea5e8b6-0fff-4614-b29c-d62929cce6ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdffb12c9-41') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.objects.instance [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lazy-loading 'pci_devices' on Instance uuid 17b25747-b89d-43f0-a28a-afcf40d35e70 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] End _get_guest_xml xml=<domain type="kvm">
Nov 02 01:59:09 user nova-compute[74996]:   <uuid>17b25747-b89d-43f0-a28a-afcf40d35e70</uuid>
Nov 02 01:59:09 user nova-compute[74996]:   <name>instance-0000002b</name>
Nov 02 01:59:09 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 01:59:09 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 01:59:09 user nova-compute[74996]:   <metadata>
Nov 02 01:59:09 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 01:59:09 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 01:59:09 user nova-compute[74996]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-612943796</nova:name>
Nov 02 01:59:09 user nova-compute[74996]:       <nova:creationTime>2023-11-02 01:59:09</nova:creationTime>
Nov 02 01:59:09 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 01:59:09 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 01:59:09 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 01:59:09 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 01:59:09 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 01:59:09 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 01:59:09 user nova-compute[74996]:       </nova:flavor>
Nov 02 01:59:09 user nova-compute[74996]:       <nova:owner>
Nov 02 01:59:09 user nova-compute[74996]:         <nova:user uuid="2876f617a1b948afb52ccb54d3d37a38">tempest-SnapshotDataIntegrityTests-1802508939-project-member</nova:user>
Nov 02 01:59:09 user nova-compute[74996]:         <nova:project uuid="ca3ff0532d194b0c9181d9dde14227b8">tempest-SnapshotDataIntegrityTests-1802508939</nova:project>
Nov 02 01:59:09 user nova-compute[74996]:       </nova:owner>
Nov 02 01:59:09 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 01:59:09 user nova-compute[74996]:       <nova:ports>
Nov 02 01:59:09 user nova-compute[74996]:         <nova:port uuid="dffb12c9-41c5-480c-bb0f-f2a3fab03b8c">
Nov 02 01:59:09 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 02 01:59:09 user nova-compute[74996]:         </nova:port>
Nov 02 01:59:09 user nova-compute[74996]:       </nova:ports>
Nov 02 01:59:09 user nova-compute[74996]:     </nova:instance>
Nov 02 01:59:09 user nova-compute[74996]:   </metadata>
Nov 02 01:59:09 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 01:59:09 user nova-compute[74996]:     <system>
Nov 02 01:59:09 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 01:59:09 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 01:59:09 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 01:59:09 user nova-compute[74996]:       <entry name="serial">17b25747-b89d-43f0-a28a-afcf40d35e70</entry>
Nov 02 01:59:09 user nova-compute[74996]:       <entry name="uuid">17b25747-b89d-43f0-a28a-afcf40d35e70</entry>
Nov 02 01:59:09 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 01:59:09 user nova-compute[74996]:     </system>
Nov 02 01:59:09 user nova-compute[74996]:   </sysinfo>
Nov 02 01:59:09 user nova-compute[74996]:   <os>
Nov 02 01:59:09 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 01:59:09 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 01:59:09 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 01:59:09 user nova-compute[74996]:   </os>
Nov 02 01:59:09 user nova-compute[74996]:   <features>
Nov 02 01:59:09 user nova-compute[74996]:     <acpi/>
Nov 02 01:59:09 user nova-compute[74996]:     <apic/>
Nov 02 01:59:09 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 01:59:09 user nova-compute[74996]:   </features>
Nov 02 01:59:09 user nova-compute[74996]:   <clock offset="utc">
Nov 02 01:59:09 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 01:59:09 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 01:59:09 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 01:59:09 user nova-compute[74996]:   </clock>
Nov 02 01:59:09 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 01:59:09 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 01:59:09 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 01:59:09 user nova-compute[74996]:   </cpu>
Nov 02 01:59:09 user nova-compute[74996]:   <devices>
Nov 02 01:59:09 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 01:59:09 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 01:59:09 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk"/>
Nov 02 01:59:09 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 01:59:09 user nova-compute[74996]:     </disk>
Nov 02 01:59:09 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 01:59:09 user nova-compute[74996]:       <mac address="fa:16:3e:9e:8e:1e"/>
Nov 02 01:59:09 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:59:09 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 01:59:09 user nova-compute[74996]:       <target dev="tapdffb12c9-41"/>
Nov 02 01:59:09 user nova-compute[74996]:     </interface>
Nov 02 01:59:09 user nova-compute[74996]:     <serial type="pty">
Nov 02 01:59:09 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/console.log" append="off"/>
Nov 02 01:59:09 user nova-compute[74996]:     </serial>
Nov 02 01:59:09 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 01:59:09 user nova-compute[74996]:     <video>
Nov 02 01:59:09 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 01:59:09 user nova-compute[74996]:     </video>
Nov 02 01:59:09 user nova-compute[74996]:     <rng model="virtio">
Nov 02 01:59:09 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 01:59:09 user nova-compute[74996]:     </rng>
Nov 02 01:59:09 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 01:59:09 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 01:59:09 user nova-compute[74996]:       <stats period="10"/>
Nov 02 01:59:09 user nova-compute[74996]:     </memballoon>
Nov 02 01:59:09 user nova-compute[74996]:   </devices>
Nov 02 01:59:09 user nova-compute[74996]: </domain>
Nov 02 01:59:09 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:59:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-612943796',display_name='tempest-SnapshotDataIntegrityTests-server-612943796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-612943796',id=43,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESrUC6mYWrWUNIBk1I0dgZ3j1zVhLZEHffFd3VUO4GyGOr1bM1s3UwSaWBLKK8sjdfcErihkdQnX31z965uf1VCh93Cufutq41Bt4TQ5V8+UP/pF5fBiR9wLl4H/hdGVw==',key_name='tempest-keypair-1292055540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca3ff0532d194b0c9181d9dde14227b8',ramdisk_id='',reservation_id='r-ac2luzd2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1802508939',owner_user_name='tempest-SnapshotDataIntegrityTests-1802508939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T01:59:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2876f617a1b948afb52ccb54d3d37a38',uuid=17b25747-b89d-43f0-a28a-afcf40d35e70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dffb12c9-41c5-480c-bb0f-f2a3fab03b8c", "address": "fa:16:3e:9e:8e:1e", "network": {"id": "aea5e8b6-0fff-4614-b29c-d62929cce6ab", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1836711877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3ff0532d194b0c9181d9dde14227b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffb12c9-41", "ovs_interfaceid": "dffb12c9-41c5-480c-bb0f-f2a3fab03b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Converting VIF {"id": "dffb12c9-41c5-480c-bb0f-f2a3fab03b8c", "address": "fa:16:3e:9e:8e:1e", "network": {"id": "aea5e8b6-0fff-4614-b29c-d62929cce6ab", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1836711877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3ff0532d194b0c9181d9dde14227b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffb12c9-41", "ovs_interfaceid": "dffb12c9-41c5-480c-bb0f-f2a3fab03b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:8e:1e,bridge_name='br-int',has_traffic_filtering=True,id=dffb12c9-41c5-480c-bb0f-f2a3fab03b8c,network=Network(aea5e8b6-0fff-4614-b29c-d62929cce6ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdffb12c9-41') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG os_vif [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:8e:1e,bridge_name='br-int',has_traffic_filtering=True,id=dffb12c9-41c5-480c-bb0f-f2a3fab03b8c,network=Network(aea5e8b6-0fff-4614-b29c-d62929cce6ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdffb12c9-41') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7801a116-3453-54f9-92c6-15e162515ef4', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdffb12c9-41, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdffb12c9-41, col_values=(('qos', UUID('bd975876-e504-4b74-9b20-f142a3f6d8ba')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdffb12c9-41, col_values=(('external_ids', {'iface-id': 'dffb12c9-41c5-480c-bb0f-f2a3fab03b8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:8e:1e', 'vm-uuid': '17b25747-b89d-43f0-a28a-afcf40d35e70'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:09 user nova-compute[74996]: INFO os_vif [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:8e:1e,bridge_name='br-int',has_traffic_filtering=True,id=dffb12c9-41c5-480c-bb0f-f2a3fab03b8c,network=Network(aea5e8b6-0fff-4614-b29c-d62929cce6ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdffb12c9-41')
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] No VIF found with MAC fa:16:3e:9e:8e:1e, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.network.neutron [req-ce6f3d26-f82e-4110-8303-042eb135a7e3 req-5a3492c0-e3f2-4c36-83fe-89c23c45626b service nova] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Updated VIF entry in instance network info cache for port dffb12c9-41c5-480c-bb0f-f2a3fab03b8c. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG nova.network.neutron [req-ce6f3d26-f82e-4110-8303-042eb135a7e3 req-5a3492c0-e3f2-4c36-83fe-89c23c45626b service nova] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Updating instance_info_cache with network_info: [{"id": "dffb12c9-41c5-480c-bb0f-f2a3fab03b8c", "address": "fa:16:3e:9e:8e:1e", "network": {"id": "aea5e8b6-0fff-4614-b29c-d62929cce6ab", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1836711877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3ff0532d194b0c9181d9dde14227b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffb12c9-41", "ovs_interfaceid": "dffb12c9-41c5-480c-bb0f-f2a3fab03b8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:59:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ce6f3d26-f82e-4110-8303-042eb135a7e3 req-5a3492c0-e3f2-4c36-83fe-89c23c45626b service nova] Releasing lock "refresh_cache-17b25747-b89d-43f0-a28a-afcf40d35e70" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:59:10 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:11 user nova-compute[74996]: DEBUG nova.compute.manager [req-5d292ead-aefa-4adb-acfc-972fda1f0042 req-3beae4ee-0f67-4c7b-bb29-a766dc9a1399 service nova] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Received event network-vif-plugged-dffb12c9-41c5-480c-bb0f-f2a3fab03b8c {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:59:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5d292ead-aefa-4adb-acfc-972fda1f0042 req-3beae4ee-0f67-4c7b-bb29-a766dc9a1399 service nova] Acquiring lock "17b25747-b89d-43f0-a28a-afcf40d35e70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:59:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5d292ead-aefa-4adb-acfc-972fda1f0042 req-3beae4ee-0f67-4c7b-bb29-a766dc9a1399 service nova] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:59:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5d292ead-aefa-4adb-acfc-972fda1f0042 req-3beae4ee-0f67-4c7b-bb29-a766dc9a1399 service nova] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:59:11 user nova-compute[74996]: DEBUG nova.compute.manager [req-5d292ead-aefa-4adb-acfc-972fda1f0042 req-3beae4ee-0f67-4c7b-bb29-a766dc9a1399 service nova] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] No waiting events found dispatching network-vif-plugged-dffb12c9-41c5-480c-bb0f-f2a3fab03b8c {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:59:11 user nova-compute[74996]: WARNING nova.compute.manager [req-5d292ead-aefa-4adb-acfc-972fda1f0042 req-3beae4ee-0f67-4c7b-bb29-a766dc9a1399 service nova] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Received unexpected event network-vif-plugged-dffb12c9-41c5-480c-bb0f-f2a3fab03b8c for instance with vm_state building and task_state spawning.
Nov 02 01:59:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:13 user nova-compute[74996]: DEBUG nova.compute.manager [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 01:59:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 01:59:13 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Instance spawned successfully.
Nov 02 01:59:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 01:59:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:59:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:59:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:59:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:59:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:59:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 01:59:13 user nova-compute[74996]: DEBUG nova.compute.manager [req-63e7e45b-81ac-439d-b2b8-4f31fac3ee35 req-32a5573f-e774-4084-9cf1-b93819cc2276 service nova] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Received event network-vif-plugged-dffb12c9-41c5-480c-bb0f-f2a3fab03b8c {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:59:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-63e7e45b-81ac-439d-b2b8-4f31fac3ee35 req-32a5573f-e774-4084-9cf1-b93819cc2276 service nova] Acquiring lock "17b25747-b89d-43f0-a28a-afcf40d35e70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:59:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-63e7e45b-81ac-439d-b2b8-4f31fac3ee35 req-32a5573f-e774-4084-9cf1-b93819cc2276 service nova] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:59:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-63e7e45b-81ac-439d-b2b8-4f31fac3ee35 req-32a5573f-e774-4084-9cf1-b93819cc2276 service nova] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:59:13 user nova-compute[74996]: DEBUG nova.compute.manager [req-63e7e45b-81ac-439d-b2b8-4f31fac3ee35 req-32a5573f-e774-4084-9cf1-b93819cc2276 service nova] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] No waiting events found dispatching network-vif-plugged-dffb12c9-41c5-480c-bb0f-f2a3fab03b8c {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:59:13 user nova-compute[74996]: WARNING nova.compute.manager [req-63e7e45b-81ac-439d-b2b8-4f31fac3ee35 req-32a5573f-e774-4084-9cf1-b93819cc2276 service nova] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Received unexpected event network-vif-plugged-dffb12c9-41c5-480c-bb0f-f2a3fab03b8c for instance with vm_state building and task_state spawning.
Nov 02 01:59:13 user nova-compute[74996]: INFO nova.compute.manager [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 02 01:59:13 user nova-compute[74996]: DEBUG nova.compute.manager [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:59:13 user nova-compute[74996]: INFO nova.compute.manager [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Took 6.12 seconds to build instance.
Nov 02 01:59:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e0d7edf9-2e24-4503-9ca4-e26eb6364fc7 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.227s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:59:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:31 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:59:32 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:59:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:59:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:59:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:59:32 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 01:59:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e460e58e-e7c4-43de-a3b1-efa37430b0c4/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e460e58e-e7c4-43de-a3b1-efa37430b0c4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e460e58e-e7c4-43de-a3b1-efa37430b0c4/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e460e58e-e7c4-43de-a3b1-efa37430b0c4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 01:59:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:35 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:59:35 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 01:59:35 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8056MB free_disk=24.83559799194336GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 01:59:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:59:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:59:35 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance e38704a7-f8a0-482c-bd51-26a90d37b71d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:59:35 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7c53e6cc-cf69-485d-b24f-5e113dae0e5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:59:35 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 27863b45-4dda-4f6d-bd6f-0f332f1fdd52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:59:35 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance e460e58e-e7c4-43de-a3b1-efa37430b0c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:59:35 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 4f56890c-d135-42a1-b862-7ac5f9076654 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:59:35 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 6fed89e8-a427-4e00-8bba-144dedc9ab1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:59:35 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 17b25747-b89d-43f0-a28a-afcf40d35e70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 01:59:35 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 01:59:35 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.392s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-3f6e5991-c687-4390-aa83-09484b100469 req-3afc1452-dd8b-4ca1-94a5-cf75e0718122 service nova] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Received event network-changed-8b4a0277-bb35-4b8c-a16d-26b237e17258 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-3f6e5991-c687-4390-aa83-09484b100469 req-3afc1452-dd8b-4ca1-94a5-cf75e0718122 service nova] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Refreshing instance network info cache due to event network-changed-8b4a0277-bb35-4b8c-a16d-26b237e17258. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3f6e5991-c687-4390-aa83-09484b100469 req-3afc1452-dd8b-4ca1-94a5-cf75e0718122 service nova] Acquiring lock "refresh_cache-e460e58e-e7c4-43de-a3b1-efa37430b0c4" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3f6e5991-c687-4390-aa83-09484b100469 req-3afc1452-dd8b-4ca1-94a5-cf75e0718122 service nova] Acquired lock "refresh_cache-e460e58e-e7c4-43de-a3b1-efa37430b0c4" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG nova.network.neutron [req-3f6e5991-c687-4390-aa83-09484b100469 req-3afc1452-dd8b-4ca1-94a5-cf75e0718122 service nova] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Refreshing network info cache for port 8b4a0277-bb35-4b8c-a16d-26b237e17258 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG nova.objects.instance [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lazy-loading 'flavor' on Instance uuid e460e58e-e7c4-43de-a3b1-efa37430b0c4 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:59:36 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Ignoring supplied device name: /dev/vdb
Nov 02 01:59:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:59:36 user nova-compute[74996]: INFO nova.compute.manager [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Attaching volume 6236d92e-6b1d-4fa4-9cef-7a565ab982f3 to /dev/vdb
Nov 02 01:59:36 user nova-compute[74996]: DEBUG os_brick.utils [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd766fa3-2f43-4698-aee8-06b69ea14d51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG nova.network.neutron [req-3f6e5991-c687-4390-aa83-09484b100469 req-3afc1452-dd8b-4ca1-94a5-cf75e0718122 service nova] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Updated VIF entry in instance network info cache for port 8b4a0277-bb35-4b8c-a16d-26b237e17258. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG nova.network.neutron [req-3f6e5991-c687-4390-aa83-09484b100469 req-3afc1452-dd8b-4ca1-94a5-cf75e0718122 service nova] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Updating instance_info_cache with network_info: [{"id": "8b4a0277-bb35-4b8c-a16d-26b237e17258", "address": "fa:16:3e:3f:9d:1c", "network": {"id": "5d5d58ab-0d25-4d7e-b535-857923f4a7a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1163860226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "971ca9cd14604f619cc269252bdc0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4a0277-bb", "ovs_interfaceid": "8b4a0277-bb35-4b8c-a16d-26b237e17258", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f473b93-f7d1-47a2-9723-5868540f16b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3f6e5991-c687-4390-aa83-09484b100469 req-3afc1452-dd8b-4ca1-94a5-cf75e0718122 service nova] Releasing lock "refresh_cache-e460e58e-e7c4-43de-a3b1-efa37430b0c4" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf7c7d2-ad5f-4b6a-89e6-f96549896e32]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65d1d14-ac4b-4900-b55b-3a95ff9b9ecf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 01:59:36 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 01:59:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[424ce117-2fc2-4688-bbed-4091833c480e]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG os_brick.utils [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:59:36 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Updating existing volume attachment record: d344c916-2a8c-401f-8a63-e5a23e713898 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 01:59:37 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:59:37 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:59:37 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 01:59:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-27863b45-4dda-4f6d-bd6f-0f332f1fdd52" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:59:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-27863b45-4dda-4f6d-bd6f-0f332f1fdd52" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:59:37 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 01:59:37 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Updating instance_info_cache with network_info: [{"id": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "address": "fa:16:3e:2e:f5:1b", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa33b3-7d", "ovs_interfaceid": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:59:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-27863b45-4dda-4f6d-bd6f-0f332f1fdd52" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:59:37 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 01:59:37 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:59:37 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:59:37 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:59:37 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 01:59:38 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:59:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:42 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:59:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:46 user nova-compute[74996]: INFO nova.compute.manager [None req-eb3c6fbb-077f-4ac9-b278-2d8816fc8b55 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Unrescuing
Nov 02 01:59:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-eb3c6fbb-077f-4ac9-b278-2d8816fc8b55 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "refresh_cache-27863b45-4dda-4f6d-bd6f-0f332f1fdd52" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 01:59:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-eb3c6fbb-077f-4ac9-b278-2d8816fc8b55 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquired lock "refresh_cache-27863b45-4dda-4f6d-bd6f-0f332f1fdd52" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 01:59:46 user nova-compute[74996]: DEBUG nova.network.neutron [None req-eb3c6fbb-077f-4ac9-b278-2d8816fc8b55 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 01:59:47 user nova-compute[74996]: DEBUG nova.network.neutron [None req-eb3c6fbb-077f-4ac9-b278-2d8816fc8b55 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Updating instance_info_cache with network_info: [{"id": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "address": "fa:16:3e:2e:f5:1b", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa33b3-7d", "ovs_interfaceid": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 01:59:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-eb3c6fbb-077f-4ac9-b278-2d8816fc8b55 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Releasing lock "refresh_cache-27863b45-4dda-4f6d-bd6f-0f332f1fdd52" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 01:59:47 user nova-compute[74996]: DEBUG nova.objects.instance [None req-eb3c6fbb-077f-4ac9-b278-2d8816fc8b55 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lazy-loading 'flavor' on Instance uuid 27863b45-4dda-4f6d-bd6f-0f332f1fdd52 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:59:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:47 user nova-compute[74996]: DEBUG nova.compute.manager [req-3c9cac6a-fab0-40b9-8e3f-862bc57293e5 req-07f8d5a8-3651-4d57-96ba-25fc3be8b5f6 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Received event network-vif-unplugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:59:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3c9cac6a-fab0-40b9-8e3f-862bc57293e5 req-07f8d5a8-3651-4d57-96ba-25fc3be8b5f6 service nova] Acquiring lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:59:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3c9cac6a-fab0-40b9-8e3f-862bc57293e5 req-07f8d5a8-3651-4d57-96ba-25fc3be8b5f6 service nova] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:59:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3c9cac6a-fab0-40b9-8e3f-862bc57293e5 req-07f8d5a8-3651-4d57-96ba-25fc3be8b5f6 service nova] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:59:47 user nova-compute[74996]: DEBUG nova.compute.manager [req-3c9cac6a-fab0-40b9-8e3f-862bc57293e5 req-07f8d5a8-3651-4d57-96ba-25fc3be8b5f6 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] No waiting events found dispatching network-vif-unplugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:59:47 user nova-compute[74996]: WARNING nova.compute.manager [req-3c9cac6a-fab0-40b9-8e3f-862bc57293e5 req-07f8d5a8-3651-4d57-96ba-25fc3be8b5f6 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Received unexpected event network-vif-unplugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 for instance with vm_state rescued and task_state unrescuing.
Nov 02 01:59:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:47 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Instance destroyed successfully.
Nov 02 01:59:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:49 user nova-compute[74996]: DEBUG nova.compute.manager [req-c1853779-f858-48b3-8cda-3233c72cbb36 req-95ea1f74-f72e-469f-9c58-9e4f617e6c95 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Received event network-vif-plugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:59:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c1853779-f858-48b3-8cda-3233c72cbb36 req-95ea1f74-f72e-469f-9c58-9e4f617e6c95 service nova] Acquiring lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:59:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c1853779-f858-48b3-8cda-3233c72cbb36 req-95ea1f74-f72e-469f-9c58-9e4f617e6c95 service nova] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:59:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c1853779-f858-48b3-8cda-3233c72cbb36 req-95ea1f74-f72e-469f-9c58-9e4f617e6c95 service nova] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:59:49 user nova-compute[74996]: DEBUG nova.compute.manager [req-c1853779-f858-48b3-8cda-3233c72cbb36 req-95ea1f74-f72e-469f-9c58-9e4f617e6c95 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] No waiting events found dispatching network-vif-plugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:59:49 user nova-compute[74996]: WARNING nova.compute.manager [req-c1853779-f858-48b3-8cda-3233c72cbb36 req-95ea1f74-f72e-469f-9c58-9e4f617e6c95 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Received unexpected event network-vif-plugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 for instance with vm_state rescued and task_state unrescuing.
Nov 02 01:59:49 user nova-compute[74996]: DEBUG nova.compute.manager [req-c1853779-f858-48b3-8cda-3233c72cbb36 req-95ea1f74-f72e-469f-9c58-9e4f617e6c95 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Received event network-vif-plugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:59:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c1853779-f858-48b3-8cda-3233c72cbb36 req-95ea1f74-f72e-469f-9c58-9e4f617e6c95 service nova] Acquiring lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:59:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c1853779-f858-48b3-8cda-3233c72cbb36 req-95ea1f74-f72e-469f-9c58-9e4f617e6c95 service nova] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:59:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c1853779-f858-48b3-8cda-3233c72cbb36 req-95ea1f74-f72e-469f-9c58-9e4f617e6c95 service nova] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:59:49 user nova-compute[74996]: DEBUG nova.compute.manager [req-c1853779-f858-48b3-8cda-3233c72cbb36 req-95ea1f74-f72e-469f-9c58-9e4f617e6c95 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] No waiting events found dispatching network-vif-plugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:59:49 user nova-compute[74996]: WARNING nova.compute.manager [req-c1853779-f858-48b3-8cda-3233c72cbb36 req-95ea1f74-f72e-469f-9c58-9e4f617e6c95 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Received unexpected event network-vif-plugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 for instance with vm_state rescued and task_state unrescuing.
Nov 02 01:59:49 user nova-compute[74996]: DEBUG nova.compute.manager [req-c1853779-f858-48b3-8cda-3233c72cbb36 req-95ea1f74-f72e-469f-9c58-9e4f617e6c95 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Received event network-vif-plugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 01:59:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c1853779-f858-48b3-8cda-3233c72cbb36 req-95ea1f74-f72e-469f-9c58-9e4f617e6c95 service nova] Acquiring lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 01:59:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c1853779-f858-48b3-8cda-3233c72cbb36 req-95ea1f74-f72e-469f-9c58-9e4f617e6c95 service nova] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 01:59:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c1853779-f858-48b3-8cda-3233c72cbb36 req-95ea1f74-f72e-469f-9c58-9e4f617e6c95 service nova] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:59:49 user nova-compute[74996]: DEBUG nova.compute.manager [req-c1853779-f858-48b3-8cda-3233c72cbb36 req-95ea1f74-f72e-469f-9c58-9e4f617e6c95 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] No waiting events found dispatching network-vif-plugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 01:59:49 user nova-compute[74996]: WARNING nova.compute.manager [req-c1853779-f858-48b3-8cda-3233c72cbb36 req-95ea1f74-f72e-469f-9c58-9e4f617e6c95 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Received unexpected event network-vif-plugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 for instance with vm_state rescued and task_state unrescuing.
Nov 02 01:59:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:50 user nova-compute[74996]: DEBUG nova.compute.manager [None req-eb3c6fbb-077f-4ac9-b278-2d8816fc8b55 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 01:59:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iZYLzydw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 01:59:55 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:59:55 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:59:55 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 01:59:55 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 01:59:55 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 01:59:55 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf634a3d-73ae-4020-90b6-182e64e23532]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 01:59:55 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5b9e75-1bc1-4cb5-873d-28f6961dd26f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3] added
Nov 02 01:59:55 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef876499-d5c4-48c6-9637-6314d382d1b4]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.120s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f085329-93ed-4409-9e9b-faeb4d397443]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iZYLzydw {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iZYLzydw" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf481138-ad92-4f3a-9ad9-6d58f013b00e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iZYLzydw'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae39ee5-c0dc-4d93-90d3-1f3c5e2e17f9]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[002157ae-594b-4626-aef4-759b629560e1]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)
Nov 02 01:59:55 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)
Nov 02 01:59:55 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.146s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5978aa-589b-4587-8f22-a0e5713dfc9b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3, portal: 172.16.0.220,3260]
Nov 02 01:59:55 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3, portal: 172.16.0.220,3260] successful.
Nov 02 01:59:55 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61154af-3c68-43f9-ad2d-a858f17d0f17]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 01:59:55 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:56 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1bdb5d-96b1-4917-b137-c83089703ce2]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:59:56 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)
Nov 02 01:59:56 user nova-compute[74996]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 (non-flash)
Nov 02 01:59:56 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 01:59:56 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)
Nov 02 01:59:56 user nova-compute[74996]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 (non-flash)
Nov 02 01:59:56 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 01:59:56 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.471s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:59:56 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 01:59:56 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 01:59:56 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 01:59:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 01:59:56 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 01:59:56 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6c0899-94f7-45d0-bde5-056810c26ee7]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 01:59:56 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: None {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:59:56 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 01:59:57 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 01:59:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iZYLzydw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 01:59:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.505s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 01:59:57 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] <== connect_volume: return (1506ms) {'type': 'block', 'scsi_wwn': '26562646538386339', 'path': '/dev/sdc'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 01:59:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562646538386339', 'path': '/dev/sdc'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 01:59:57 user nova-compute[74996]: DEBUG nova.objects.instance [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lazy-loading 'flavor' on Instance uuid e460e58e-e7c4-43de-a3b1-efa37430b0c4 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 01:59:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 01:59:57 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 01:59:57 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 01:59:57 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 01:59:57 user nova-compute[74996]:   <serial>6236d92e-6b1d-4fa4-9cef-7a565ab982f3</serial>
Nov 02 01:59:57 user nova-compute[74996]: </disk>
Nov 02 01:59:57 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 01:59:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:59:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 01:59:57 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] No VIF found with MAC fa:16:3e:3f:9d:1c, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 01:59:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a6c10112-fe6f-41a7-93c0-67603b2fa1b9 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.992s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 01:59:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:00:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "4f56890c-d135-42a1-b862-7ac5f9076654" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:00:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "4f56890c-d135-42a1-b862-7ac5f9076654" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:00:07 user nova-compute[74996]: DEBUG nova.objects.instance [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lazy-loading 'flavor' on Instance uuid 4f56890c-d135-42a1-b862-7ac5f9076654 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:00:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "4f56890c-d135-42a1-b862-7ac5f9076654" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:00:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "4f56890c-d135-42a1-b862-7ac5f9076654" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:00:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "4f56890c-d135-42a1-b862-7ac5f9076654" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:00:07 user nova-compute[74996]: INFO nova.compute.manager [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Attaching volume a86c480c-2ecb-4347-b194-d6ce06ca9425 to /dev/vdb
Nov 02 02:00:07 user nova-compute[74996]: DEBUG os_brick.utils [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:00:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:07 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acdee60-c447-4d11-a620-77f9f356e4f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:00:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:07 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3eb037c-684e-49ab-97fc-baadf1d9b041]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:00:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:07 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e7adcb-b7fa-45b0-b747-d639dcfa3c16]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:00:07 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45278ac-1590-473f-a113-644a567a7ec6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:00:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 02:00:07 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 02:00:07 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:08 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 02:00:08 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 02:00:08 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[697bb308-8fc7-40ac-86c6-7a3b0b15ba5b]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:00:08 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 02:00:08 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 02:00:08 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 02:00:08 user nova-compute[74996]: DEBUG os_brick.utils [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:00:08 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Updating existing volume attachment record: 9852a1e1-5ecd-4a7a-a18c-97eb9c7eaf00 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 02:00:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:00:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:00:31 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:00:32 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:00:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:00:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:00:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:00:32 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 02:00:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:32 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e460e58e-e7c4-43de-a3b1-efa37430b0c4/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e460e58e-e7c4-43de-a3b1-efa37430b0c4/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e460e58e-e7c4-43de-a3b1-efa37430b0c4/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e460e58e-e7c4-43de-a3b1-efa37430b0c4/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 02:00:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 02:00:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:00:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:36 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:00:36 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:00:36 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8079MB free_disk=24.823871612548828GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 02:00:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:00:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:00:36 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance e38704a7-f8a0-482c-bd51-26a90d37b71d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:00:36 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7c53e6cc-cf69-485d-b24f-5e113dae0e5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:00:36 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 27863b45-4dda-4f6d-bd6f-0f332f1fdd52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:00:36 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance e460e58e-e7c4-43de-a3b1-efa37430b0c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:00:36 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 4f56890c-d135-42a1-b862-7ac5f9076654 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:00:36 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 6fed89e8-a427-4e00-8bba-144dedc9ab1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:00:36 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 17b25747-b89d-43f0-a28a-afcf40d35e70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:00:36 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 02:00:36 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 02:00:36 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:00:36 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:00:36 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 02:00:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.523s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:00:37 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:00:37 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:00:37 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:00:37 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:00:37 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 02:00:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 02:00:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dxBwKaIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:00:37 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:00:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:00:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:00:37 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:00:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:00:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:00:37 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 02:00:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f572375-706f-4f34-9550-56c416e99af9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:00:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 02:00:37 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:00:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1538913d-ada3-4091-b82c-bedcdb928257]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:00:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425] added
Nov 02 02:00:37 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb41463-6630-4cd1-a5e8-88ce34e22df4]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7220a221-5982-4c49-81ba-3f9cdbd860c5]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dxBwKaIL {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dxBwKaIL" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb94d9b2-2cf5-41f1-b4ee-91d71fb6f7f8]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dxBwKaIL'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bfb616-7f80-463b-9b9c-84526f92f378]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[67abd84c-de39-43bb-8cfe-ac80afd69129]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)
Nov 02 02:00:38 user nova-compute[74996]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 (non-flash)
Nov 02 02:00:38 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)
Nov 02 02:00:38 user nova-compute[74996]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 (non-flash)
Nov 02 02:00:38 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf661307-3896-4d09-9718-6c006f6deac2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425, portal: 172.16.0.220,3260]
Nov 02 02:00:38 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425, portal: 172.16.0.220,3260] successful.
Nov 02 02:00:38 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Rebuilding the list of instances to heal {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6673733-c685-42e7-9336-daae21d59b65]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d60378-9f2a-49a8-a706-477ede179a19]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)
Nov 02 02:00:38 user nova-compute[74996]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 (non-flash)
Nov 02 02:00:38 user nova-compute[74996]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 (non-flash)
Nov 02 02:00:38 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)
Nov 02 02:00:38 user nova-compute[74996]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 (non-flash)
Nov 02 02:00:38 user nova-compute[74996]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 (non-flash)
Nov 02 02:00:38 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed763c29-23d8-4e95-a80e-f787f32f93af]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dxBwKaIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-e38704a7-f8a0-482c-bd51-26a90d37b71d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-e38704a7-f8a0-482c-bd51-26a90d37b71d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG nova.objects.instance [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lazy-loading 'info_cache' on Instance uuid e38704a7-f8a0-482c-bd51-26a90d37b71d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Updating instance_info_cache with network_info: [{"id": "b5d6eb99-a00c-4440-98d6-6432b493f131", "address": "fa:16:3e:67:64:10", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d6eb99-a0", "ovs_interfaceid": "b5d6eb99-a00c-4440-98d6-6432b493f131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-e38704a7-f8a0-482c-bd51-26a90d37b71d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 02:00:38 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:00:39 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:00:39 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26364633062623534', 'path': '/dev/sdd'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:00:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364633062623534', 'path': '/dev/sdd'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 02:00:39 user nova-compute[74996]: DEBUG nova.objects.instance [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lazy-loading 'flavor' on Instance uuid 4f56890c-d135-42a1-b862-7ac5f9076654 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:00:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 02:00:39 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:00:39 user nova-compute[74996]:   <source dev="/dev/sdd"/>
Nov 02 02:00:39 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:00:39 user nova-compute[74996]:   <serial>a86c480c-2ecb-4347-b194-d6ce06ca9425</serial>
Nov 02 02:00:39 user nova-compute[74996]: </disk>
Nov 02 02:00:39 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 02:00:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:00:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:00:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:00:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] No VIF found with MAC fa:16:3e:ef:c5:84, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 02:00:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e6d7d6d7-c900-4fd3-945d-b4833a57cc6e tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "4f56890c-d135-42a1-b862-7ac5f9076654" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.012s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:00:40 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:00:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:42 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:00:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d3e48476-ab65-4064-9c47-341306ee30f5 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:00:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d3e48476-ab65-4064-9c47-341306ee30f5 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:00:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d3e48476-ab65-4064-9c47-341306ee30f5 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:00:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d3e48476-ab65-4064-9c47-341306ee30f5 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:00:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d3e48476-ab65-4064-9c47-341306ee30f5 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:00:42 user nova-compute[74996]: INFO nova.compute.manager [None req-d3e48476-ab65-4064-9c47-341306ee30f5 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Terminating instance
Nov 02 02:00:42 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d3e48476-ab65-4064-9c47-341306ee30f5 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 02:00:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:42 user nova-compute[74996]: DEBUG nova.compute.manager [req-f772eb86-76d5-4bd6-ae97-14ed883e05ea req-621706b1-935e-448c-91a2-10b02477e79f service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Received event network-changed-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:00:42 user nova-compute[74996]: DEBUG nova.compute.manager [req-f772eb86-76d5-4bd6-ae97-14ed883e05ea req-621706b1-935e-448c-91a2-10b02477e79f service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Refreshing instance network info cache due to event network-changed-78937d9b-197e-4ff7-8e1c-c26daa12fcc8. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 02:00:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f772eb86-76d5-4bd6-ae97-14ed883e05ea req-621706b1-935e-448c-91a2-10b02477e79f service nova] Acquiring lock "refresh_cache-4f56890c-d135-42a1-b862-7ac5f9076654" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:00:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f772eb86-76d5-4bd6-ae97-14ed883e05ea req-621706b1-935e-448c-91a2-10b02477e79f service nova] Acquired lock "refresh_cache-4f56890c-d135-42a1-b862-7ac5f9076654" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:00:42 user nova-compute[74996]: DEBUG nova.network.neutron [req-f772eb86-76d5-4bd6-ae97-14ed883e05ea req-621706b1-935e-448c-91a2-10b02477e79f service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Refreshing network info cache for port 78937d9b-197e-4ff7-8e1c-c26daa12fcc8 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 02:00:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-64fe7164-75fd-41c6-89af-ec5fa5961a5c req-a3ed37f6-a7fa-49ba-a21a-0c5a7c86f4de service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Received event network-vif-unplugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:00:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-64fe7164-75fd-41c6-89af-ec5fa5961a5c req-a3ed37f6-a7fa-49ba-a21a-0c5a7c86f4de service nova] Acquiring lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:00:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-64fe7164-75fd-41c6-89af-ec5fa5961a5c req-a3ed37f6-a7fa-49ba-a21a-0c5a7c86f4de service nova] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:00:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-64fe7164-75fd-41c6-89af-ec5fa5961a5c req-a3ed37f6-a7fa-49ba-a21a-0c5a7c86f4de service nova] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:00:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-64fe7164-75fd-41c6-89af-ec5fa5961a5c req-a3ed37f6-a7fa-49ba-a21a-0c5a7c86f4de service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] No waiting events found dispatching network-vif-unplugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:00:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-64fe7164-75fd-41c6-89af-ec5fa5961a5c req-a3ed37f6-a7fa-49ba-a21a-0c5a7c86f4de service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Received event network-vif-unplugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 02:00:43 user nova-compute[74996]: DEBUG nova.network.neutron [req-f772eb86-76d5-4bd6-ae97-14ed883e05ea req-621706b1-935e-448c-91a2-10b02477e79f service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Updated VIF entry in instance network info cache for port 78937d9b-197e-4ff7-8e1c-c26daa12fcc8. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 02:00:43 user nova-compute[74996]: DEBUG nova.network.neutron [req-f772eb86-76d5-4bd6-ae97-14ed883e05ea req-621706b1-935e-448c-91a2-10b02477e79f service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Updating instance_info_cache with network_info: [{"id": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "address": "fa:16:3e:ef:c5:84", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78937d9b-19", "ovs_interfaceid": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:00:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-f772eb86-76d5-4bd6-ae97-14ed883e05ea req-621706b1-935e-448c-91a2-10b02477e79f service nova] Releasing lock "refresh_cache-4f56890c-d135-42a1-b862-7ac5f9076654" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:00:43 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Instance destroyed successfully.
Nov 02 02:00:43 user nova-compute[74996]: DEBUG nova.objects.instance [None req-d3e48476-ab65-4064-9c47-341306ee30f5 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lazy-loading 'resources' on Instance uuid 6fed89e8-a427-4e00-8bba-144dedc9ab1c {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:00:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-d3e48476-ab65-4064-9c47-341306ee30f5 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-02T01:55:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-818920333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-818920333',id=39,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJK2CwSeTpDLIUeMIBLT4PtH5q7fxUV7NAatQGrJ1Lx6MS+E+zjr3mfDsjIyZbP9qqId/6fWYkwaBc/CiiXBZnomBxbD6xFRQ8jZC0ANus4eCWyBhNbF1mQkIftWzwdyUw==',key_name='tempest-keypair-1113388504',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:59:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='22b862880e0c43ab8f5a4d65f6697955',ramdisk_id='',reservation_id='r-2s89a6k1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-701748724',owner_user_name='tempest-AttachVolumeShelveTestJSON-701748724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:59:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01fc2ea044794374b09741ecaf841ba2',uuid=6fed89e8-a427-4e00-8bba-144dedc9ab1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "address": "fa:16:3e:02:47:7a", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef383fd9-4f", "ovs_interfaceid": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 02:00:43 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-d3e48476-ab65-4064-9c47-341306ee30f5 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Converting VIF {"id": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "address": "fa:16:3e:02:47:7a", "network": {"id": "936a0e26-8a02-4c7c-9d24-acbb2f438cd4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-256234899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22b862880e0c43ab8f5a4d65f6697955", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef383fd9-4f", "ovs_interfaceid": "ef383fd9-4ffc-495b-ab4f-732f933a0391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:00:43 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-d3e48476-ab65-4064-9c47-341306ee30f5 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:47:7a,bridge_name='br-int',has_traffic_filtering=True,id=ef383fd9-4ffc-495b-ab4f-732f933a0391,network=Network(936a0e26-8a02-4c7c-9d24-acbb2f438cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef383fd9-4f') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:00:43 user nova-compute[74996]: DEBUG os_vif [None req-d3e48476-ab65-4064-9c47-341306ee30f5 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:47:7a,bridge_name='br-int',has_traffic_filtering=True,id=ef383fd9-4ffc-495b-ab4f-732f933a0391,network=Network(936a0e26-8a02-4c7c-9d24-acbb2f438cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef383fd9-4f') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 02:00:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef383fd9-4f, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:00:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e2058058-0bf1-48f8-9a90-c5e5099b5344) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:00:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:00:43 user nova-compute[74996]: INFO os_vif [None req-d3e48476-ab65-4064-9c47-341306ee30f5 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:47:7a,bridge_name='br-int',has_traffic_filtering=True,id=ef383fd9-4ffc-495b-ab4f-732f933a0391,network=Network(936a0e26-8a02-4c7c-9d24-acbb2f438cd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef383fd9-4f')
Nov 02 02:00:43 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-d3e48476-ab65-4064-9c47-341306ee30f5 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Deleting instance files /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c_del
Nov 02 02:00:43 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-d3e48476-ab65-4064-9c47-341306ee30f5 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Deletion of /opt/stack/data/nova/instances/6fed89e8-a427-4e00-8bba-144dedc9ab1c_del complete
Nov 02 02:00:43 user nova-compute[74996]: INFO nova.compute.manager [None req-d3e48476-ab65-4064-9c47-341306ee30f5 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 02 02:00:43 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-d3e48476-ab65-4064-9c47-341306ee30f5 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 02:00:43 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 02:00:43 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 02:00:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:44 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:00:44 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Took 1.08 seconds to deallocate network for instance.
Nov 02 02:00:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d3e48476-ab65-4064-9c47-341306ee30f5 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:00:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d3e48476-ab65-4064-9c47-341306ee30f5 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:00:44 user nova-compute[74996]: DEBUG nova.compute.manager [req-6e40c884-8830-4b92-b493-b3dc7f87822b req-853b035e-6cfe-4da0-acb2-76801b252575 service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Received event network-vif-deleted-ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:00:44 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d3e48476-ab65-4064-9c47-341306ee30f5 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:00:44 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d3e48476-ab65-4064-9c47-341306ee30f5 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:00:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d3e48476-ab65-4064-9c47-341306ee30f5 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:00:45 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-d3e48476-ab65-4064-9c47-341306ee30f5 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Deleted allocations for instance 6fed89e8-a427-4e00-8bba-144dedc9ab1c
Nov 02 02:00:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d3e48476-ab65-4064-9c47-341306ee30f5 tempest-AttachVolumeShelveTestJSON-701748724 tempest-AttachVolumeShelveTestJSON-701748724-project-member] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.431s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:00:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-d74763e4-1d89-44ff-b165-d107b29d7f32 req-b152e2ce-472a-448e-b596-eea95d91f5fc service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Received event network-vif-plugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:00:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d74763e4-1d89-44ff-b165-d107b29d7f32 req-b152e2ce-472a-448e-b596-eea95d91f5fc service nova] Acquiring lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:00:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d74763e4-1d89-44ff-b165-d107b29d7f32 req-b152e2ce-472a-448e-b596-eea95d91f5fc service nova] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:00:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d74763e4-1d89-44ff-b165-d107b29d7f32 req-b152e2ce-472a-448e-b596-eea95d91f5fc service nova] Lock "6fed89e8-a427-4e00-8bba-144dedc9ab1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:00:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-d74763e4-1d89-44ff-b165-d107b29d7f32 req-b152e2ce-472a-448e-b596-eea95d91f5fc service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] No waiting events found dispatching network-vif-plugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:00:45 user nova-compute[74996]: WARNING nova.compute.manager [req-d74763e4-1d89-44ff-b165-d107b29d7f32 req-b152e2ce-472a-448e-b596-eea95d91f5fc service nova] [instance: 6fed89e8-a427-4e00-8bba-144dedc9ab1c] Received unexpected event network-vif-plugged-ef383fd9-4ffc-495b-ab4f-732f933a0391 for instance with vm_state deleted and task_state None.
Nov 02 02:00:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4a9ad1dd-62ad-4ab1-b2dc-acd6b91c3997 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "4f56890c-d135-42a1-b862-7ac5f9076654" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:00:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4a9ad1dd-62ad-4ab1-b2dc-acd6b91c3997 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "4f56890c-d135-42a1-b862-7ac5f9076654" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:00:45 user nova-compute[74996]: INFO nova.compute.manager [None req-4a9ad1dd-62ad-4ab1-b2dc-acd6b91c3997 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Rebooting instance
Nov 02 02:00:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4a9ad1dd-62ad-4ab1-b2dc-acd6b91c3997 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "refresh_cache-4f56890c-d135-42a1-b862-7ac5f9076654" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:00:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4a9ad1dd-62ad-4ab1-b2dc-acd6b91c3997 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquired lock "refresh_cache-4f56890c-d135-42a1-b862-7ac5f9076654" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:00:45 user nova-compute[74996]: DEBUG nova.network.neutron [None req-4a9ad1dd-62ad-4ab1-b2dc-acd6b91c3997 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 02:00:46 user nova-compute[74996]: DEBUG nova.network.neutron [None req-4a9ad1dd-62ad-4ab1-b2dc-acd6b91c3997 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Updating instance_info_cache with network_info: [{"id": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "address": "fa:16:3e:ef:c5:84", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78937d9b-19", "ovs_interfaceid": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:00:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4a9ad1dd-62ad-4ab1-b2dc-acd6b91c3997 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Releasing lock "refresh_cache-4f56890c-d135-42a1-b862-7ac5f9076654" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:00:46 user nova-compute[74996]: DEBUG nova.compute.manager [None req-4a9ad1dd-62ad-4ab1-b2dc-acd6b91c3997 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 02:00:47 user nova-compute[74996]: DEBUG nova.compute.manager [req-bdff372a-006e-4af9-b785-d5a2bbd3747a req-fe4205bc-4778-4a52-a75c-aee4d86d8efa service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Received event network-changed-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:00:47 user nova-compute[74996]: DEBUG nova.compute.manager [req-bdff372a-006e-4af9-b785-d5a2bbd3747a req-fe4205bc-4778-4a52-a75c-aee4d86d8efa service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Refreshing instance network info cache due to event network-changed-78937d9b-197e-4ff7-8e1c-c26daa12fcc8. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 02:00:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-bdff372a-006e-4af9-b785-d5a2bbd3747a req-fe4205bc-4778-4a52-a75c-aee4d86d8efa service nova] Acquiring lock "refresh_cache-4f56890c-d135-42a1-b862-7ac5f9076654" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:00:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-bdff372a-006e-4af9-b785-d5a2bbd3747a req-fe4205bc-4778-4a52-a75c-aee4d86d8efa service nova] Acquired lock "refresh_cache-4f56890c-d135-42a1-b862-7ac5f9076654" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:00:47 user nova-compute[74996]: DEBUG nova.network.neutron [req-bdff372a-006e-4af9-b785-d5a2bbd3747a req-fe4205bc-4778-4a52-a75c-aee4d86d8efa service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Refreshing network info cache for port 78937d9b-197e-4ff7-8e1c-c26daa12fcc8 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 02:00:47 user nova-compute[74996]: DEBUG nova.network.neutron [req-bdff372a-006e-4af9-b785-d5a2bbd3747a req-fe4205bc-4778-4a52-a75c-aee4d86d8efa service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Updated VIF entry in instance network info cache for port 78937d9b-197e-4ff7-8e1c-c26daa12fcc8. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 02:00:47 user nova-compute[74996]: DEBUG nova.network.neutron [req-bdff372a-006e-4af9-b785-d5a2bbd3747a req-fe4205bc-4778-4a52-a75c-aee4d86d8efa service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Updating instance_info_cache with network_info: [{"id": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "address": "fa:16:3e:ef:c5:84", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78937d9b-19", "ovs_interfaceid": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:00:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-bdff372a-006e-4af9-b785-d5a2bbd3747a req-fe4205bc-4778-4a52-a75c-aee4d86d8efa service nova] Releasing lock "refresh_cache-4f56890c-d135-42a1-b862-7ac5f9076654" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:00:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:49 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:00:49 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Cleaning up deleted instances {{(pid=74996) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 02:00:49 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] There are 0 instances to clean {{(pid=74996) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 02:00:49 user nova-compute[74996]: DEBUG nova.compute.manager [req-8166971a-d106-4e04-bb74-d3dd178aa520 req-f13975c2-2d15-4738-a512-fdc9ede427c7 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Received event network-vif-unplugged-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:00:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8166971a-d106-4e04-bb74-d3dd178aa520 req-f13975c2-2d15-4738-a512-fdc9ede427c7 service nova] Acquiring lock "4f56890c-d135-42a1-b862-7ac5f9076654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:00:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8166971a-d106-4e04-bb74-d3dd178aa520 req-f13975c2-2d15-4738-a512-fdc9ede427c7 service nova] Lock "4f56890c-d135-42a1-b862-7ac5f9076654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:00:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8166971a-d106-4e04-bb74-d3dd178aa520 req-f13975c2-2d15-4738-a512-fdc9ede427c7 service nova] Lock "4f56890c-d135-42a1-b862-7ac5f9076654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:00:49 user nova-compute[74996]: DEBUG nova.compute.manager [req-8166971a-d106-4e04-bb74-d3dd178aa520 req-f13975c2-2d15-4738-a512-fdc9ede427c7 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] No waiting events found dispatching network-vif-unplugged-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:00:49 user nova-compute[74996]: WARNING nova.compute.manager [req-8166971a-d106-4e04-bb74-d3dd178aa520 req-f13975c2-2d15-4738-a512-fdc9ede427c7 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Received unexpected event network-vif-unplugged-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 for instance with vm_state active and task_state reboot_started.
Nov 02 02:00:49 user nova-compute[74996]: DEBUG nova.compute.manager [req-8166971a-d106-4e04-bb74-d3dd178aa520 req-f13975c2-2d15-4738-a512-fdc9ede427c7 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Received event network-vif-plugged-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:00:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8166971a-d106-4e04-bb74-d3dd178aa520 req-f13975c2-2d15-4738-a512-fdc9ede427c7 service nova] Acquiring lock "4f56890c-d135-42a1-b862-7ac5f9076654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:00:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8166971a-d106-4e04-bb74-d3dd178aa520 req-f13975c2-2d15-4738-a512-fdc9ede427c7 service nova] Lock "4f56890c-d135-42a1-b862-7ac5f9076654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:00:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8166971a-d106-4e04-bb74-d3dd178aa520 req-f13975c2-2d15-4738-a512-fdc9ede427c7 service nova] Lock "4f56890c-d135-42a1-b862-7ac5f9076654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:00:49 user nova-compute[74996]: DEBUG nova.compute.manager [req-8166971a-d106-4e04-bb74-d3dd178aa520 req-f13975c2-2d15-4738-a512-fdc9ede427c7 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] No waiting events found dispatching network-vif-plugged-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:00:49 user nova-compute[74996]: WARNING nova.compute.manager [req-8166971a-d106-4e04-bb74-d3dd178aa520 req-f13975c2-2d15-4738-a512-fdc9ede427c7 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Received unexpected event network-vif-plugged-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 for instance with vm_state active and task_state reboot_started.
Nov 02 02:00:49 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-4a9ad1dd-62ad-4ab1-b2dc-acd6b91c3997 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Instance shutdown successfully.
Nov 02 02:00:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-7fcf5dde-dbe1-4132-bb2a-66d4cc586ccc req-de6843cb-bd18-4d23-ae8d-be2ea48dc530 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Received event network-vif-plugged-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:00:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7fcf5dde-dbe1-4132-bb2a-66d4cc586ccc req-de6843cb-bd18-4d23-ae8d-be2ea48dc530 service nova] Acquiring lock "4f56890c-d135-42a1-b862-7ac5f9076654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:00:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7fcf5dde-dbe1-4132-bb2a-66d4cc586ccc req-de6843cb-bd18-4d23-ae8d-be2ea48dc530 service nova] Lock "4f56890c-d135-42a1-b862-7ac5f9076654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:00:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7fcf5dde-dbe1-4132-bb2a-66d4cc586ccc req-de6843cb-bd18-4d23-ae8d-be2ea48dc530 service nova] Lock "4f56890c-d135-42a1-b862-7ac5f9076654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:00:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-7fcf5dde-dbe1-4132-bb2a-66d4cc586ccc req-de6843cb-bd18-4d23-ae8d-be2ea48dc530 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] No waiting events found dispatching network-vif-plugged-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:00:51 user nova-compute[74996]: WARNING nova.compute.manager [req-7fcf5dde-dbe1-4132-bb2a-66d4cc586ccc req-de6843cb-bd18-4d23-ae8d-be2ea48dc530 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Received unexpected event network-vif-plugged-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 for instance with vm_state active and task_state reboot_started.
Nov 02 02:00:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-7fcf5dde-dbe1-4132-bb2a-66d4cc586ccc req-de6843cb-bd18-4d23-ae8d-be2ea48dc530 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Received event network-vif-plugged-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:00:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7fcf5dde-dbe1-4132-bb2a-66d4cc586ccc req-de6843cb-bd18-4d23-ae8d-be2ea48dc530 service nova] Acquiring lock "4f56890c-d135-42a1-b862-7ac5f9076654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:00:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7fcf5dde-dbe1-4132-bb2a-66d4cc586ccc req-de6843cb-bd18-4d23-ae8d-be2ea48dc530 service nova] Lock "4f56890c-d135-42a1-b862-7ac5f9076654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:00:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7fcf5dde-dbe1-4132-bb2a-66d4cc586ccc req-de6843cb-bd18-4d23-ae8d-be2ea48dc530 service nova] Lock "4f56890c-d135-42a1-b862-7ac5f9076654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:00:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-7fcf5dde-dbe1-4132-bb2a-66d4cc586ccc req-de6843cb-bd18-4d23-ae8d-be2ea48dc530 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] No waiting events found dispatching network-vif-plugged-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:00:51 user nova-compute[74996]: WARNING nova.compute.manager [req-7fcf5dde-dbe1-4132-bb2a-66d4cc586ccc req-de6843cb-bd18-4d23-ae8d-be2ea48dc530 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Received unexpected event network-vif-plugged-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 for instance with vm_state active and task_state reboot_started.
Nov 02 02:00:52 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:00:52 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74996) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 02:00:52 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Instance running successfully.
Nov 02 02:00:52 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-4a9ad1dd-62ad-4ab1-b2dc-acd6b91c3997 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Instance soft rebooted successfully.
Nov 02 02:00:52 user nova-compute[74996]: DEBUG nova.compute.manager [None req-4a9ad1dd-62ad-4ab1-b2dc-acd6b91c3997 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 02:00:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-4a9ad1dd-62ad-4ab1-b2dc-acd6b91c3997 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "4f56890c-d135-42a1-b862-7ac5f9076654" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.090s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:00:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:58 user nova-compute[74996]: DEBUG nova.compute.manager [req-4bc9839d-f972-454d-9056-ee1aa1fc4d29 req-8c771637-b9a5-4efb-a557-8579e7388de3 service nova] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Received event network-changed-dffb12c9-41c5-480c-bb0f-f2a3fab03b8c {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:00:58 user nova-compute[74996]: DEBUG nova.compute.manager [req-4bc9839d-f972-454d-9056-ee1aa1fc4d29 req-8c771637-b9a5-4efb-a557-8579e7388de3 service nova] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Refreshing instance network info cache due to event network-changed-dffb12c9-41c5-480c-bb0f-f2a3fab03b8c. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 02:00:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4bc9839d-f972-454d-9056-ee1aa1fc4d29 req-8c771637-b9a5-4efb-a557-8579e7388de3 service nova] Acquiring lock "refresh_cache-17b25747-b89d-43f0-a28a-afcf40d35e70" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:00:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4bc9839d-f972-454d-9056-ee1aa1fc4d29 req-8c771637-b9a5-4efb-a557-8579e7388de3 service nova] Acquired lock "refresh_cache-17b25747-b89d-43f0-a28a-afcf40d35e70" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:00:58 user nova-compute[74996]: DEBUG nova.network.neutron [req-4bc9839d-f972-454d-9056-ee1aa1fc4d29 req-8c771637-b9a5-4efb-a557-8579e7388de3 service nova] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Refreshing network info cache for port dffb12c9-41c5-480c-bb0f-f2a3fab03b8c {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 02:00:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:58 user nova-compute[74996]: DEBUG nova.network.neutron [req-4bc9839d-f972-454d-9056-ee1aa1fc4d29 req-8c771637-b9a5-4efb-a557-8579e7388de3 service nova] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Updated VIF entry in instance network info cache for port dffb12c9-41c5-480c-bb0f-f2a3fab03b8c. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 02:00:58 user nova-compute[74996]: DEBUG nova.network.neutron [req-4bc9839d-f972-454d-9056-ee1aa1fc4d29 req-8c771637-b9a5-4efb-a557-8579e7388de3 service nova] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Updating instance_info_cache with network_info: [{"id": "dffb12c9-41c5-480c-bb0f-f2a3fab03b8c", "address": "fa:16:3e:9e:8e:1e", "network": {"id": "aea5e8b6-0fff-4614-b29c-d62929cce6ab", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1836711877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3ff0532d194b0c9181d9dde14227b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffb12c9-41", "ovs_interfaceid": "dffb12c9-41c5-480c-bb0f-f2a3fab03b8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:00:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:00:58 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4bc9839d-f972-454d-9056-ee1aa1fc4d29 req-8c771637-b9a5-4efb-a557-8579e7388de3 service nova] Releasing lock "refresh_cache-17b25747-b89d-43f0-a28a-afcf40d35e70" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:01:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:01:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:01:01 user nova-compute[74996]: INFO nova.compute.manager [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Detaching volume 6236d92e-6b1d-4fa4-9cef-7a565ab982f3
Nov 02 02:01:01 user nova-compute[74996]: INFO nova.virt.block_device [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Attempting to driver detach volume 6236d92e-6b1d-4fa4-9cef-7a565ab982f3 from mountpoint /dev/vdb
Nov 02 02:01:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Attempting to detach device vdb from instance e460e58e-e7c4-43de-a3b1-efa37430b0c4 from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 02:01:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 02:01:01 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:01:01 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 02:01:01 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:01:01 user nova-compute[74996]:   <serial>6236d92e-6b1d-4fa4-9cef-7a565ab982f3</serial>
Nov 02 02:01:01 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 02:01:01 user nova-compute[74996]: </disk>
Nov 02 02:01:01 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 02:01:01 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Successfully detached device vdb from instance e460e58e-e7c4-43de-a3b1-efa37430b0c4 from the persistent domain config.
Nov 02 02:01:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e460e58e-e7c4-43de-a3b1-efa37430b0c4 from the live domain config. {{(pid=74996) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 02:01:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 02:01:01 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:01:01 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 02:01:01 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:01:01 user nova-compute[74996]:   <serial>6236d92e-6b1d-4fa4-9cef-7a565ab982f3</serial>
Nov 02 02:01:01 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 02:01:01 user nova-compute[74996]: </disk>
Nov 02 02:01:01 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 02:01:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:01:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e460e58e-e7c4-43de-a3b1-efa37430b0c4 {{(pid=74996) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 02:01:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "17b25747-b89d-43f0-a28a-afcf40d35e70" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:01:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:01:06 user nova-compute[74996]: DEBUG nova.objects.instance [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lazy-loading 'flavor' on Instance uuid 17b25747-b89d-43f0-a28a-afcf40d35e70 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:01:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:01:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "17b25747-b89d-43f0-a28a-afcf40d35e70" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:01:06 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:01:06 user nova-compute[74996]: INFO nova.compute.manager [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Attaching volume b4afb240-da77-4ea2-96d5-138bb4168a02 to /dev/vdb
Nov 02 02:01:06 user nova-compute[74996]: DEBUG os_brick.utils [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:01:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce88f58-953c-4505-8944-580e6a3237b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c1a889-c502-4998-8b75-aeab9ac6783d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[887d2ae0-5e38-41a4-a0ff-fc1039c54209]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a3644d-b2a0-4542-806f-8e0f399e6a8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 02:01:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 02:01:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 02:01:06 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 02:01:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94b68ba-9ad0-48c0-88c5-82e5b07ad36c]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 02:01:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 02:01:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 02:01:06 user nova-compute[74996]: DEBUG os_brick.utils [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:01:06 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Updating existing volume attachment record: 78fb2be4-9c36-4eb1-9e0b-2ab35ff014a9 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 02:01:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:21 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e460e58e-e7c4-43de-a3b1-efa37430b0c4 is timed out.
Nov 02 02:01:21 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Successfully detached device vdb from instance e460e58e-e7c4-43de-a3b1-efa37430b0c4 from the live domain config.
Nov 02 02:01:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iZYLzydw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:01:21 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:01:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cddb82-fa93-41eb-9aec-5d60f1e87ab8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 02:01:21 user nova-compute[74996]: No targets found.
Nov 02 02:01:21 user nova-compute[74996]: iSNS:
Nov 02 02:01:21 user nova-compute[74996]: No targets found.
Nov 02 02:01:21 user nova-compute[74996]: STATIC:
Nov 02 02:01:21 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425
Nov 02 02:01:21 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 02:01:21 user nova-compute[74996]:                 Iface Name: default
Nov 02 02:01:21 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348
Nov 02 02:01:21 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 02:01:21 user nova-compute[74996]:                 Iface Name: default
Nov 02 02:01:21 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3
Nov 02 02:01:21 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 02:01:21 user nova-compute[74996]:                 Iface Name: default
Nov 02 02:01:21 user nova-compute[74996]: FIRMWARE:
Nov 02 02:01:21 user nova-compute[74996]: No targets found.
Nov 02 02:01:21 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 02:01:21 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 02:01:21 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc654fd-d4ce-4203-a9ff-1a51aa396622]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afe5ee1-17c0-4023-8f2a-4a82ddc0a9ef]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)
Nov 02 02:01:21 user nova-compute[74996]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 (non-flash)
Nov 02 02:01:21 user nova-compute[74996]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 (non-flash)
Nov 02 02:01:21 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)
Nov 02 02:01:21 user nova-compute[74996]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 (non-flash)
Nov 02 02:01:21 user nova-compute[74996]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 (non-flash)
Nov 02 02:01:21 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830c4cc040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3'): ({'sdc'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Removing single pathed devices sdc {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ee1f5a-a672-4167-b228-c6eed1a6d58d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8daac63-878b-46c0-8f6f-08ddcee25f77]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Flushing IO for device /dev/sdc {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[204f780a-7673-4b00-b6d1-c66f8148fbd8]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6584fb3c-3e13-4572-9032-1dc46ea1743a]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f4c09c-927b-4448-a6bf-3e2cc6a4eb34]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1838367-e2be-40f9-85b8-8b00e3eae59d]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3, portal: 172.16.0.220,3260]
Nov 02 02:01:21 user nova-compute[74996]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3, portal: 172.16.0.220,3260] successful.
Nov 02 02:01:21 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dc5779-531a-4c3c-a55a-c3750669b4b0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] <== disconnect_volume: return (308ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:01:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 02:01:22 user nova-compute[74996]: DEBUG nova.objects.instance [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lazy-loading 'flavor' on Instance uuid e460e58e-e7c4-43de-a3b1-efa37430b0c4 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:01:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ac1ba407-db49-41ea-96d7-2f008290f480 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.864s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:01:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.747s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:01:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:01:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:01:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:01:22 user nova-compute[74996]: INFO nova.compute.manager [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Terminating instance
Nov 02 02:01:22 user nova-compute[74996]: DEBUG nova.compute.manager [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 02:01:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG nova.compute.manager [req-49473e32-6c3c-4a2d-9eb5-dae5ff834891 req-168684e7-d801-42d0-a7e3-7e33228c53c3 service nova] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Received event network-vif-unplugged-8b4a0277-bb35-4b8c-a16d-26b237e17258 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-49473e32-6c3c-4a2d-9eb5-dae5ff834891 req-168684e7-d801-42d0-a7e3-7e33228c53c3 service nova] Acquiring lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-49473e32-6c3c-4a2d-9eb5-dae5ff834891 req-168684e7-d801-42d0-a7e3-7e33228c53c3 service nova] Lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-49473e32-6c3c-4a2d-9eb5-dae5ff834891 req-168684e7-d801-42d0-a7e3-7e33228c53c3 service nova] Lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG nova.compute.manager [req-49473e32-6c3c-4a2d-9eb5-dae5ff834891 req-168684e7-d801-42d0-a7e3-7e33228c53c3 service nova] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] No waiting events found dispatching network-vif-unplugged-8b4a0277-bb35-4b8c-a16d-26b237e17258 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG nova.compute.manager [req-49473e32-6c3c-4a2d-9eb5-dae5ff834891 req-168684e7-d801-42d0-a7e3-7e33228c53c3 service nova] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Received event network-vif-unplugged-8b4a0277-bb35-4b8c-a16d-26b237e17258 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:23 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Instance destroyed successfully.
Nov 02 02:01:23 user nova-compute[74996]: DEBUG nova.objects.instance [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lazy-loading 'resources' on Instance uuid e460e58e-e7c4-43de-a3b1-efa37430b0c4 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-648910713',display_name='tempest-VolumesSnapshotTestJSON-instance-648910713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-648910713',id=41,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4jKDT6KZdhZFque0ft1whvuBbBcCP57NihnfWPGwUhRP9wtabmLGomDfeTQmsnYTHMq3paIphp1FwBykVF2F/pGF8UhwzM9ortDGei22boIMIypPMKTRQGUxCQuAeIcA==',key_name='tempest-keypair-732424982',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:57:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='971ca9cd14604f619cc269252bdc0983',ramdisk_id='',reservation_id='r-cl50r292',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1059088146',owner_user_name='tempest-VolumesSnapshotTestJSON-1059088146-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:57:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a32baeba9e0491392e9bd9475b1dddd',uuid=e460e58e-e7c4-43de-a3b1-efa37430b0c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b4a0277-bb35-4b8c-a16d-26b237e17258", "address": "fa:16:3e:3f:9d:1c", "network": {"id": "5d5d58ab-0d25-4d7e-b535-857923f4a7a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1163860226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "971ca9cd14604f619cc269252bdc0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4a0277-bb", "ovs_interfaceid": "8b4a0277-bb35-4b8c-a16d-26b237e17258", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Converting VIF {"id": "8b4a0277-bb35-4b8c-a16d-26b237e17258", "address": "fa:16:3e:3f:9d:1c", "network": {"id": "5d5d58ab-0d25-4d7e-b535-857923f4a7a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1163860226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "971ca9cd14604f619cc269252bdc0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4a0277-bb", "ovs_interfaceid": "8b4a0277-bb35-4b8c-a16d-26b237e17258", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:9d:1c,bridge_name='br-int',has_traffic_filtering=True,id=8b4a0277-bb35-4b8c-a16d-26b237e17258,network=Network(5d5d58ab-0d25-4d7e-b535-857923f4a7a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4a0277-bb') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG os_vif [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:9d:1c,bridge_name='br-int',has_traffic_filtering=True,id=8b4a0277-bb35-4b8c-a16d-26b237e17258,network=Network(5d5d58ab-0d25-4d7e-b535-857923f4a7a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4a0277-bb') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b4a0277-bb, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15b4030e-3f50-4840-a1e0-194bfcebf817) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:01:23 user nova-compute[74996]: INFO os_vif [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:9d:1c,bridge_name='br-int',has_traffic_filtering=True,id=8b4a0277-bb35-4b8c-a16d-26b237e17258,network=Network(5d5d58ab-0d25-4d7e-b535-857923f4a7a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4a0277-bb')
Nov 02 02:01:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iZYLzydw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:01:23 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:01:23 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94f84bd-b8be-4109-8b05-52f716d06d4d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 02:01:23 user nova-compute[74996]: No targets found.
Nov 02 02:01:23 user nova-compute[74996]: iSNS:
Nov 02 02:01:23 user nova-compute[74996]: No targets found.
Nov 02 02:01:23 user nova-compute[74996]: STATIC:
Nov 02 02:01:23 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425
Nov 02 02:01:23 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 02:01:23 user nova-compute[74996]:                 Iface Name: default
Nov 02 02:01:23 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348
Nov 02 02:01:23 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 02:01:23 user nova-compute[74996]:                 Iface Name: default
Nov 02 02:01:23 user nova-compute[74996]: FIRMWARE:
Nov 02 02:01:23 user nova-compute[74996]: No targets found.
Nov 02 02:01:23 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 02:01:23 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 02:01:23 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6236d92e-6b1d-4fa4-9cef-7a565ab982f3', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9febb1fb-dd41-45ba-8184-d050e4234390]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[870cf009-1935-44ac-9578-a55a08d637b3]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)
Nov 02 02:01:23 user nova-compute[74996]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 (non-flash)
Nov 02 02:01:23 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)
Nov 02 02:01:23 user nova-compute[74996]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 (non-flash)
Nov 02 02:01:23 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e86ffac0>, {}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Disconnecting from: [] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.082s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] <== disconnect_volume: return (83ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 02:01:23 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Deleting instance files /opt/stack/data/nova/instances/e460e58e-e7c4-43de-a3b1-efa37430b0c4_del
Nov 02 02:01:23 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Deletion of /opt/stack/data/nova/instances/e460e58e-e7c4-43de-a3b1-efa37430b0c4_del complete
Nov 02 02:01:23 user nova-compute[74996]: INFO nova.compute.manager [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 02 02:01:23 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 02:01:23 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 02:01:24 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:01:24 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Took 0.80 seconds to deallocate network for instance.
Nov 02 02:01:24 user nova-compute[74996]: WARNING nova.volume.cinder [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Attachment d344c916-2a8c-401f-8a63-e5a23e713898 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = d344c916-2a8c-401f-8a63-e5a23e713898. (HTTP 404) (Request-ID: req-5b7086b5-bf2d-4b9c-b853-3d0c03e3d583)
Nov 02 02:01:24 user nova-compute[74996]: INFO nova.compute.manager [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Took 0.03 seconds to detach 1 volumes for instance.
Nov 02 02:01:24 user nova-compute[74996]: DEBUG nova.compute.manager [req-f32eb670-6cc3-4b8b-b1c8-4763eb4b2a57 req-9e936877-270e-42aa-bbdb-6ed50a4a2c23 service nova] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Received event network-vif-deleted-8b4a0277-bb35-4b8c-a16d-26b237e17258 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:01:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:01:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:01:25 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:01:25 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:01:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:01:25 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Deleted allocations for instance e460e58e-e7c4-43de-a3b1-efa37430b0c4
Nov 02 02:01:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-537a4943-e112-4e5f-8c26-8385dafdd357 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.400s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:01:25 user nova-compute[74996]: DEBUG nova.compute.manager [req-2b35bf4b-d6fe-4aca-a1f3-a2c0222822ec req-31ac5354-073f-4e84-b472-457567f7fc4a service nova] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Received event network-vif-plugged-8b4a0277-bb35-4b8c-a16d-26b237e17258 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:01:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2b35bf4b-d6fe-4aca-a1f3-a2c0222822ec req-31ac5354-073f-4e84-b472-457567f7fc4a service nova] Acquiring lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:01:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2b35bf4b-d6fe-4aca-a1f3-a2c0222822ec req-31ac5354-073f-4e84-b472-457567f7fc4a service nova] Lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:01:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2b35bf4b-d6fe-4aca-a1f3-a2c0222822ec req-31ac5354-073f-4e84-b472-457567f7fc4a service nova] Lock "e460e58e-e7c4-43de-a3b1-efa37430b0c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:01:25 user nova-compute[74996]: DEBUG nova.compute.manager [req-2b35bf4b-d6fe-4aca-a1f3-a2c0222822ec req-31ac5354-073f-4e84-b472-457567f7fc4a service nova] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] No waiting events found dispatching network-vif-plugged-8b4a0277-bb35-4b8c-a16d-26b237e17258 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:01:25 user nova-compute[74996]: WARNING nova.compute.manager [req-2b35bf4b-d6fe-4aca-a1f3-a2c0222822ec req-31ac5354-073f-4e84-b472-457567f7fc4a service nova] [instance: e460e58e-e7c4-43de-a3b1-efa37430b0c4] Received unexpected event network-vif-plugged-8b4a0277-bb35-4b8c-a16d-26b237e17258 for instance with vm_state deleted and task_state None.
Nov 02 02:01:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJAeuXiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:01:26 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:01:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:01:26 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:01:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:01:26 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef30cc9-74e7-48ff-a9b7-1aa0f1972bfa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 02:01:26 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2262a6f3-ec50-4365-a381-80253b6dacbb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02] added
Nov 02 02:01:26 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[138c0203-0773-4adb-8bb8-43ef6ba4c20d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d1f326-c927-4cd5-8d51-7c9330a3d4eb]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tJAeuXiP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tJAeuXiP" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3e93c2-2878-4d9b-b6f6-ae0bf6c55fa5]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tJAeuXiP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9a7409-7ae3-4595-bab2-78efebf56f16]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc02809-1c0b-402d-bf95-f880d96f195b]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)
Nov 02 02:01:26 user nova-compute[74996]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 (non-flash)
Nov 02 02:01:26 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)
Nov 02 02:01:26 user nova-compute[74996]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 (non-flash)
Nov 02 02:01:26 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e6263d-656b-4492-a06d-2d4bd1225558]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02, portal: 172.16.0.220,3260]
Nov 02 02:01:26 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02, portal: 172.16.0.220,3260] successful.
Nov 02 02:01:26 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[39abda5d-896d-4677-9594-9e6b210936e5]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edfb254-9375-4aec-be04-e1ae2963b024]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)
Nov 02 02:01:26 user nova-compute[74996]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 (non-flash)
Nov 02 02:01:26 user nova-compute[74996]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 (non-flash)
Nov 02 02:01:26 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)
Nov 02 02:01:26 user nova-compute[74996]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 (non-flash)
Nov 02 02:01:26 user nova-compute[74996]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 (non-flash)
Nov 02 02:01:26 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8990d1-bc5f-4255-9abe-04902fb9f284]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 02:01:26 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJAeuXiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 02:01:27 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:01:27 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23734386135363431', 'path': '/dev/sdc'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:01:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734386135363431', 'path': '/dev/sdc'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 02:01:27 user nova-compute[74996]: DEBUG nova.objects.instance [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lazy-loading 'flavor' on Instance uuid 17b25747-b89d-43f0-a28a-afcf40d35e70 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:01:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 02:01:27 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:01:27 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 02:01:27 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:01:27 user nova-compute[74996]:   <serial>b4afb240-da77-4ea2-96d5-138bb4168a02</serial>
Nov 02 02:01:27 user nova-compute[74996]: </disk>
Nov 02 02:01:27 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 02:01:28 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:01:28 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:01:28 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] No VIF found with MAC fa:16:3e:9e:8e:1e, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 02:01:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1b6aa7b5-21fc-48cf-a70a-7e2317aed47c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.876s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:01:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:33 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:01:33 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:01:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:01:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:01:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:01:33 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 02:01:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 02:01:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 02:01:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 02:01:35 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:01:35 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:01:35 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8237MB free_disk=24.876750946044922GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 02:01:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:01:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:01:36 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance e38704a7-f8a0-482c-bd51-26a90d37b71d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:01:36 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7c53e6cc-cf69-485d-b24f-5e113dae0e5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:01:36 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 27863b45-4dda-4f6d-bd6f-0f332f1fdd52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:01:36 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 4f56890c-d135-42a1-b862-7ac5f9076654 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:01:36 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 17b25747-b89d-43f0-a28a-afcf40d35e70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:01:36 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 02:01:36 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 02:01:36 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Refreshing inventories for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 02:01:36 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Updating ProviderTree inventory for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 02:01:36 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Updating inventory in ProviderTree for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 02:01:36 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Refreshing aggregate associations for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259, aggregates: None {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 02:01:36 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Refreshing trait associations for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 02:01:36 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:01:36 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:01:36 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 02:01:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:01:38 user nova-compute[74996]: DEBUG nova.compute.manager [req-41e84fc0-f60e-4a34-bae8-3b58bd1dbc5c req-d55bb738-f1ae-4eac-ad8b-ba15ab898e77 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Received event network-changed-9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:01:38 user nova-compute[74996]: DEBUG nova.compute.manager [req-41e84fc0-f60e-4a34-bae8-3b58bd1dbc5c req-d55bb738-f1ae-4eac-ad8b-ba15ab898e77 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Refreshing instance network info cache due to event network-changed-9ffa33b3-7d4c-484c-834b-60c2f888b540. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 02:01:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-41e84fc0-f60e-4a34-bae8-3b58bd1dbc5c req-d55bb738-f1ae-4eac-ad8b-ba15ab898e77 service nova] Acquiring lock "refresh_cache-27863b45-4dda-4f6d-bd6f-0f332f1fdd52" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:01:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-41e84fc0-f60e-4a34-bae8-3b58bd1dbc5c req-d55bb738-f1ae-4eac-ad8b-ba15ab898e77 service nova] Acquired lock "refresh_cache-27863b45-4dda-4f6d-bd6f-0f332f1fdd52" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:01:38 user nova-compute[74996]: DEBUG nova.network.neutron [req-41e84fc0-f60e-4a34-bae8-3b58bd1dbc5c req-d55bb738-f1ae-4eac-ad8b-ba15ab898e77 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Refreshing network info cache for port 9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 02:01:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:01:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:01:38 user nova-compute[74996]: INFO nova.compute.manager [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Detaching volume a39d6caa-314c-4622-a23b-7234fbab3348
Nov 02 02:01:38 user nova-compute[74996]: DEBUG nova.network.neutron [req-41e84fc0-f60e-4a34-bae8-3b58bd1dbc5c req-d55bb738-f1ae-4eac-ad8b-ba15ab898e77 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Updated VIF entry in instance network info cache for port 9ffa33b3-7d4c-484c-834b-60c2f888b540. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 02:01:38 user nova-compute[74996]: DEBUG nova.network.neutron [req-41e84fc0-f60e-4a34-bae8-3b58bd1dbc5c req-d55bb738-f1ae-4eac-ad8b-ba15ab898e77 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Updating instance_info_cache with network_info: [{"id": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "address": "fa:16:3e:2e:f5:1b", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa33b3-7d", "ovs_interfaceid": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:01:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-41e84fc0-f60e-4a34-bae8-3b58bd1dbc5c req-d55bb738-f1ae-4eac-ad8b-ba15ab898e77 service nova] Releasing lock "refresh_cache-27863b45-4dda-4f6d-bd6f-0f332f1fdd52" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:01:38 user nova-compute[74996]: INFO nova.virt.block_device [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Attempting to driver detach volume a39d6caa-314c-4622-a23b-7234fbab3348 from mountpoint /dev/vdb
Nov 02 02:01:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Attempting to detach device vdb from instance 27863b45-4dda-4f6d-bd6f-0f332f1fdd52 from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 02:01:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 02:01:38 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:01:38 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 02:01:38 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:01:38 user nova-compute[74996]:   <serial>a39d6caa-314c-4622-a23b-7234fbab3348</serial>
Nov 02 02:01:38 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 02:01:38 user nova-compute[74996]: </disk>
Nov 02 02:01:38 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 02:01:38 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Successfully detached device vdb from instance 27863b45-4dda-4f6d-bd6f-0f332f1fdd52 from the persistent domain config.
Nov 02 02:01:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 27863b45-4dda-4f6d-bd6f-0f332f1fdd52 from the live domain config. {{(pid=74996) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 02:01:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 02:01:38 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:01:38 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 02:01:38 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:01:38 user nova-compute[74996]:   <serial>a39d6caa-314c-4622-a23b-7234fbab3348</serial>
Nov 02 02:01:38 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 02:01:38 user nova-compute[74996]: </disk>
Nov 02 02:01:38 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 02:01:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 27863b45-4dda-4f6d-bd6f-0f332f1fdd52 {{(pid=74996) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 02:01:39 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:01:39 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:01:39 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:01:39 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 02:01:40 user nova-compute[74996]: DEBUG nova.compute.manager [req-21c05bf3-19ba-478b-abc9-4ee21ac73575 req-7b2df2df-4d61-49b3-9cbd-103266de324a service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Received event network-changed-9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:01:40 user nova-compute[74996]: DEBUG nova.compute.manager [req-21c05bf3-19ba-478b-abc9-4ee21ac73575 req-7b2df2df-4d61-49b3-9cbd-103266de324a service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Refreshing instance network info cache due to event network-changed-9ffa33b3-7d4c-484c-834b-60c2f888b540. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 02:01:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-21c05bf3-19ba-478b-abc9-4ee21ac73575 req-7b2df2df-4d61-49b3-9cbd-103266de324a service nova] Acquiring lock "refresh_cache-27863b45-4dda-4f6d-bd6f-0f332f1fdd52" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:01:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-21c05bf3-19ba-478b-abc9-4ee21ac73575 req-7b2df2df-4d61-49b3-9cbd-103266de324a service nova] Acquired lock "refresh_cache-27863b45-4dda-4f6d-bd6f-0f332f1fdd52" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:01:40 user nova-compute[74996]: DEBUG nova.network.neutron [req-21c05bf3-19ba-478b-abc9-4ee21ac73575 req-7b2df2df-4d61-49b3-9cbd-103266de324a service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Refreshing network info cache for port 9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 02:01:40 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:01:40 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 02:01:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-7c53e6cc-cf69-485d-b24f-5e113dae0e5d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:01:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-7c53e6cc-cf69-485d-b24f-5e113dae0e5d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:01:40 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 02:01:40 user nova-compute[74996]: DEBUG nova.network.neutron [req-21c05bf3-19ba-478b-abc9-4ee21ac73575 req-7b2df2df-4d61-49b3-9cbd-103266de324a service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Updated VIF entry in instance network info cache for port 9ffa33b3-7d4c-484c-834b-60c2f888b540. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 02:01:40 user nova-compute[74996]: DEBUG nova.network.neutron [req-21c05bf3-19ba-478b-abc9-4ee21ac73575 req-7b2df2df-4d61-49b3-9cbd-103266de324a service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Updating instance_info_cache with network_info: [{"id": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "address": "fa:16:3e:2e:f5:1b", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa33b3-7d", "ovs_interfaceid": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:01:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-21c05bf3-19ba-478b-abc9-4ee21ac73575 req-7b2df2df-4d61-49b3-9cbd-103266de324a service nova] Releasing lock "refresh_cache-27863b45-4dda-4f6d-bd6f-0f332f1fdd52" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:01:41 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Updating instance_info_cache with network_info: [{"id": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "address": "fa:16:3e:9b:c8:b7", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391c1ab0-6a", "ovs_interfaceid": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:01:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-7c53e6cc-cf69-485d-b24f-5e113dae0e5d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:01:41 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 02:01:41 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:01:41 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:01:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:44 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:01:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:57 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:01:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:01:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:01:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:01:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:01:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:01:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:01:59 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 27863b45-4dda-4f6d-bd6f-0f332f1fdd52 is timed out.
Nov 02 02:01:59 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Successfully detached device vdb from instance 27863b45-4dda-4f6d-bd6f-0f332f1fdd52 from the live domain config.
Nov 02 02:01:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FagKZchD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:01:59 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:01:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6942c9c6-69d9-4f88-988f-536f6d5805b3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 02:01:59 user nova-compute[74996]: No targets found.
Nov 02 02:01:59 user nova-compute[74996]: iSNS:
Nov 02 02:01:59 user nova-compute[74996]: No targets found.
Nov 02 02:01:59 user nova-compute[74996]: STATIC:
Nov 02 02:01:59 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425
Nov 02 02:01:59 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 02:01:59 user nova-compute[74996]:                 Iface Name: default
Nov 02 02:01:59 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348
Nov 02 02:01:59 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 02:01:59 user nova-compute[74996]:                 Iface Name: default
Nov 02 02:01:59 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02
Nov 02 02:01:59 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 02:01:59 user nova-compute[74996]:                 Iface Name: default
Nov 02 02:01:59 user nova-compute[74996]: FIRMWARE:
Nov 02 02:01:59 user nova-compute[74996]: No targets found.
Nov 02 02:01:59 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 02:01:59 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 02:01:59 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbe7b18-9c95-4fb8-96d3-455e46f638cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3688a6dc-5faa-4c23-954c-6c0b7032abac]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)
Nov 02 02:01:59 user nova-compute[74996]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 (non-flash)
Nov 02 02:01:59 user nova-compute[74996]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 (non-flash)
Nov 02 02:01:59 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 (non-flash)
Nov 02 02:01:59 user nova-compute[74996]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 (non-flash)
Nov 02 02:01:59 user nova-compute[74996]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 (non-flash)
Nov 02 02:01:59 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830c2ea9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348'): ({'sdb'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Removing single pathed devices sdb {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b79789-20d1-4e8d-9796-5678541ad2a4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dd0ce5-b2b3-4265-a540-ffadacbe858d]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Flushing IO for device /dev/sdb {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4bc80d-bff0-438a-9cb6-b9e898e18cc0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[725196a2-e28d-4eca-afd8-d6625266e191]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a2d705-bce0-45bc-95fd-60e71d62495d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de87eba-a182-4d40-9060-bfc68fd58b18]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348, portal: 172.16.0.220,3260]
Nov 02 02:01:59 user nova-compute[74996]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348, portal: 172.16.0.220,3260] successful.
Nov 02 02:01:59 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a39d6caa-314c-4622-a23b-7234fbab3348 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb55b853-fef4-4b25-a13d-f275d2d70701]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] <== disconnect_volume: return (302ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:01:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 02:02:00 user nova-compute[74996]: DEBUG nova.objects.instance [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lazy-loading 'flavor' on Instance uuid 27863b45-4dda-4f6d-bd6f-0f332f1fdd52 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:02:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ac59efad-f896-4ec0-996c-4fd02b8b84ef tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.836s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:02:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:02:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "17b25747-b89d-43f0-a28a-afcf40d35e70" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:02:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:02:12 user nova-compute[74996]: INFO nova.compute.manager [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Detaching volume b4afb240-da77-4ea2-96d5-138bb4168a02
Nov 02 02:02:13 user nova-compute[74996]: INFO nova.virt.block_device [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Attempting to driver detach volume b4afb240-da77-4ea2-96d5-138bb4168a02 from mountpoint /dev/vdb
Nov 02 02:02:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Attempting to detach device vdb from instance 17b25747-b89d-43f0-a28a-afcf40d35e70 from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 02:02:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 02:02:13 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:02:13 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 02:02:13 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:02:13 user nova-compute[74996]:   <serial>b4afb240-da77-4ea2-96d5-138bb4168a02</serial>
Nov 02 02:02:13 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 02:02:13 user nova-compute[74996]: </disk>
Nov 02 02:02:13 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 02:02:13 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Successfully detached device vdb from instance 17b25747-b89d-43f0-a28a-afcf40d35e70 from the persistent domain config.
Nov 02 02:02:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 17b25747-b89d-43f0-a28a-afcf40d35e70 from the live domain config. {{(pid=74996) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 02:02:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 02:02:13 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:02:13 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 02:02:13 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:02:13 user nova-compute[74996]:   <serial>b4afb240-da77-4ea2-96d5-138bb4168a02</serial>
Nov 02 02:02:13 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 02:02:13 user nova-compute[74996]: </disk>
Nov 02 02:02:13 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 02:02:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 17b25747-b89d-43f0-a28a-afcf40d35e70 {{(pid=74996) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 02:02:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:02:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:02:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:02:23 user nova-compute[74996]: DEBUG nova.compute.manager [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 02:02:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:02:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:02:23 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 02:02:23 user nova-compute[74996]: INFO nova.compute.claims [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Claim successful on node user
Nov 02 02:02:24 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:02:24 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:02:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.332s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:02:24 user nova-compute[74996]: DEBUG nova.compute.manager [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 02:02:24 user nova-compute[74996]: DEBUG nova.compute.manager [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 02:02:24 user nova-compute[74996]: DEBUG nova.network.neutron [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 02:02:24 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 02:02:24 user nova-compute[74996]: DEBUG nova.compute.manager [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 02:02:24 user nova-compute[74996]: DEBUG nova.policy [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dd49c6f202cc46b496df91de55c53c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee0ae54cb9642e68d847235ebe13875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 02:02:24 user nova-compute[74996]: DEBUG nova.compute.manager [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 02:02:24 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 02:02:24 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Creating image(s)
Nov 02 02:02:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "/opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:02:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "/opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:02:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "/opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:02:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.187s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:02:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:02:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.205s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk 1073741824" returned: 0 in 0.054s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:02:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.187s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:25 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 02:02:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:25 user nova-compute[74996]: DEBUG nova.network.neutron [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Successfully created port: 46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 02:02:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:25 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Cannot resize image /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 02:02:25 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 02:02:25 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Ensure instance console log exists: /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 02:02:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:02:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:02:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:02:25 user nova-compute[74996]: DEBUG nova.network.neutron [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Successfully updated port: 46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 02:02:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "refresh_cache-04bbae43-881f-455a-bcd2-c1be2e82f0dc" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:02:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquired lock "refresh_cache-04bbae43-881f-455a-bcd2-c1be2e82f0dc" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:02:25 user nova-compute[74996]: DEBUG nova.network.neutron [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 02:02:25 user nova-compute[74996]: DEBUG nova.compute.manager [req-c206afad-591d-417f-8d99-a069010f97d2 req-1f46982c-6230-46dc-90ac-5095dd86e2f2 service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Received event network-changed-46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:02:25 user nova-compute[74996]: DEBUG nova.compute.manager [req-c206afad-591d-417f-8d99-a069010f97d2 req-1f46982c-6230-46dc-90ac-5095dd86e2f2 service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Refreshing instance network info cache due to event network-changed-46cdee0a-7249-457f-b3d1-e69a6ed62504. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 02:02:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c206afad-591d-417f-8d99-a069010f97d2 req-1f46982c-6230-46dc-90ac-5095dd86e2f2 service nova] Acquiring lock "refresh_cache-04bbae43-881f-455a-bcd2-c1be2e82f0dc" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:02:25 user nova-compute[74996]: DEBUG nova.network.neutron [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.network.neutron [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Updating instance_info_cache with network_info: [{"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Releasing lock "refresh_cache-04bbae43-881f-455a-bcd2-c1be2e82f0dc" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.compute.manager [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Instance network_info: |[{"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c206afad-591d-417f-8d99-a069010f97d2 req-1f46982c-6230-46dc-90ac-5095dd86e2f2 service nova] Acquired lock "refresh_cache-04bbae43-881f-455a-bcd2-c1be2e82f0dc" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.network.neutron [req-c206afad-591d-417f-8d99-a069010f97d2 req-1f46982c-6230-46dc-90ac-5095dd86e2f2 service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Refreshing network info cache for port 46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Start _get_guest_xml network_info=[{"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 02:02:26 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:02:26 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-737287584',display_name='tempest-AttachVolumeTestJSON-server-737287584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-737287584',id=44,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeIW/CNmoj21FtRCsqg1lXO54HxCaIvv1uBUUE6B0bU+AGTCthBvSHQimH9CWWXBX3zHlj6txcR4awRuWt6j/DhBo4E/0517ba1Qrhay/0zFwqi/ch9Lcgb2pyyzhBOxA==',key_name='tempest-keypair-535762259',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fee0ae54cb9642e68d847235ebe13875',ramdisk_id='',reservation_id='r-44fx7s8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1064832613',owner_user_name='tempest-AttachVolumeTestJSON-1064832613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T02:02:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd49c6f202cc46b496df91de55c53c65',uuid=04bbae43-881f-455a-bcd2-c1be2e82f0dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Converting VIF {"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:2c:81,bridge_name='br-int',has_traffic_filtering=True,id=46cdee0a-7249-457f-b3d1-e69a6ed62504,network=Network(699807b0-2588-4e44-967e-e11023d25985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cdee0a-72') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.objects.instance [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'pci_devices' on Instance uuid 04bbae43-881f-455a-bcd2-c1be2e82f0dc {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] End _get_guest_xml xml=<domain type="kvm">
Nov 02 02:02:26 user nova-compute[74996]:   <uuid>04bbae43-881f-455a-bcd2-c1be2e82f0dc</uuid>
Nov 02 02:02:26 user nova-compute[74996]:   <name>instance-0000002c</name>
Nov 02 02:02:26 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 02:02:26 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 02:02:26 user nova-compute[74996]:   <metadata>
Nov 02 02:02:26 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 02:02:26 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 02:02:26 user nova-compute[74996]:       <nova:name>tempest-AttachVolumeTestJSON-server-737287584</nova:name>
Nov 02 02:02:26 user nova-compute[74996]:       <nova:creationTime>2023-11-02 02:02:26</nova:creationTime>
Nov 02 02:02:26 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 02:02:26 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 02:02:26 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 02:02:26 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 02:02:26 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 02:02:26 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 02:02:26 user nova-compute[74996]:       </nova:flavor>
Nov 02 02:02:26 user nova-compute[74996]:       <nova:owner>
Nov 02 02:02:26 user nova-compute[74996]:         <nova:user uuid="dd49c6f202cc46b496df91de55c53c65">tempest-AttachVolumeTestJSON-1064832613-project-member</nova:user>
Nov 02 02:02:26 user nova-compute[74996]:         <nova:project uuid="fee0ae54cb9642e68d847235ebe13875">tempest-AttachVolumeTestJSON-1064832613</nova:project>
Nov 02 02:02:26 user nova-compute[74996]:       </nova:owner>
Nov 02 02:02:26 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 02:02:26 user nova-compute[74996]:       <nova:ports>
Nov 02 02:02:26 user nova-compute[74996]:         <nova:port uuid="46cdee0a-7249-457f-b3d1-e69a6ed62504">
Nov 02 02:02:26 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 02:02:26 user nova-compute[74996]:         </nova:port>
Nov 02 02:02:26 user nova-compute[74996]:       </nova:ports>
Nov 02 02:02:26 user nova-compute[74996]:     </nova:instance>
Nov 02 02:02:26 user nova-compute[74996]:   </metadata>
Nov 02 02:02:26 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 02:02:26 user nova-compute[74996]:     <system>
Nov 02 02:02:26 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 02:02:26 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 02:02:26 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 02:02:26 user nova-compute[74996]:       <entry name="serial">04bbae43-881f-455a-bcd2-c1be2e82f0dc</entry>
Nov 02 02:02:26 user nova-compute[74996]:       <entry name="uuid">04bbae43-881f-455a-bcd2-c1be2e82f0dc</entry>
Nov 02 02:02:26 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 02:02:26 user nova-compute[74996]:     </system>
Nov 02 02:02:26 user nova-compute[74996]:   </sysinfo>
Nov 02 02:02:26 user nova-compute[74996]:   <os>
Nov 02 02:02:26 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 02:02:26 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 02:02:26 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 02:02:26 user nova-compute[74996]:   </os>
Nov 02 02:02:26 user nova-compute[74996]:   <features>
Nov 02 02:02:26 user nova-compute[74996]:     <acpi/>
Nov 02 02:02:26 user nova-compute[74996]:     <apic/>
Nov 02 02:02:26 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 02:02:26 user nova-compute[74996]:   </features>
Nov 02 02:02:26 user nova-compute[74996]:   <clock offset="utc">
Nov 02 02:02:26 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 02:02:26 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 02:02:26 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 02:02:26 user nova-compute[74996]:   </clock>
Nov 02 02:02:26 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 02:02:26 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 02:02:26 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 02:02:26 user nova-compute[74996]:   </cpu>
Nov 02 02:02:26 user nova-compute[74996]:   <devices>
Nov 02 02:02:26 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 02:02:26 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 02:02:26 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk"/>
Nov 02 02:02:26 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 02:02:26 user nova-compute[74996]:     </disk>
Nov 02 02:02:26 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 02:02:26 user nova-compute[74996]:       <mac address="fa:16:3e:73:2c:81"/>
Nov 02 02:02:26 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 02:02:26 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 02:02:26 user nova-compute[74996]:       <target dev="tap46cdee0a-72"/>
Nov 02 02:02:26 user nova-compute[74996]:     </interface>
Nov 02 02:02:26 user nova-compute[74996]:     <serial type="pty">
Nov 02 02:02:26 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/console.log" append="off"/>
Nov 02 02:02:26 user nova-compute[74996]:     </serial>
Nov 02 02:02:26 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 02:02:26 user nova-compute[74996]:     <video>
Nov 02 02:02:26 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 02:02:26 user nova-compute[74996]:     </video>
Nov 02 02:02:26 user nova-compute[74996]:     <rng model="virtio">
Nov 02 02:02:26 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 02:02:26 user nova-compute[74996]:     </rng>
Nov 02 02:02:26 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 02:02:26 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 02:02:26 user nova-compute[74996]:       <stats period="10"/>
Nov 02 02:02:26 user nova-compute[74996]:     </memballoon>
Nov 02 02:02:26 user nova-compute[74996]:   </devices>
Nov 02 02:02:26 user nova-compute[74996]: </domain>
Nov 02 02:02:26 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-737287584',display_name='tempest-AttachVolumeTestJSON-server-737287584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-737287584',id=44,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeIW/CNmoj21FtRCsqg1lXO54HxCaIvv1uBUUE6B0bU+AGTCthBvSHQimH9CWWXBX3zHlj6txcR4awRuWt6j/DhBo4E/0517ba1Qrhay/0zFwqi/ch9Lcgb2pyyzhBOxA==',key_name='tempest-keypair-535762259',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fee0ae54cb9642e68d847235ebe13875',ramdisk_id='',reservation_id='r-44fx7s8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1064832613',owner_user_name='tempest-AttachVolumeTestJSON-1064832613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T02:02:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd49c6f202cc46b496df91de55c53c65',uuid=04bbae43-881f-455a-bcd2-c1be2e82f0dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Converting VIF {"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:2c:81,bridge_name='br-int',has_traffic_filtering=True,id=46cdee0a-7249-457f-b3d1-e69a6ed62504,network=Network(699807b0-2588-4e44-967e-e11023d25985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cdee0a-72') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG os_vif [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:2c:81,bridge_name='br-int',has_traffic_filtering=True,id=46cdee0a-7249-457f-b3d1-e69a6ed62504,network=Network(699807b0-2588-4e44-967e-e11023d25985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cdee0a-72') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '632c27b2-a6a7-54bf-8066-3a6d296025b1', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46cdee0a-72, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap46cdee0a-72, col_values=(('qos', UUID('6d97c1b8-18cb-4721-8317-9a57b585aa0d')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap46cdee0a-72, col_values=(('external_ids', {'iface-id': '46cdee0a-7249-457f-b3d1-e69a6ed62504', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:2c:81', 'vm-uuid': '04bbae43-881f-455a-bcd2-c1be2e82f0dc'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:26 user nova-compute[74996]: INFO os_vif [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:2c:81,bridge_name='br-int',has_traffic_filtering=True,id=46cdee0a-7249-457f-b3d1-e69a6ed62504,network=Network(699807b0-2588-4e44-967e-e11023d25985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cdee0a-72')
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] No VIF found with MAC fa:16:3e:73:2c:81, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.network.neutron [req-c206afad-591d-417f-8d99-a069010f97d2 req-1f46982c-6230-46dc-90ac-5095dd86e2f2 service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Updated VIF entry in instance network info cache for port 46cdee0a-7249-457f-b3d1-e69a6ed62504. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG nova.network.neutron [req-c206afad-591d-417f-8d99-a069010f97d2 req-1f46982c-6230-46dc-90ac-5095dd86e2f2 service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Updating instance_info_cache with network_info: [{"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:02:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c206afad-591d-417f-8d99-a069010f97d2 req-1f46982c-6230-46dc-90ac-5095dd86e2f2 service nova] Releasing lock "refresh_cache-04bbae43-881f-455a-bcd2-c1be2e82f0dc" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:02:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:27 user nova-compute[74996]: DEBUG nova.compute.manager [req-91a8eeb4-dfbc-49ec-9a41-11d2069f9729 req-bd554fea-08f3-421a-a765-c949c6ae6b4b service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Received event network-vif-plugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:02:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-91a8eeb4-dfbc-49ec-9a41-11d2069f9729 req-bd554fea-08f3-421a-a765-c949c6ae6b4b service nova] Acquiring lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:02:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-91a8eeb4-dfbc-49ec-9a41-11d2069f9729 req-bd554fea-08f3-421a-a765-c949c6ae6b4b service nova] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:02:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-91a8eeb4-dfbc-49ec-9a41-11d2069f9729 req-bd554fea-08f3-421a-a765-c949c6ae6b4b service nova] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:02:27 user nova-compute[74996]: DEBUG nova.compute.manager [req-91a8eeb4-dfbc-49ec-9a41-11d2069f9729 req-bd554fea-08f3-421a-a765-c949c6ae6b4b service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] No waiting events found dispatching network-vif-plugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:02:27 user nova-compute[74996]: WARNING nova.compute.manager [req-91a8eeb4-dfbc-49ec-9a41-11d2069f9729 req-bd554fea-08f3-421a-a765-c949c6ae6b4b service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Received unexpected event network-vif-plugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 for instance with vm_state building and task_state spawning.
Nov 02 02:02:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e6816f9f-d4ac-47cb-9ea7-16ba9877f704 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:02:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e6816f9f-d4ac-47cb-9ea7-16ba9877f704 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:02:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e6816f9f-d4ac-47cb-9ea7-16ba9877f704 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:02:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e6816f9f-d4ac-47cb-9ea7-16ba9877f704 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:02:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e6816f9f-d4ac-47cb-9ea7-16ba9877f704 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:02:28 user nova-compute[74996]: INFO nova.compute.manager [None req-e6816f9f-d4ac-47cb-9ea7-16ba9877f704 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Terminating instance
Nov 02 02:02:28 user nova-compute[74996]: DEBUG nova.compute.manager [None req-e6816f9f-d4ac-47cb-9ea7-16ba9877f704 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 02:02:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG nova.compute.manager [req-0cd2fc42-264f-421f-9cf8-4e4426b47271 req-c7bcee9e-2a07-49aa-87a8-a99df8e2b664 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Received event network-vif-unplugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0cd2fc42-264f-421f-9cf8-4e4426b47271 req-c7bcee9e-2a07-49aa-87a8-a99df8e2b664 service nova] Acquiring lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0cd2fc42-264f-421f-9cf8-4e4426b47271 req-c7bcee9e-2a07-49aa-87a8-a99df8e2b664 service nova] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0cd2fc42-264f-421f-9cf8-4e4426b47271 req-c7bcee9e-2a07-49aa-87a8-a99df8e2b664 service nova] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG nova.compute.manager [req-0cd2fc42-264f-421f-9cf8-4e4426b47271 req-c7bcee9e-2a07-49aa-87a8-a99df8e2b664 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] No waiting events found dispatching network-vif-unplugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG nova.compute.manager [req-0cd2fc42-264f-421f-9cf8-4e4426b47271 req-c7bcee9e-2a07-49aa-87a8-a99df8e2b664 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Received event network-vif-unplugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:29 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Instance destroyed successfully.
Nov 02 02:02:29 user nova-compute[74996]: DEBUG nova.objects.instance [None req-e6816f9f-d4ac-47cb-9ea7-16ba9877f704 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lazy-loading 'resources' on Instance uuid 27863b45-4dda-4f6d-bd6f-0f332f1fdd52 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-e6816f9f-d4ac-47cb-9ea7-16ba9877f704 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:55:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1987643853',display_name='tempest-ServerRescueNegativeTestJSON-server-1987643853',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1987643853',id=40,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKheu8wiqdlC3hH3OAEdws9kSpyqPO541Zoa8GP80tBYxiXZ24s0YcE15PIexh9WjlPW0xLXSXW4RQU/f4sL5hr1y0f0ZWs+SVjjxo1F9di75eqRJG50AOSZORve8JSc/A==',key_name='tempest-keypair-2071253473',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:58:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d89083c24ba475f9159a80fddfe9159',ramdisk_id='',reservation_id='r-v8max6zc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1433266011',owner_user_name='tempest-ServerRescueNegativeTestJSON-1433266011-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:59:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87e5cf8786fe44b5a5305f3be11d64c2',uuid=27863b45-4dda-4f6d-bd6f-0f332f1fdd52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "address": "fa:16:3e:2e:f5:1b", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa33b3-7d", "ovs_interfaceid": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-e6816f9f-d4ac-47cb-9ea7-16ba9877f704 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Converting VIF {"id": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "address": "fa:16:3e:2e:f5:1b", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ffa33b3-7d", "ovs_interfaceid": "9ffa33b3-7d4c-484c-834b-60c2f888b540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-e6816f9f-d4ac-47cb-9ea7-16ba9877f704 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:f5:1b,bridge_name='br-int',has_traffic_filtering=True,id=9ffa33b3-7d4c-484c-834b-60c2f888b540,network=Network(81a443a7-0a10-4c81-9903-853291c58596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ffa33b3-7d') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG os_vif [None req-e6816f9f-d4ac-47cb-9ea7-16ba9877f704 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:f5:1b,bridge_name='br-int',has_traffic_filtering=True,id=9ffa33b3-7d4c-484c-834b-60c2f888b540,network=Network(81a443a7-0a10-4c81-9903-853291c58596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ffa33b3-7d') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ffa33b3-7d, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f16569c-2c52-4276-a0cf-90e30f7cbd65) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:29 user nova-compute[74996]: INFO os_vif [None req-e6816f9f-d4ac-47cb-9ea7-16ba9877f704 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:f5:1b,bridge_name='br-int',has_traffic_filtering=True,id=9ffa33b3-7d4c-484c-834b-60c2f888b540,network=Network(81a443a7-0a10-4c81-9903-853291c58596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ffa33b3-7d')
Nov 02 02:02:29 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-e6816f9f-d4ac-47cb-9ea7-16ba9877f704 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Deleting instance files /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52_del
Nov 02 02:02:29 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-e6816f9f-d4ac-47cb-9ea7-16ba9877f704 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Deletion of /opt/stack/data/nova/instances/27863b45-4dda-4f6d-bd6f-0f332f1fdd52_del complete
Nov 02 02:02:29 user nova-compute[74996]: INFO nova.compute.manager [None req-e6816f9f-d4ac-47cb-9ea7-16ba9877f704 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 02 02:02:29 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-e6816f9f-d4ac-47cb-9ea7-16ba9877f704 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG nova.compute.manager [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 02:02:29 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Instance spawned successfully.
Nov 02 02:02:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG nova.compute.manager [req-cdd8388a-a1ae-4d8b-b8f6-5aa63ecbd756 req-f87d6956-4272-442f-ae0a-500d89766989 service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Received event network-vif-plugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cdd8388a-a1ae-4d8b-b8f6-5aa63ecbd756 req-f87d6956-4272-442f-ae0a-500d89766989 service nova] Acquiring lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cdd8388a-a1ae-4d8b-b8f6-5aa63ecbd756 req-f87d6956-4272-442f-ae0a-500d89766989 service nova] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cdd8388a-a1ae-4d8b-b8f6-5aa63ecbd756 req-f87d6956-4272-442f-ae0a-500d89766989 service nova] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:02:29 user nova-compute[74996]: DEBUG nova.compute.manager [req-cdd8388a-a1ae-4d8b-b8f6-5aa63ecbd756 req-f87d6956-4272-442f-ae0a-500d89766989 service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] No waiting events found dispatching network-vif-plugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:02:29 user nova-compute[74996]: WARNING nova.compute.manager [req-cdd8388a-a1ae-4d8b-b8f6-5aa63ecbd756 req-f87d6956-4272-442f-ae0a-500d89766989 service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Received unexpected event network-vif-plugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 for instance with vm_state building and task_state spawning.
Nov 02 02:02:29 user nova-compute[74996]: INFO nova.compute.manager [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Took 5.50 seconds to spawn the instance on the hypervisor.
Nov 02 02:02:29 user nova-compute[74996]: DEBUG nova.compute.manager [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 02:02:30 user nova-compute[74996]: INFO nova.compute.manager [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Took 6.16 seconds to build instance.
Nov 02 02:02:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-437087b7-d645-4270-8d7f-36a6b9a9e8a6 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.268s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:02:30 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:02:30 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Took 0.80 seconds to deallocate network for instance.
Nov 02 02:02:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e6816f9f-d4ac-47cb-9ea7-16ba9877f704 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:02:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e6816f9f-d4ac-47cb-9ea7-16ba9877f704 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:02:30 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-e6816f9f-d4ac-47cb-9ea7-16ba9877f704 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:02:30 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-e6816f9f-d4ac-47cb-9ea7-16ba9877f704 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:02:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e6816f9f-d4ac-47cb-9ea7-16ba9877f704 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:02:30 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-e6816f9f-d4ac-47cb-9ea7-16ba9877f704 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Deleted allocations for instance 27863b45-4dda-4f6d-bd6f-0f332f1fdd52
Nov 02 02:02:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e6816f9f-d4ac-47cb-9ea7-16ba9877f704 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.219s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:02:31 user nova-compute[74996]: DEBUG nova.compute.manager [req-16c428fc-6ff2-4297-a9d6-dece68577517 req-722e748e-734d-4f6b-855d-be2b06833122 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Received event network-vif-plugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:02:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-16c428fc-6ff2-4297-a9d6-dece68577517 req-722e748e-734d-4f6b-855d-be2b06833122 service nova] Acquiring lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:02:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-16c428fc-6ff2-4297-a9d6-dece68577517 req-722e748e-734d-4f6b-855d-be2b06833122 service nova] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:02:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-16c428fc-6ff2-4297-a9d6-dece68577517 req-722e748e-734d-4f6b-855d-be2b06833122 service nova] Lock "27863b45-4dda-4f6d-bd6f-0f332f1fdd52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:02:31 user nova-compute[74996]: DEBUG nova.compute.manager [req-16c428fc-6ff2-4297-a9d6-dece68577517 req-722e748e-734d-4f6b-855d-be2b06833122 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] No waiting events found dispatching network-vif-plugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:02:31 user nova-compute[74996]: WARNING nova.compute.manager [req-16c428fc-6ff2-4297-a9d6-dece68577517 req-722e748e-734d-4f6b-855d-be2b06833122 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Received unexpected event network-vif-plugged-9ffa33b3-7d4c-484c-834b-60c2f888b540 for instance with vm_state deleted and task_state None.
Nov 02 02:02:31 user nova-compute[74996]: DEBUG nova.compute.manager [req-16c428fc-6ff2-4297-a9d6-dece68577517 req-722e748e-734d-4f6b-855d-be2b06833122 service nova] [instance: 27863b45-4dda-4f6d-bd6f-0f332f1fdd52] Received event network-vif-deleted-9ffa33b3-7d4c-484c-834b-60c2f888b540 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:02:33 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 17b25747-b89d-43f0-a28a-afcf40d35e70 is timed out.
Nov 02 02:02:33 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Successfully detached device vdb from instance 17b25747-b89d-43f0-a28a-afcf40d35e70 from the live domain config.
Nov 02 02:02:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJAeuXiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:02:33 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:02:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e905ef6a-83fc-458a-8202-28f1cc838a06]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 02:02:33 user nova-compute[74996]: No targets found.
Nov 02 02:02:33 user nova-compute[74996]: iSNS:
Nov 02 02:02:33 user nova-compute[74996]: No targets found.
Nov 02 02:02:33 user nova-compute[74996]: STATIC:
Nov 02 02:02:33 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425
Nov 02 02:02:33 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 02:02:33 user nova-compute[74996]:                 Iface Name: default
Nov 02 02:02:33 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02
Nov 02 02:02:33 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 02:02:33 user nova-compute[74996]:                 Iface Name: default
Nov 02 02:02:33 user nova-compute[74996]: FIRMWARE:
Nov 02 02:02:33 user nova-compute[74996]: No targets found.
Nov 02 02:02:33 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 02:02:33 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 02:02:33 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6310ea-9446-45a9-a10a-a20ca8506bf3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafb320e-7cb9-45e7-ba7d-e4f043b13719]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 (non-flash)
Nov 02 02:02:33 user nova-compute[74996]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 (non-flash)
Nov 02 02:02:33 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 (non-flash)
Nov 02 02:02:33 user nova-compute[74996]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 (non-flash)
Nov 02 02:02:33 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8315368310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02'): ({'sdc'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Removing single pathed devices sdc {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa192d3-4dd3-493e-9d01-a9ce83cd124f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c7e2ce-eecb-485f-8a5c-989e00ee41ba]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Flushing IO for device /dev/sdc {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e909a813-5548-4f43-967a-65f04e8d8260]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[727e2e72-57f1-447a-9728-26d67057914d]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ff2eec-5380-43b7-ae4c-9c0030a1ba18]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a07dbf-8bcb-4de2-b099-970039a7de20]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02, portal: 172.16.0.220,3260]
Nov 02 02:02:33 user nova-compute[74996]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02, portal: 172.16.0.220,3260] successful.
Nov 02 02:02:33 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4afb240-da77-4ea2-96d5-138bb4168a02 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4eb4d8-379c-45f5-b0e3-2207bb5a9b34]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] <== disconnect_volume: return (317ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 02:02:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:34 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:02:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:02:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:02:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:02:34 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 02:02:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:34 user nova-compute[74996]: DEBUG nova.objects.instance [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lazy-loading 'flavor' on Instance uuid 17b25747-b89d-43f0-a28a-afcf40d35e70 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:02:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-39f7a582-bd41-47ae-8423-4e65f795a54b tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.883s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:02:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:36 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 02:02:37 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:02:37 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:02:37 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8377MB free_disk=24.892780303955078GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 02:02:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:02:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:02:37 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance e38704a7-f8a0-482c-bd51-26a90d37b71d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:02:37 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7c53e6cc-cf69-485d-b24f-5e113dae0e5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:02:37 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 4f56890c-d135-42a1-b862-7ac5f9076654 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:02:37 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 17b25747-b89d-43f0-a28a-afcf40d35e70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:02:37 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 04bbae43-881f-455a-bcd2-c1be2e82f0dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:02:37 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 02:02:37 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 02:02:37 user nova-compute[74996]: DEBUG nova.compute.manager [req-d30ec6c0-9a5d-4627-90f3-c6f434d47280 req-f4990a92-9e66-489f-bb04-1d6ca8c5dc39 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Received event network-changed-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:02:37 user nova-compute[74996]: DEBUG nova.compute.manager [req-d30ec6c0-9a5d-4627-90f3-c6f434d47280 req-f4990a92-9e66-489f-bb04-1d6ca8c5dc39 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Refreshing instance network info cache due to event network-changed-78937d9b-197e-4ff7-8e1c-c26daa12fcc8. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 02:02:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d30ec6c0-9a5d-4627-90f3-c6f434d47280 req-f4990a92-9e66-489f-bb04-1d6ca8c5dc39 service nova] Acquiring lock "refresh_cache-4f56890c-d135-42a1-b862-7ac5f9076654" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:02:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d30ec6c0-9a5d-4627-90f3-c6f434d47280 req-f4990a92-9e66-489f-bb04-1d6ca8c5dc39 service nova] Acquired lock "refresh_cache-4f56890c-d135-42a1-b862-7ac5f9076654" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:02:37 user nova-compute[74996]: DEBUG nova.network.neutron [req-d30ec6c0-9a5d-4627-90f3-c6f434d47280 req-f4990a92-9e66-489f-bb04-1d6ca8c5dc39 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Refreshing network info cache for port 78937d9b-197e-4ff7-8e1c-c26daa12fcc8 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 02:02:37 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:02:37 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:02:37 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 02:02:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.631s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:02:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "4f56890c-d135-42a1-b862-7ac5f9076654" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:02:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "4f56890c-d135-42a1-b862-7ac5f9076654" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:02:38 user nova-compute[74996]: INFO nova.compute.manager [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Detaching volume a86c480c-2ecb-4347-b194-d6ce06ca9425
Nov 02 02:02:38 user nova-compute[74996]: INFO nova.virt.block_device [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Attempting to driver detach volume a86c480c-2ecb-4347-b194-d6ce06ca9425 from mountpoint /dev/vdb
Nov 02 02:02:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Attempting to detach device vdb from instance 4f56890c-d135-42a1-b862-7ac5f9076654 from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 02:02:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 02:02:38 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:02:38 user nova-compute[74996]:   <source dev="/dev/sdd"/>
Nov 02 02:02:38 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:02:38 user nova-compute[74996]:   <serial>a86c480c-2ecb-4347-b194-d6ce06ca9425</serial>
Nov 02 02:02:38 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 02:02:38 user nova-compute[74996]: </disk>
Nov 02 02:02:38 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 02:02:38 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Successfully detached device vdb from instance 4f56890c-d135-42a1-b862-7ac5f9076654 from the persistent domain config.
Nov 02 02:02:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4f56890c-d135-42a1-b862-7ac5f9076654 from the live domain config. {{(pid=74996) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 02:02:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 02:02:38 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:02:38 user nova-compute[74996]:   <source dev="/dev/sdd"/>
Nov 02 02:02:38 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:02:38 user nova-compute[74996]:   <serial>a86c480c-2ecb-4347-b194-d6ce06ca9425</serial>
Nov 02 02:02:38 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 02:02:38 user nova-compute[74996]: </disk>
Nov 02 02:02:38 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 02:02:38 user nova-compute[74996]: DEBUG nova.network.neutron [req-d30ec6c0-9a5d-4627-90f3-c6f434d47280 req-f4990a92-9e66-489f-bb04-1d6ca8c5dc39 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Updated VIF entry in instance network info cache for port 78937d9b-197e-4ff7-8e1c-c26daa12fcc8. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 02:02:38 user nova-compute[74996]: DEBUG nova.network.neutron [req-d30ec6c0-9a5d-4627-90f3-c6f434d47280 req-f4990a92-9e66-489f-bb04-1d6ca8c5dc39 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Updating instance_info_cache with network_info: [{"id": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "address": "fa:16:3e:ef:c5:84", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78937d9b-19", "ovs_interfaceid": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:02:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d30ec6c0-9a5d-4627-90f3-c6f434d47280 req-f4990a92-9e66-489f-bb04-1d6ca8c5dc39 service nova] Releasing lock "refresh_cache-4f56890c-d135-42a1-b862-7ac5f9076654" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:02:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4f56890c-d135-42a1-b862-7ac5f9076654 {{(pid=74996) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 02:02:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:02:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:02:39 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 02:02:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:02:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:02:39 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 02:02:39 user nova-compute[74996]: INFO nova.compute.claims [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Claim successful on node user
Nov 02 02:02:39 user nova-compute[74996]: DEBUG nova.compute.manager [req-a48449b3-2900-4336-9e54-67a0efe000fb req-1630a749-2829-4bbe-aedd-c0d5897687ab service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Received event network-changed-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:02:39 user nova-compute[74996]: DEBUG nova.compute.manager [req-a48449b3-2900-4336-9e54-67a0efe000fb req-1630a749-2829-4bbe-aedd-c0d5897687ab service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Refreshing instance network info cache due to event network-changed-78937d9b-197e-4ff7-8e1c-c26daa12fcc8. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 02:02:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a48449b3-2900-4336-9e54-67a0efe000fb req-1630a749-2829-4bbe-aedd-c0d5897687ab service nova] Acquiring lock "refresh_cache-4f56890c-d135-42a1-b862-7ac5f9076654" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:02:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a48449b3-2900-4336-9e54-67a0efe000fb req-1630a749-2829-4bbe-aedd-c0d5897687ab service nova] Acquired lock "refresh_cache-4f56890c-d135-42a1-b862-7ac5f9076654" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:02:39 user nova-compute[74996]: DEBUG nova.network.neutron [req-a48449b3-2900-4336-9e54-67a0efe000fb req-1630a749-2829-4bbe-aedd-c0d5897687ab service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Refreshing network info cache for port 78937d9b-197e-4ff7-8e1c-c26daa12fcc8 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 02:02:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:39 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:02:39 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:02:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:02:39 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 02:02:39 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 02:02:39 user nova-compute[74996]: DEBUG nova.network.neutron [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 02:02:39 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 02:02:40 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 02:02:40 user nova-compute[74996]: DEBUG nova.policy [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a32baeba9e0491392e9bd9475b1dddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '971ca9cd14604f619cc269252bdc0983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 02:02:40 user nova-compute[74996]: DEBUG nova.network.neutron [req-a48449b3-2900-4336-9e54-67a0efe000fb req-1630a749-2829-4bbe-aedd-c0d5897687ab service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Updated VIF entry in instance network info cache for port 78937d9b-197e-4ff7-8e1c-c26daa12fcc8. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 02:02:40 user nova-compute[74996]: DEBUG nova.network.neutron [req-a48449b3-2900-4336-9e54-67a0efe000fb req-1630a749-2829-4bbe-aedd-c0d5897687ab service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Updating instance_info_cache with network_info: [{"id": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "address": "fa:16:3e:ef:c5:84", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78937d9b-19", "ovs_interfaceid": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:02:40 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 02:02:40 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 02:02:40 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Creating image(s)
Nov 02 02:02:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e773f71-2d35-4daa-ae68-e1e7f4b9d94d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:02:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "/opt/stack/data/nova/instances/8e773f71-2d35-4daa-ae68-e1e7f4b9d94d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:02:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "/opt/stack/data/nova/instances/8e773f71-2d35-4daa-ae68-e1e7f4b9d94d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:02:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a48449b3-2900-4336-9e54-67a0efe000fb req-1630a749-2829-4bbe-aedd-c0d5897687ab service nova] Releasing lock "refresh_cache-4f56890c-d135-42a1-b862-7ac5f9076654" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:02:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.191s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:02:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:02:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.194s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/8e773f71-2d35-4daa-ae68-e1e7f4b9d94d/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:40 user nova-compute[74996]: DEBUG nova.network.neutron [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Successfully created port: 3c23df81-7b74-48b3-8f38-d458707b3e7d {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 02:02:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/8e773f71-2d35-4daa-ae68-e1e7f4b9d94d/disk 1073741824" returned: 0 in 0.060s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:02:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.198s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:40 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e773f71-2d35-4daa-ae68-e1e7f4b9d94d/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 02:02:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e773f71-2d35-4daa-ae68-e1e7f4b9d94d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e773f71-2d35-4daa-ae68-e1e7f4b9d94d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Cannot resize image /opt/stack/data/nova/instances/8e773f71-2d35-4daa-ae68-e1e7f4b9d94d/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Ensure instance console log exists: /opt/stack/data/nova/instances/8e773f71-2d35-4daa-ae68-e1e7f4b9d94d/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.network.neutron [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Successfully updated port: 3c23df81-7b74-48b3-8f38-d458707b3e7d {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "refresh_cache-8e773f71-2d35-4daa-ae68-e1e7f4b9d94d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquired lock "refresh_cache-8e773f71-2d35-4daa-ae68-e1e7f4b9d94d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.network.neutron [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.compute.manager [req-d5203aac-2354-4b2a-92dd-a5216a8a9eb6 req-f40a607c-b3f3-49b9-b923-71e25d93aa8c service nova] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Received event network-changed-3c23df81-7b74-48b3-8f38-d458707b3e7d {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.compute.manager [req-d5203aac-2354-4b2a-92dd-a5216a8a9eb6 req-f40a607c-b3f3-49b9-b923-71e25d93aa8c service nova] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Refreshing instance network info cache due to event network-changed-3c23df81-7b74-48b3-8f38-d458707b3e7d. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d5203aac-2354-4b2a-92dd-a5216a8a9eb6 req-f40a607c-b3f3-49b9-b923-71e25d93aa8c service nova] Acquiring lock "refresh_cache-8e773f71-2d35-4daa-ae68-e1e7f4b9d94d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.network.neutron [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.network.neutron [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Updating instance_info_cache with network_info: [{"id": "3c23df81-7b74-48b3-8f38-d458707b3e7d", "address": "fa:16:3e:39:1d:17", "network": {"id": "5d5d58ab-0d25-4d7e-b535-857923f4a7a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1163860226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "971ca9cd14604f619cc269252bdc0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c23df81-7b", "ovs_interfaceid": "3c23df81-7b74-48b3-8f38-d458707b3e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Releasing lock "refresh_cache-8e773f71-2d35-4daa-ae68-e1e7f4b9d94d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Instance network_info: |[{"id": "3c23df81-7b74-48b3-8f38-d458707b3e7d", "address": "fa:16:3e:39:1d:17", "network": {"id": "5d5d58ab-0d25-4d7e-b535-857923f4a7a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1163860226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "971ca9cd14604f619cc269252bdc0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c23df81-7b", "ovs_interfaceid": "3c23df81-7b74-48b3-8f38-d458707b3e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d5203aac-2354-4b2a-92dd-a5216a8a9eb6 req-f40a607c-b3f3-49b9-b923-71e25d93aa8c service nova] Acquired lock "refresh_cache-8e773f71-2d35-4daa-ae68-e1e7f4b9d94d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.network.neutron [req-d5203aac-2354-4b2a-92dd-a5216a8a9eb6 req-f40a607c-b3f3-49b9-b923-71e25d93aa8c service nova] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Refreshing network info cache for port 3c23df81-7b74-48b3-8f38-d458707b3e7d {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Start _get_guest_xml network_info=[{"id": "3c23df81-7b74-48b3-8f38-d458707b3e7d", "address": "fa:16:3e:39:1d:17", "network": {"id": "5d5d58ab-0d25-4d7e-b535-857923f4a7a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1163860226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "971ca9cd14604f619cc269252bdc0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c23df81-7b", "ovs_interfaceid": "3c23df81-7b74-48b3-8f38-d458707b3e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 02:02:41 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:02:41 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:02:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-910655328',display_name='tempest-VolumesSnapshotTestJSON-instance-910655328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-910655328',id=45,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZS/+1qUmQXcFQlvNoicPEBbgGCJ2Q392vsjnWjUn5B3t7q0M2eRNzdYFqZHNtZARt8tarE2ggKT9xybU063ujYA5fo4cvce0QNlbXg45VDldzox5KVqKU3hs5cLYwxrA==',key_name='tempest-keypair-650627317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='971ca9cd14604f619cc269252bdc0983',ramdisk_id='',reservation_id='r-ncsekunm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1059088146',owner_user_name='tempest-VolumesSnapshotTestJSON-1059088146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T02:02:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a32baeba9e0491392e9bd9475b1dddd',uuid=8e773f71-2d35-4daa-ae68-e1e7f4b9d94d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c23df81-7b74-48b3-8f38-d458707b3e7d", "address": "fa:16:3e:39:1d:17", "network": {"id": "5d5d58ab-0d25-4d7e-b535-857923f4a7a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1163860226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "971ca9cd14604f619cc269252bdc0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c23df81-7b", "ovs_interfaceid": "3c23df81-7b74-48b3-8f38-d458707b3e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Converting VIF {"id": "3c23df81-7b74-48b3-8f38-d458707b3e7d", "address": "fa:16:3e:39:1d:17", "network": {"id": "5d5d58ab-0d25-4d7e-b535-857923f4a7a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1163860226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "971ca9cd14604f619cc269252bdc0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c23df81-7b", "ovs_interfaceid": "3c23df81-7b74-48b3-8f38-d458707b3e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:1d:17,bridge_name='br-int',has_traffic_filtering=True,id=3c23df81-7b74-48b3-8f38-d458707b3e7d,network=Network(5d5d58ab-0d25-4d7e-b535-857923f4a7a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c23df81-7b') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.objects.instance [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] End _get_guest_xml xml=<domain type="kvm">
Nov 02 02:02:41 user nova-compute[74996]:   <uuid>8e773f71-2d35-4daa-ae68-e1e7f4b9d94d</uuid>
Nov 02 02:02:41 user nova-compute[74996]:   <name>instance-0000002d</name>
Nov 02 02:02:41 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 02:02:41 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 02:02:41 user nova-compute[74996]:   <metadata>
Nov 02 02:02:41 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 02:02:41 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 02:02:41 user nova-compute[74996]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-910655328</nova:name>
Nov 02 02:02:41 user nova-compute[74996]:       <nova:creationTime>2023-11-02 02:02:41</nova:creationTime>
Nov 02 02:02:41 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 02:02:41 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 02:02:41 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 02:02:41 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 02:02:41 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 02:02:41 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 02:02:41 user nova-compute[74996]:       </nova:flavor>
Nov 02 02:02:41 user nova-compute[74996]:       <nova:owner>
Nov 02 02:02:41 user nova-compute[74996]:         <nova:user uuid="7a32baeba9e0491392e9bd9475b1dddd">tempest-VolumesSnapshotTestJSON-1059088146-project-member</nova:user>
Nov 02 02:02:41 user nova-compute[74996]:         <nova:project uuid="971ca9cd14604f619cc269252bdc0983">tempest-VolumesSnapshotTestJSON-1059088146</nova:project>
Nov 02 02:02:41 user nova-compute[74996]:       </nova:owner>
Nov 02 02:02:41 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 02:02:41 user nova-compute[74996]:       <nova:ports>
Nov 02 02:02:41 user nova-compute[74996]:         <nova:port uuid="3c23df81-7b74-48b3-8f38-d458707b3e7d">
Nov 02 02:02:41 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 02:02:41 user nova-compute[74996]:         </nova:port>
Nov 02 02:02:41 user nova-compute[74996]:       </nova:ports>
Nov 02 02:02:41 user nova-compute[74996]:     </nova:instance>
Nov 02 02:02:41 user nova-compute[74996]:   </metadata>
Nov 02 02:02:41 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 02:02:41 user nova-compute[74996]:     <system>
Nov 02 02:02:41 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 02:02:41 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 02:02:41 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 02:02:41 user nova-compute[74996]:       <entry name="serial">8e773f71-2d35-4daa-ae68-e1e7f4b9d94d</entry>
Nov 02 02:02:41 user nova-compute[74996]:       <entry name="uuid">8e773f71-2d35-4daa-ae68-e1e7f4b9d94d</entry>
Nov 02 02:02:41 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 02:02:41 user nova-compute[74996]:     </system>
Nov 02 02:02:41 user nova-compute[74996]:   </sysinfo>
Nov 02 02:02:41 user nova-compute[74996]:   <os>
Nov 02 02:02:41 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 02:02:41 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 02:02:41 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 02:02:41 user nova-compute[74996]:   </os>
Nov 02 02:02:41 user nova-compute[74996]:   <features>
Nov 02 02:02:41 user nova-compute[74996]:     <acpi/>
Nov 02 02:02:41 user nova-compute[74996]:     <apic/>
Nov 02 02:02:41 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 02:02:41 user nova-compute[74996]:   </features>
Nov 02 02:02:41 user nova-compute[74996]:   <clock offset="utc">
Nov 02 02:02:41 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 02:02:41 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 02:02:41 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 02:02:41 user nova-compute[74996]:   </clock>
Nov 02 02:02:41 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 02:02:41 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 02:02:41 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 02:02:41 user nova-compute[74996]:   </cpu>
Nov 02 02:02:41 user nova-compute[74996]:   <devices>
Nov 02 02:02:41 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 02:02:41 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 02:02:41 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/8e773f71-2d35-4daa-ae68-e1e7f4b9d94d/disk"/>
Nov 02 02:02:41 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 02:02:41 user nova-compute[74996]:     </disk>
Nov 02 02:02:41 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 02:02:41 user nova-compute[74996]:       <mac address="fa:16:3e:39:1d:17"/>
Nov 02 02:02:41 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 02:02:41 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 02:02:41 user nova-compute[74996]:       <target dev="tap3c23df81-7b"/>
Nov 02 02:02:41 user nova-compute[74996]:     </interface>
Nov 02 02:02:41 user nova-compute[74996]:     <serial type="pty">
Nov 02 02:02:41 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/8e773f71-2d35-4daa-ae68-e1e7f4b9d94d/console.log" append="off"/>
Nov 02 02:02:41 user nova-compute[74996]:     </serial>
Nov 02 02:02:41 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 02:02:41 user nova-compute[74996]:     <video>
Nov 02 02:02:41 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 02:02:41 user nova-compute[74996]:     </video>
Nov 02 02:02:41 user nova-compute[74996]:     <rng model="virtio">
Nov 02 02:02:41 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 02:02:41 user nova-compute[74996]:     </rng>
Nov 02 02:02:41 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 02:02:41 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 02:02:41 user nova-compute[74996]:       <stats period="10"/>
Nov 02 02:02:41 user nova-compute[74996]:     </memballoon>
Nov 02 02:02:41 user nova-compute[74996]:   </devices>
Nov 02 02:02:41 user nova-compute[74996]: </domain>
Nov 02 02:02:41 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:02:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-910655328',display_name='tempest-VolumesSnapshotTestJSON-instance-910655328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-910655328',id=45,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZS/+1qUmQXcFQlvNoicPEBbgGCJ2Q392vsjnWjUn5B3t7q0M2eRNzdYFqZHNtZARt8tarE2ggKT9xybU063ujYA5fo4cvce0QNlbXg45VDldzox5KVqKU3hs5cLYwxrA==',key_name='tempest-keypair-650627317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='971ca9cd14604f619cc269252bdc0983',ramdisk_id='',reservation_id='r-ncsekunm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1059088146',owner_user_name='tempest-VolumesSnapshotTestJSON-1059088146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T02:02:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a32baeba9e0491392e9bd9475b1dddd',uuid=8e773f71-2d35-4daa-ae68-e1e7f4b9d94d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c23df81-7b74-48b3-8f38-d458707b3e7d", "address": "fa:16:3e:39:1d:17", "network": {"id": "5d5d58ab-0d25-4d7e-b535-857923f4a7a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1163860226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "971ca9cd14604f619cc269252bdc0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c23df81-7b", "ovs_interfaceid": "3c23df81-7b74-48b3-8f38-d458707b3e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Converting VIF {"id": "3c23df81-7b74-48b3-8f38-d458707b3e7d", "address": "fa:16:3e:39:1d:17", "network": {"id": "5d5d58ab-0d25-4d7e-b535-857923f4a7a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1163860226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "971ca9cd14604f619cc269252bdc0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c23df81-7b", "ovs_interfaceid": "3c23df81-7b74-48b3-8f38-d458707b3e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:1d:17,bridge_name='br-int',has_traffic_filtering=True,id=3c23df81-7b74-48b3-8f38-d458707b3e7d,network=Network(5d5d58ab-0d25-4d7e-b535-857923f4a7a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c23df81-7b') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG os_vif [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:1d:17,bridge_name='br-int',has_traffic_filtering=True,id=3c23df81-7b74-48b3-8f38-d458707b3e7d,network=Network(5d5d58ab-0d25-4d7e-b535-857923f4a7a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c23df81-7b') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a28ae2f7-2146-5f79-8055-8208bd73094a', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c23df81-7b, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3c23df81-7b, col_values=(('qos', UUID('5b6c2e43-f789-4968-88ed-fbd27806b40b')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3c23df81-7b, col_values=(('external_ids', {'iface-id': '3c23df81-7b74-48b3-8f38-d458707b3e7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:1d:17', 'vm-uuid': '8e773f71-2d35-4daa-ae68-e1e7f4b9d94d'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:41 user nova-compute[74996]: INFO os_vif [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:1d:17,bridge_name='br-int',has_traffic_filtering=True,id=3c23df81-7b74-48b3-8f38-d458707b3e7d,network=Network(5d5d58ab-0d25-4d7e-b535-857923f4a7a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c23df81-7b')
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] No VIF found with MAC fa:16:3e:39:1d:17, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-4f56890c-d135-42a1-b862-7ac5f9076654" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-4f56890c-d135-42a1-b862-7ac5f9076654" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.network.neutron [req-d5203aac-2354-4b2a-92dd-a5216a8a9eb6 req-f40a607c-b3f3-49b9-b923-71e25d93aa8c service nova] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Updated VIF entry in instance network info cache for port 3c23df81-7b74-48b3-8f38-d458707b3e7d. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG nova.network.neutron [req-d5203aac-2354-4b2a-92dd-a5216a8a9eb6 req-f40a607c-b3f3-49b9-b923-71e25d93aa8c service nova] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Updating instance_info_cache with network_info: [{"id": "3c23df81-7b74-48b3-8f38-d458707b3e7d", "address": "fa:16:3e:39:1d:17", "network": {"id": "5d5d58ab-0d25-4d7e-b535-857923f4a7a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1163860226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "971ca9cd14604f619cc269252bdc0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c23df81-7b", "ovs_interfaceid": "3c23df81-7b74-48b3-8f38-d458707b3e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:02:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-d5203aac-2354-4b2a-92dd-a5216a8a9eb6 req-f40a607c-b3f3-49b9-b923-71e25d93aa8c service nova] Releasing lock "refresh_cache-8e773f71-2d35-4daa-ae68-e1e7f4b9d94d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:02:42 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Updating instance_info_cache with network_info: [{"id": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "address": "fa:16:3e:ef:c5:84", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78937d9b-19", "ovs_interfaceid": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:02:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-4f56890c-d135-42a1-b862-7ac5f9076654" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:02:42 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 02:02:42 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:02:42 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:02:42 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:02:42 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:02:42 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 02:02:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-3d4297ae-621a-4696-9bb4-0b33694e48f5 req-a59ff4f9-773c-4222-8dc9-dab78846c7a9 service nova] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Received event network-vif-plugged-3c23df81-7b74-48b3-8f38-d458707b3e7d {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:02:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3d4297ae-621a-4696-9bb4-0b33694e48f5 req-a59ff4f9-773c-4222-8dc9-dab78846c7a9 service nova] Acquiring lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:02:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3d4297ae-621a-4696-9bb4-0b33694e48f5 req-a59ff4f9-773c-4222-8dc9-dab78846c7a9 service nova] Lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:02:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3d4297ae-621a-4696-9bb4-0b33694e48f5 req-a59ff4f9-773c-4222-8dc9-dab78846c7a9 service nova] Lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:02:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-3d4297ae-621a-4696-9bb4-0b33694e48f5 req-a59ff4f9-773c-4222-8dc9-dab78846c7a9 service nova] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] No waiting events found dispatching network-vif-plugged-3c23df81-7b74-48b3-8f38-d458707b3e7d {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:02:43 user nova-compute[74996]: WARNING nova.compute.manager [req-3d4297ae-621a-4696-9bb4-0b33694e48f5 req-a59ff4f9-773c-4222-8dc9-dab78846c7a9 service nova] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Received unexpected event network-vif-plugged-3c23df81-7b74-48b3-8f38-d458707b3e7d for instance with vm_state building and task_state spawning.
Nov 02 02:02:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:45 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 02:02:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 02:02:45 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Instance spawned successfully.
Nov 02 02:02:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 02:02:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:02:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:02:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:02:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:02:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:02:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:02:45 user nova-compute[74996]: INFO nova.compute.manager [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 02 02:02:45 user nova-compute[74996]: DEBUG nova.compute.manager [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 02:02:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-4c68f2e9-3b66-43c8-baa9-dc82def3f882 req-0366875f-b1eb-400d-a176-f13bb4c1c8d0 service nova] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Received event network-vif-plugged-3c23df81-7b74-48b3-8f38-d458707b3e7d {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:02:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4c68f2e9-3b66-43c8-baa9-dc82def3f882 req-0366875f-b1eb-400d-a176-f13bb4c1c8d0 service nova] Acquiring lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:02:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4c68f2e9-3b66-43c8-baa9-dc82def3f882 req-0366875f-b1eb-400d-a176-f13bb4c1c8d0 service nova] Lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:02:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4c68f2e9-3b66-43c8-baa9-dc82def3f882 req-0366875f-b1eb-400d-a176-f13bb4c1c8d0 service nova] Lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:02:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-4c68f2e9-3b66-43c8-baa9-dc82def3f882 req-0366875f-b1eb-400d-a176-f13bb4c1c8d0 service nova] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] No waiting events found dispatching network-vif-plugged-3c23df81-7b74-48b3-8f38-d458707b3e7d {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:02:45 user nova-compute[74996]: WARNING nova.compute.manager [req-4c68f2e9-3b66-43c8-baa9-dc82def3f882 req-0366875f-b1eb-400d-a176-f13bb4c1c8d0 service nova] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Received unexpected event network-vif-plugged-3c23df81-7b74-48b3-8f38-d458707b3e7d for instance with vm_state building and task_state spawning.
Nov 02 02:02:45 user nova-compute[74996]: INFO nova.compute.manager [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Took 5.73 seconds to build instance.
Nov 02 02:02:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-a5cfb5db-3eb4-45b1-bff4-104f061a6262 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.825s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:02:46 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:02:46 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:02:58 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4f56890c-d135-42a1-b862-7ac5f9076654 is timed out.
Nov 02 02:02:58 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Successfully detached device vdb from instance 4f56890c-d135-42a1-b862-7ac5f9076654 from the live domain config.
Nov 02 02:02:58 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 02:02:58 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dxBwKaIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:02:58 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:02:58 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:02:58 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:02:58 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb43fa0-3974-463f-8ce8-82245c5a3f46]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 02:02:59 user nova-compute[74996]: No targets found.
Nov 02 02:02:59 user nova-compute[74996]: iSNS:
Nov 02 02:02:59 user nova-compute[74996]: No targets found.
Nov 02 02:02:59 user nova-compute[74996]: STATIC:
Nov 02 02:02:59 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425
Nov 02 02:02:59 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 02:02:59 user nova-compute[74996]:                 Iface Name: default
Nov 02 02:02:59 user nova-compute[74996]: FIRMWARE:
Nov 02 02:02:59 user nova-compute[74996]: No targets found.
Nov 02 02:02:59 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 02:02:59 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 02:02:59 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e15b287-7ba2-4178-938a-cad8f07e6a3c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[928d0071-e2f9-4805-91ef-399432d5bae9]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 (non-flash)
Nov 02 02:02:59 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 (non-flash)
Nov 02 02:02:59 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830c42c280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425'): ({'sdd'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Removing single pathed devices sdd {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a859306a-013c-46fd-bd01-6c45e7d04449]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d24bcc-a429-4448-9032-22febae7e228]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Flushing IO for device /dev/sdd {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7eb042-d9e3-4b36-b1fc-767457022dea]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10b485e-d043-4032-ae25-2cf795f0b8ce]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] SCSI volumes sdd have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[989af3f9-10a6-436a-a98e-f16c82307a74]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2925b6ab-7f0c-4b36-9c2d-624392c44a5b]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425, portal: 172.16.0.220,3260]
Nov 02 02:02:59 user nova-compute[74996]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425, portal: 172.16.0.220,3260] successful.
Nov 02 02:02:59 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a86c480c-2ecb-4347-b194-d6ce06ca9425 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a88933-3bc3-4d04-8c44-77a44f0ddfd4]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] <== disconnect_volume: return (285ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:02:59 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 02:03:00 user nova-compute[74996]: DEBUG nova.objects.instance [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lazy-loading 'flavor' on Instance uuid 4f56890c-d135-42a1-b862-7ac5f9076654 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:03:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-88bb21b2-00cf-4831-80c6-aac3f32e6634 tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "4f56890c-d135-42a1-b862-7ac5f9076654" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.742s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:03:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "17b25747-b89d-43f0-a28a-afcf40d35e70" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:03:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:03:09 user nova-compute[74996]: DEBUG nova.objects.instance [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lazy-loading 'flavor' on Instance uuid 17b25747-b89d-43f0-a28a-afcf40d35e70 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:03:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:03:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "17b25747-b89d-43f0-a28a-afcf40d35e70" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:03:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:03:09 user nova-compute[74996]: INFO nova.compute.manager [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Attaching volume 72f1cfc2-d623-4642-a4fc-389faf124842 to /dev/vdb
Nov 02 02:03:09 user nova-compute[74996]: DEBUG os_brick.utils [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:03:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:09 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[60461592-f406-4626-a8fa-f78f850d15e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:03:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:09 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4137ae9d-b969-41c8-b9a4-37ff7655f58f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:03:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:09 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2794401b-d2de-4a68-b329-a6b6ed1a68bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:03:09 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6baadb74-c3d0-409c-b7a4-e25fc8fa8892]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:03:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 02:03:09 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 02:03:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:09 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 02:03:09 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 02:03:09 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6321428b-73d4-4ce6-b30b-55e37989041f]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:03:09 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 02:03:09 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 02:03:09 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 02:03:09 user nova-compute[74996]: DEBUG os_brick.utils [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:03:09 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Updating existing volume attachment record: c40e6cfd-3b91-4fc1-8ddf-738269a2794d {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 02:03:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:16 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:03:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:03:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:03:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:03:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FoHcrMzZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:03:28 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:03:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:03:28 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:03:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:03:28 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[704ea961-af42-4b59-ae28-c1bbaee94c8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 02:03:28 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b78586-cdf3-4d25-a4c6-29c5382520ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842] added
Nov 02 02:03:28 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb0f108-83d2-4988-9ba2-ebc22267c19c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2202d74e-41d9-4221-92e2-d6fe75af5bc7]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FoHcrMzZ {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FoHcrMzZ" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2678b3-8113-441e-a17a-bce2a9eb06cc]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FoHcrMzZ'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d12c20e-6976-4d09-97b7-8b3985e55252]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[93be8371-9945-43b0-8bcc-3f2e78999685]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 02:03:28 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 02:03:28 user nova-compute[74996]:  {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:03:28 user nova-compute[74996]: WARNING os_brick.initiator.connectors.iscsi [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 02:03:28 user nova-compute[74996]: 
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[46159d3c-6ef7-403e-b47e-18f5b40ce1ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842, portal: 172.16.0.220,3260]
Nov 02 02:03:28 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842, portal: 172.16.0.220,3260] successful.
Nov 02 02:03:28 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[291e41f1-1434-49ee-964c-8c90a33fb09d]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adcc497-42db-492b-b51c-c9d7b8a29659]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842 (non-flash)
Nov 02 02:03:28 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842 (non-flash)
Nov 02 02:03:28 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 02:03:28 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ba2d93-6d82-4dc3-a240-f2542953961a]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:03:29 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 02:03:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FoHcrMzZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 02:03:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:03:30 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23238626265316165', 'path': '/dev/sdb'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:03:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238626265316165', 'path': '/dev/sdb'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 02:03:30 user nova-compute[74996]: DEBUG nova.objects.instance [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lazy-loading 'flavor' on Instance uuid 17b25747-b89d-43f0-a28a-afcf40d35e70 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:03:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 02:03:30 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:03:30 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 02:03:30 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:03:30 user nova-compute[74996]:   <serial>72f1cfc2-d623-4642-a4fc-389faf124842</serial>
Nov 02 02:03:30 user nova-compute[74996]: </disk>
Nov 02 02:03:30 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 02:03:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:03:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:03:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] No VIF found with MAC fa:16:3e:9e:8e:1e, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 02:03:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-816f81b4-f084-4dc3-830a-4aa7d64561ca tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.037s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:03:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "17b25747-b89d-43f0-a28a-afcf40d35e70" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:03:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:03:32 user nova-compute[74996]: INFO nova.compute.manager [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Detaching volume 72f1cfc2-d623-4642-a4fc-389faf124842
Nov 02 02:03:32 user nova-compute[74996]: INFO nova.virt.block_device [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Attempting to driver detach volume 72f1cfc2-d623-4642-a4fc-389faf124842 from mountpoint /dev/vdb
Nov 02 02:03:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Attempting to detach device vdb from instance 17b25747-b89d-43f0-a28a-afcf40d35e70 from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 02:03:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 02:03:32 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:03:32 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 02:03:32 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:03:32 user nova-compute[74996]:   <serial>72f1cfc2-d623-4642-a4fc-389faf124842</serial>
Nov 02 02:03:32 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 02:03:32 user nova-compute[74996]: </disk>
Nov 02 02:03:32 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 02:03:32 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Successfully detached device vdb from instance 17b25747-b89d-43f0-a28a-afcf40d35e70 from the persistent domain config.
Nov 02 02:03:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 17b25747-b89d-43f0-a28a-afcf40d35e70 from the live domain config. {{(pid=74996) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 02:03:32 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 02:03:32 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:03:32 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 02:03:32 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:03:32 user nova-compute[74996]:   <serial>72f1cfc2-d623-4642-a4fc-389faf124842</serial>
Nov 02 02:03:32 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 02:03:32 user nova-compute[74996]: </disk>
Nov 02 02:03:32 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 02:03:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 17b25747-b89d-43f0-a28a-afcf40d35e70 {{(pid=74996) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 02:03:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:34 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:03:34 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:03:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:03:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:03:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:03:34 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 02:03:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e773f71-2d35-4daa-ae68-e1e7f4b9d94d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e773f71-2d35-4daa-ae68-e1e7f4b9d94d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e773f71-2d35-4daa-ae68-e1e7f4b9d94d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e773f71-2d35-4daa-ae68-e1e7f4b9d94d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:37 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:03:37 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:03:37 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8208MB free_disk=24.82659149169922GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 02:03:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:03:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:03:37 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance e38704a7-f8a0-482c-bd51-26a90d37b71d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:03:37 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 7c53e6cc-cf69-485d-b24f-5e113dae0e5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:03:37 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 4f56890c-d135-42a1-b862-7ac5f9076654 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:03:37 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 17b25747-b89d-43f0-a28a-afcf40d35e70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:03:37 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 04bbae43-881f-455a-bcd2-c1be2e82f0dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:03:37 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:03:37 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 02:03:37 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 02:03:37 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:03:37 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:03:37 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 02:03:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.365s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:03:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e2847ec9-59da-472f-ae27-00bf7860d0be tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:03:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e2847ec9-59da-472f-ae27-00bf7860d0be tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:03:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e2847ec9-59da-472f-ae27-00bf7860d0be tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:03:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e2847ec9-59da-472f-ae27-00bf7860d0be tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:03:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e2847ec9-59da-472f-ae27-00bf7860d0be tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:03:40 user nova-compute[74996]: INFO nova.compute.manager [None req-e2847ec9-59da-472f-ae27-00bf7860d0be tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Terminating instance
Nov 02 02:03:40 user nova-compute[74996]: DEBUG nova.compute.manager [None req-e2847ec9-59da-472f-ae27-00bf7860d0be tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 02:03:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d1778cac-1373-410f-bbf0-235a9785901d tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "4f56890c-d135-42a1-b862-7ac5f9076654" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:03:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d1778cac-1373-410f-bbf0-235a9785901d tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "4f56890c-d135-42a1-b862-7ac5f9076654" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:03:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d1778cac-1373-410f-bbf0-235a9785901d tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "4f56890c-d135-42a1-b862-7ac5f9076654-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:03:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d1778cac-1373-410f-bbf0-235a9785901d tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "4f56890c-d135-42a1-b862-7ac5f9076654-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:03:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d1778cac-1373-410f-bbf0-235a9785901d tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "4f56890c-d135-42a1-b862-7ac5f9076654-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:03:40 user nova-compute[74996]: INFO nova.compute.manager [None req-d1778cac-1373-410f-bbf0-235a9785901d tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Terminating instance
Nov 02 02:03:40 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d1778cac-1373-410f-bbf0-235a9785901d tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 02:03:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:40 user nova-compute[74996]: DEBUG nova.compute.manager [req-93570756-2f4c-418b-9cbd-e2ae50d40ed7 req-6e2855dd-dbf6-417b-9cf3-effca8e34550 service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Received event network-vif-unplugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:03:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-93570756-2f4c-418b-9cbd-e2ae50d40ed7 req-6e2855dd-dbf6-417b-9cf3-effca8e34550 service nova] Acquiring lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:03:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-93570756-2f4c-418b-9cbd-e2ae50d40ed7 req-6e2855dd-dbf6-417b-9cf3-effca8e34550 service nova] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:03:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-93570756-2f4c-418b-9cbd-e2ae50d40ed7 req-6e2855dd-dbf6-417b-9cf3-effca8e34550 service nova] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:03:40 user nova-compute[74996]: DEBUG nova.compute.manager [req-93570756-2f4c-418b-9cbd-e2ae50d40ed7 req-6e2855dd-dbf6-417b-9cf3-effca8e34550 service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] No waiting events found dispatching network-vif-unplugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:03:40 user nova-compute[74996]: DEBUG nova.compute.manager [req-93570756-2f4c-418b-9cbd-e2ae50d40ed7 req-6e2855dd-dbf6-417b-9cf3-effca8e34550 service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Received event network-vif-unplugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG nova.compute.manager [req-c88c1dd6-2fed-48a4-9b1d-3aaa496640b2 req-ecc91f7c-a817-47dd-ba3e-81f370019a86 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Received event network-vif-unplugged-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c88c1dd6-2fed-48a4-9b1d-3aaa496640b2 req-ecc91f7c-a817-47dd-ba3e-81f370019a86 service nova] Acquiring lock "4f56890c-d135-42a1-b862-7ac5f9076654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c88c1dd6-2fed-48a4-9b1d-3aaa496640b2 req-ecc91f7c-a817-47dd-ba3e-81f370019a86 service nova] Lock "4f56890c-d135-42a1-b862-7ac5f9076654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c88c1dd6-2fed-48a4-9b1d-3aaa496640b2 req-ecc91f7c-a817-47dd-ba3e-81f370019a86 service nova] Lock "4f56890c-d135-42a1-b862-7ac5f9076654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG nova.compute.manager [req-c88c1dd6-2fed-48a4-9b1d-3aaa496640b2 req-ecc91f7c-a817-47dd-ba3e-81f370019a86 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] No waiting events found dispatching network-vif-unplugged-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG nova.compute.manager [req-c88c1dd6-2fed-48a4-9b1d-3aaa496640b2 req-ecc91f7c-a817-47dd-ba3e-81f370019a86 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Received event network-vif-unplugged-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:41 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Instance destroyed successfully.
Nov 02 02:03:41 user nova-compute[74996]: DEBUG nova.objects.instance [None req-e2847ec9-59da-472f-ae27-00bf7860d0be tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lazy-loading 'resources' on Instance uuid 7c53e6cc-cf69-485d-b24f-5e113dae0e5d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:03:41 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Instance destroyed successfully.
Nov 02 02:03:41 user nova-compute[74996]: DEBUG nova.objects.instance [None req-d1778cac-1373-410f-bbf0-235a9785901d tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lazy-loading 'resources' on Instance uuid 4f56890c-d135-42a1-b862-7ac5f9076654 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-e2847ec9-59da-472f-ae27-00bf7860d0be tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:46:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1398759994',display_name='tempest-ServerRescueNegativeTestJSON-server-1398759994',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1398759994',id=32,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:48:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d89083c24ba475f9159a80fddfe9159',ramdisk_id='',reservation_id='r-5l3af2z9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1433266011',owner_user_name='tempest-ServerRescueNegativeTestJSON-1433266011-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:48:55Z,user_data=None,user_id='87e5cf8786fe44b5a5305f3be11d64c2',uuid=7c53e6cc-cf69-485d-b24f-5e113dae0e5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "address": "fa:16:3e:9b:c8:b7", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391c1ab0-6a", "ovs_interfaceid": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-e2847ec9-59da-472f-ae27-00bf7860d0be tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Converting VIF {"id": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "address": "fa:16:3e:9b:c8:b7", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391c1ab0-6a", "ovs_interfaceid": "391c1ab0-6a16-4d16-894f-a061aac3fc6a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-e2847ec9-59da-472f-ae27-00bf7860d0be tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:c8:b7,bridge_name='br-int',has_traffic_filtering=True,id=391c1ab0-6a16-4d16-894f-a061aac3fc6a,network=Network(81a443a7-0a10-4c81-9903-853291c58596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391c1ab0-6a') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG os_vif [None req-e2847ec9-59da-472f-ae27-00bf7860d0be tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:c8:b7,bridge_name='br-int',has_traffic_filtering=True,id=391c1ab0-6a16-4d16-894f-a061aac3fc6a,network=Network(81a443a7-0a10-4c81-9903-853291c58596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391c1ab0-6a') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap391c1ab0-6a, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-d1778cac-1373-410f-bbf0-235a9785901d tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1728348689',display_name='tempest-TestMinimumBasicScenario-server-1728348689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1728348689',id=42,image_ref='b6b6767e-ba8a-4dbd-aa21-d75b3d3ffd27',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH899TM/rBHcQE1n0n3iCloLlovOhyXsE7Y6f0ED7vrwer1ehja7sJDRxPgSKSJjSIaDq9WEKp13S7pOXfa5vGtZvBJ7xoD8MRo1oFT6Yoh8qcqYRhJ3CeJeY21s4N23CQ==',key_name='tempest-TestMinimumBasicScenario-320891136',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:58:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be09717763f448b5a5d1a1e5f62e289b',ramdisk_id='',reservation_id='r-mrxi90op',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6b6767e-ba8a-4dbd-aa21-d75b3d3ffd27',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1426618310',owner_user_name='tempest-TestMinimumBasicScenario-1426618310-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T02:00:53Z,user_data=None,user_id='e7d9a6e0ced84500aab9759d009f0a49',uuid=4f56890c-d135-42a1-b862-7ac5f9076654,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "address": "fa:16:3e:ef:c5:84", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78937d9b-19", "ovs_interfaceid": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-d1778cac-1373-410f-bbf0-235a9785901d tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Converting VIF {"id": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "address": "fa:16:3e:ef:c5:84", "network": {"id": "ab25d1c6-cd19-42dd-abe2-cb20978f06e0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1782008575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be09717763f448b5a5d1a1e5f62e289b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78937d9b-19", "ovs_interfaceid": "78937d9b-197e-4ff7-8e1c-c26daa12fcc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-d1778cac-1373-410f-bbf0-235a9785901d tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:c5:84,bridge_name='br-int',has_traffic_filtering=True,id=78937d9b-197e-4ff7-8e1c-c26daa12fcc8,network=Network(ab25d1c6-cd19-42dd-abe2-cb20978f06e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78937d9b-19') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG os_vif [None req-d1778cac-1373-410f-bbf0-235a9785901d tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:c5:84,bridge_name='br-int',has_traffic_filtering=True,id=78937d9b-197e-4ff7-8e1c-c26daa12fcc8,network=Network(ab25d1c6-cd19-42dd-abe2-cb20978f06e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78937d9b-19') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78937d9b-19, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8bb4d42b-c216-49ec-9a21-b3dc00353249) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0513ce59-5e8a-49e2-89aa-dd3ab3071d0a) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:41 user nova-compute[74996]: INFO os_vif [None req-e2847ec9-59da-472f-ae27-00bf7860d0be tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:c8:b7,bridge_name='br-int',has_traffic_filtering=True,id=391c1ab0-6a16-4d16-894f-a061aac3fc6a,network=Network(81a443a7-0a10-4c81-9903-853291c58596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391c1ab0-6a')
Nov 02 02:03:41 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-e2847ec9-59da-472f-ae27-00bf7860d0be tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Deleting instance files /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d_del
Nov 02 02:03:41 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-e2847ec9-59da-472f-ae27-00bf7860d0be tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Deletion of /opt/stack/data/nova/instances/7c53e6cc-cf69-485d-b24f-5e113dae0e5d_del complete
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:41 user nova-compute[74996]: INFO os_vif [None req-d1778cac-1373-410f-bbf0-235a9785901d tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:c5:84,bridge_name='br-int',has_traffic_filtering=True,id=78937d9b-197e-4ff7-8e1c-c26daa12fcc8,network=Network(ab25d1c6-cd19-42dd-abe2-cb20978f06e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78937d9b-19')
Nov 02 02:03:41 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-d1778cac-1373-410f-bbf0-235a9785901d tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Deleting instance files /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654_del
Nov 02 02:03:41 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-d1778cac-1373-410f-bbf0-235a9785901d tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Deletion of /opt/stack/data/nova/instances/4f56890c-d135-42a1-b862-7ac5f9076654_del complete
Nov 02 02:03:41 user nova-compute[74996]: INFO nova.compute.manager [None req-e2847ec9-59da-472f-ae27-00bf7860d0be tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 02 02:03:41 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-e2847ec9-59da-472f-ae27-00bf7860d0be tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:41 user nova-compute[74996]: INFO nova.compute.manager [None req-d1778cac-1373-410f-bbf0-235a9785901d tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 02 02:03:41 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-d1778cac-1373-410f-bbf0-235a9785901d tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 02:03:41 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 02:03:42 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:03:42 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Took 0.38 seconds to deallocate network for instance.
Nov 02 02:03:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e2847ec9-59da-472f-ae27-00bf7860d0be tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:03:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e2847ec9-59da-472f-ae27-00bf7860d0be tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:03:42 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:03:42 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Took 0.57 seconds to deallocate network for instance.
Nov 02 02:03:42 user nova-compute[74996]: DEBUG nova.compute.manager [req-dde0eb32-ebc6-47a2-9f25-eb735f4207fd req-b13d98fe-a605-4e83-8a92-48437334690e service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Received event network-vif-deleted-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:03:42 user nova-compute[74996]: INFO nova.compute.manager [req-dde0eb32-ebc6-47a2-9f25-eb735f4207fd req-b13d98fe-a605-4e83-8a92-48437334690e service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Neutron deleted interface 78937d9b-197e-4ff7-8e1c-c26daa12fcc8; detaching it from the instance and deleting it from the info cache
Nov 02 02:03:42 user nova-compute[74996]: DEBUG nova.network.neutron [req-dde0eb32-ebc6-47a2-9f25-eb735f4207fd req-b13d98fe-a605-4e83-8a92-48437334690e service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:03:42 user nova-compute[74996]: DEBUG nova.compute.manager [req-dde0eb32-ebc6-47a2-9f25-eb735f4207fd req-b13d98fe-a605-4e83-8a92-48437334690e service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Detach interface failed, port_id=78937d9b-197e-4ff7-8e1c-c26daa12fcc8, reason: Instance 4f56890c-d135-42a1-b862-7ac5f9076654 could not be found. {{(pid=74996) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 02:03:42 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-e2847ec9-59da-472f-ae27-00bf7860d0be tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:03:42 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-e2847ec9-59da-472f-ae27-00bf7860d0be tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:03:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d1778cac-1373-410f-bbf0-235a9785901d tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:03:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e2847ec9-59da-472f-ae27-00bf7860d0be tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.248s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:03:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d1778cac-1373-410f-bbf0-235a9785901d tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.026s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:03:42 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-e2847ec9-59da-472f-ae27-00bf7860d0be tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Deleted allocations for instance 7c53e6cc-cf69-485d-b24f-5e113dae0e5d
Nov 02 02:03:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-e2847ec9-59da-472f-ae27-00bf7860d0be tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.045s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:03:42 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d1778cac-1373-410f-bbf0-235a9785901d tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:03:42 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d1778cac-1373-410f-bbf0-235a9785901d tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:03:42 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:03:42 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:03:42 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:03:42 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:03:42 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 02:03:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d1778cac-1373-410f-bbf0-235a9785901d tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:03:42 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-d1778cac-1373-410f-bbf0-235a9785901d tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Deleted allocations for instance 4f56890c-d135-42a1-b862-7ac5f9076654
Nov 02 02:03:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d1778cac-1373-410f-bbf0-235a9785901d tempest-TestMinimumBasicScenario-1426618310 tempest-TestMinimumBasicScenario-1426618310-project-member] Lock "4f56890c-d135-42a1-b862-7ac5f9076654" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.320s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:03:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-7d420b2e-f1a9-4be8-b7fc-7cd73bf3b480 req-7ea9a955-a5d8-443a-952e-16f82914a5db service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Received event network-vif-plugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:03:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7d420b2e-f1a9-4be8-b7fc-7cd73bf3b480 req-7ea9a955-a5d8-443a-952e-16f82914a5db service nova] Acquiring lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:03:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7d420b2e-f1a9-4be8-b7fc-7cd73bf3b480 req-7ea9a955-a5d8-443a-952e-16f82914a5db service nova] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:03:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7d420b2e-f1a9-4be8-b7fc-7cd73bf3b480 req-7ea9a955-a5d8-443a-952e-16f82914a5db service nova] Lock "7c53e6cc-cf69-485d-b24f-5e113dae0e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:03:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-7d420b2e-f1a9-4be8-b7fc-7cd73bf3b480 req-7ea9a955-a5d8-443a-952e-16f82914a5db service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] No waiting events found dispatching network-vif-plugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:03:43 user nova-compute[74996]: WARNING nova.compute.manager [req-7d420b2e-f1a9-4be8-b7fc-7cd73bf3b480 req-7ea9a955-a5d8-443a-952e-16f82914a5db service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Received unexpected event network-vif-plugged-391c1ab0-6a16-4d16-894f-a061aac3fc6a for instance with vm_state deleted and task_state None.
Nov 02 02:03:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-7d420b2e-f1a9-4be8-b7fc-7cd73bf3b480 req-7ea9a955-a5d8-443a-952e-16f82914a5db service nova] [instance: 7c53e6cc-cf69-485d-b24f-5e113dae0e5d] Received event network-vif-deleted-391c1ab0-6a16-4d16-894f-a061aac3fc6a {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:03:43 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:03:43 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 02:03:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-50c235cc-f4f5-443f-b056-906393ccd512 req-d67916c9-0436-44b5-96fb-9b15b6fd5aa3 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Received event network-vif-plugged-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:03:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-50c235cc-f4f5-443f-b056-906393ccd512 req-d67916c9-0436-44b5-96fb-9b15b6fd5aa3 service nova] Acquiring lock "4f56890c-d135-42a1-b862-7ac5f9076654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:03:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-50c235cc-f4f5-443f-b056-906393ccd512 req-d67916c9-0436-44b5-96fb-9b15b6fd5aa3 service nova] Lock "4f56890c-d135-42a1-b862-7ac5f9076654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:03:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-50c235cc-f4f5-443f-b056-906393ccd512 req-d67916c9-0436-44b5-96fb-9b15b6fd5aa3 service nova] Lock "4f56890c-d135-42a1-b862-7ac5f9076654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:03:43 user nova-compute[74996]: DEBUG nova.compute.manager [req-50c235cc-f4f5-443f-b056-906393ccd512 req-d67916c9-0436-44b5-96fb-9b15b6fd5aa3 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] No waiting events found dispatching network-vif-plugged-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:03:43 user nova-compute[74996]: WARNING nova.compute.manager [req-50c235cc-f4f5-443f-b056-906393ccd512 req-d67916c9-0436-44b5-96fb-9b15b6fd5aa3 service nova] [instance: 4f56890c-d135-42a1-b862-7ac5f9076654] Received unexpected event network-vif-plugged-78937d9b-197e-4ff7-8e1c-c26daa12fcc8 for instance with vm_state deleted and task_state None.
Nov 02 02:03:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-17b25747-b89d-43f0-a28a-afcf40d35e70" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:03:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-17b25747-b89d-43f0-a28a-afcf40d35e70" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:03:43 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 02:03:43 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Updating instance_info_cache with network_info: [{"id": "dffb12c9-41c5-480c-bb0f-f2a3fab03b8c", "address": "fa:16:3e:9e:8e:1e", "network": {"id": "aea5e8b6-0fff-4614-b29c-d62929cce6ab", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1836711877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3ff0532d194b0c9181d9dde14227b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffb12c9-41", "ovs_interfaceid": "dffb12c9-41c5-480c-bb0f-f2a3fab03b8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:03:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-17b25747-b89d-43f0-a28a-afcf40d35e70" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:03:43 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 02:03:43 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:03:46 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:47 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:03:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:03:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:03:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:03:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:03:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:03:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:03:53 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 17b25747-b89d-43f0-a28a-afcf40d35e70 is timed out.
Nov 02 02:03:53 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Successfully detached device vdb from instance 17b25747-b89d-43f0-a28a-afcf40d35e70 from the live domain config.
Nov 02 02:03:53 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FoHcrMzZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:03:53 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:03:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84bb0e4-8197-4e5e-9a45-56ffec65d486]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 02:03:53 user nova-compute[74996]: No targets found.
Nov 02 02:03:53 user nova-compute[74996]: iSNS:
Nov 02 02:03:53 user nova-compute[74996]: No targets found.
Nov 02 02:03:53 user nova-compute[74996]: STATIC:
Nov 02 02:03:53 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842
Nov 02 02:03:53 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 02:03:53 user nova-compute[74996]:                 Iface Name: default
Nov 02 02:03:53 user nova-compute[74996]: FIRMWARE:
Nov 02 02:03:53 user nova-compute[74996]: No targets found.
Nov 02 02:03:53 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 02:03:53 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 02:03:53 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f9c26b-ec46-48cd-b416-020090aa808f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8155a169-0b14-4e69-b580-9d804e6ed2ac]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842 (non-flash)
Nov 02 02:03:53 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842 (non-flash)
Nov 02 02:03:53 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830c7b2f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842'): ({'sdb'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Removing single pathed devices sdb {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96b8ea2-a30b-45e6-9be6-55e3b2433a3a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb749525-2596-4379-97d8-29ee7a66f448]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Flushing IO for device /dev/sdb {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f88531b-e970-449c-9c91-bb2ee3bb5a7b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a6c052-f2c2-477d-8d11-cfd0dd1dddb4]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[535dee45-e625-44fe-9691-00f4e69ad23a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8301641-41fa-42d8-ba13-55d73da708eb]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842, portal: 172.16.0.220,3260]
Nov 02 02:03:53 user nova-compute[74996]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842, portal: 172.16.0.220,3260] successful.
Nov 02 02:03:53 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72f1cfc2-d623-4642-a4fc-389faf124842 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f7bf7d-ae50-48c7-8bc9-aac925bb2fb0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] <== disconnect_volume: return (292ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:03:53 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 02:03:54 user nova-compute[74996]: DEBUG nova.objects.instance [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lazy-loading 'flavor' on Instance uuid 17b25747-b89d-43f0-a28a-afcf40d35e70 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:03:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-763529ff-8b7d-4535-823c-fa4300049ed3 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.740s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:03:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:03:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:03:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:03:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:03:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:03:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:00 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:04:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:04:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:04:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:04:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:04:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:04:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:04:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:04:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:04:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:04:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:04:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:04:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:04:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:04:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:14 user nova-compute[74996]: DEBUG nova.compute.manager [req-8b8b745e-d59e-49ce-9dc3-64d5bdb29005 req-dd3f5d9b-6a3d-4e77-a523-23dec7dc43fa service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Received event network-changed-46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:04:14 user nova-compute[74996]: DEBUG nova.compute.manager [req-8b8b745e-d59e-49ce-9dc3-64d5bdb29005 req-dd3f5d9b-6a3d-4e77-a523-23dec7dc43fa service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Refreshing instance network info cache due to event network-changed-46cdee0a-7249-457f-b3d1-e69a6ed62504. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 02:04:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8b8b745e-d59e-49ce-9dc3-64d5bdb29005 req-dd3f5d9b-6a3d-4e77-a523-23dec7dc43fa service nova] Acquiring lock "refresh_cache-04bbae43-881f-455a-bcd2-c1be2e82f0dc" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:04:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8b8b745e-d59e-49ce-9dc3-64d5bdb29005 req-dd3f5d9b-6a3d-4e77-a523-23dec7dc43fa service nova] Acquired lock "refresh_cache-04bbae43-881f-455a-bcd2-c1be2e82f0dc" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:04:14 user nova-compute[74996]: DEBUG nova.network.neutron [req-8b8b745e-d59e-49ce-9dc3-64d5bdb29005 req-dd3f5d9b-6a3d-4e77-a523-23dec7dc43fa service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Refreshing network info cache for port 46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 02:04:15 user nova-compute[74996]: DEBUG nova.network.neutron [req-8b8b745e-d59e-49ce-9dc3-64d5bdb29005 req-dd3f5d9b-6a3d-4e77-a523-23dec7dc43fa service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Updated VIF entry in instance network info cache for port 46cdee0a-7249-457f-b3d1-e69a6ed62504. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 02:04:15 user nova-compute[74996]: DEBUG nova.network.neutron [req-8b8b745e-d59e-49ce-9dc3-64d5bdb29005 req-dd3f5d9b-6a3d-4e77-a523-23dec7dc43fa service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Updating instance_info_cache with network_info: [{"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:04:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8b8b745e-d59e-49ce-9dc3-64d5bdb29005 req-dd3f5d9b-6a3d-4e77-a523-23dec7dc43fa service nova] Releasing lock "refresh_cache-04bbae43-881f-455a-bcd2-c1be2e82f0dc" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:04:16 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:04:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:04:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:04:20 user nova-compute[74996]: DEBUG nova.objects.instance [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'flavor' on Instance uuid 04bbae43-881f-455a-bcd2-c1be2e82f0dc {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:04:20 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:04:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:04:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:04:21 user nova-compute[74996]: INFO nova.compute.manager [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Attaching volume d864c413-1bfb-4383-bc1a-8e5d8a5728db to /dev/vdb
Nov 02 02:04:21 user nova-compute[74996]: DEBUG os_brick.utils [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:04:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f37ef46-993d-4a8d-a0c1-40a3d11f8a75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45c1a28-dcec-447f-9088-326684dc5d26]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a490fbf3-8276-4d92-aeb0-30c73d9b169b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[99884268-4654-419f-be44-7e007f259927]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 02:04:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 02:04:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 02:04:21 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 02:04:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c457447-1c80-405a-8048-5b440ab4b2da]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 02:04:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 02:04:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 02:04:21 user nova-compute[74996]: DEBUG os_brick.utils [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:04:21 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Updating existing volume attachment record: 2218302f-b5de-4ba2-9f2d-e7ecabb888b0 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 02:04:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "17b25747-b89d-43f0-a28a-afcf40d35e70" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:04:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:04:28 user nova-compute[74996]: DEBUG nova.objects.instance [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lazy-loading 'flavor' on Instance uuid 17b25747-b89d-43f0-a28a-afcf40d35e70 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:04:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:04:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "17b25747-b89d-43f0-a28a-afcf40d35e70" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:04:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:04:29 user nova-compute[74996]: INFO nova.compute.manager [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Attaching volume 71cfe966-edb3-43d2-b513-077aa1f67ec2 to /dev/vdb
Nov 02 02:04:29 user nova-compute[74996]: DEBUG os_brick.utils [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:04:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c627543-89b3-4e2d-a33e-22f57c07bf96]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[33041a3f-6e23-40f7-a274-195b0b31ee3c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd000a1-884a-4e06-a3be-05c122ef6f68]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ec7f63-9c87-491b-b5d6-7a6b7a4a5685]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 02:04:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 02:04:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:29 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 02:04:29 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 02:04:29 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbc2312-531b-4871-9fe4-47381eb7c066]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 02:04:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 02:04:29 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 02:04:29 user nova-compute[74996]: DEBUG os_brick.utils [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:04:29 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Updating existing volume attachment record: 0dead3dd-00c2-417d-a8c7-6715ed6d8d8e {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 02:04:30 user nova-compute[74996]: DEBUG nova.compute.manager [req-e6b25b2a-b05a-4992-832b-6442d8787ba8 req-5e3ed02b-8413-425f-8a39-824443099dba service nova] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Received event network-changed-3c23df81-7b74-48b3-8f38-d458707b3e7d {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:04:30 user nova-compute[74996]: DEBUG nova.compute.manager [req-e6b25b2a-b05a-4992-832b-6442d8787ba8 req-5e3ed02b-8413-425f-8a39-824443099dba service nova] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Refreshing instance network info cache due to event network-changed-3c23df81-7b74-48b3-8f38-d458707b3e7d. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 02:04:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-e6b25b2a-b05a-4992-832b-6442d8787ba8 req-5e3ed02b-8413-425f-8a39-824443099dba service nova] Acquiring lock "refresh_cache-8e773f71-2d35-4daa-ae68-e1e7f4b9d94d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:04:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-e6b25b2a-b05a-4992-832b-6442d8787ba8 req-5e3ed02b-8413-425f-8a39-824443099dba service nova] Acquired lock "refresh_cache-8e773f71-2d35-4daa-ae68-e1e7f4b9d94d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:04:30 user nova-compute[74996]: DEBUG nova.network.neutron [req-e6b25b2a-b05a-4992-832b-6442d8787ba8 req-5e3ed02b-8413-425f-8a39-824443099dba service nova] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Refreshing network info cache for port 3c23df81-7b74-48b3-8f38-d458707b3e7d {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 02:04:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:04:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:04:30 user nova-compute[74996]: DEBUG nova.objects.instance [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lazy-loading 'flavor' on Instance uuid 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:04:30 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Ignoring supplied device name: /dev/vdb
Nov 02 02:04:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:04:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:04:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:04:30 user nova-compute[74996]: INFO nova.compute.manager [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Attaching volume 784ad61c-3447-483f-a3e0-a08fd6ee45f2 to /dev/vdb
Nov 02 02:04:30 user nova-compute[74996]: DEBUG os_brick.utils [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:04:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:30 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0de762f-9cfe-47d3-bd79-b3795ff3d8ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:30 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cec6f0-ddf0-428e-a1f6-7eaf32535515]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff866f1-13e0-461f-92b6-2375fd797bb5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ac2135-2b26-4a90-8237-ebcd7ee2db5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 02:04:31 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 02:04:31 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4915e8-f6e1-47fc-855c-3b9bc8ca96a6]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG os_brick.utils [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Updating existing volume attachment record: bdc17fc5-3eba-423a-bdeb-cfce6bc59308 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-48867195-68cd-4fa0-879a-bc857173a0e8 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "e38704a7-f8a0-482c-bd51-26a90d37b71d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-48867195-68cd-4fa0-879a-bc857173a0e8 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-48867195-68cd-4fa0-879a-bc857173a0e8 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-48867195-68cd-4fa0-879a-bc857173a0e8 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-48867195-68cd-4fa0-879a-bc857173a0e8 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:04:31 user nova-compute[74996]: INFO nova.compute.manager [None req-48867195-68cd-4fa0-879a-bc857173a0e8 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Terminating instance
Nov 02 02:04:31 user nova-compute[74996]: DEBUG nova.compute.manager [None req-48867195-68cd-4fa0-879a-bc857173a0e8 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG nova.network.neutron [req-e6b25b2a-b05a-4992-832b-6442d8787ba8 req-5e3ed02b-8413-425f-8a39-824443099dba service nova] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Updated VIF entry in instance network info cache for port 3c23df81-7b74-48b3-8f38-d458707b3e7d. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG nova.network.neutron [req-e6b25b2a-b05a-4992-832b-6442d8787ba8 req-5e3ed02b-8413-425f-8a39-824443099dba service nova] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Updating instance_info_cache with network_info: [{"id": "3c23df81-7b74-48b3-8f38-d458707b3e7d", "address": "fa:16:3e:39:1d:17", "network": {"id": "5d5d58ab-0d25-4d7e-b535-857923f4a7a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1163860226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "971ca9cd14604f619cc269252bdc0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c23df81-7b", "ovs_interfaceid": "3c23df81-7b74-48b3-8f38-d458707b3e7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-e6b25b2a-b05a-4992-832b-6442d8787ba8 req-5e3ed02b-8413-425f-8a39-824443099dba service nova] Releasing lock "refresh_cache-8e773f71-2d35-4daa-ae68-e1e7f4b9d94d" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG nova.compute.manager [req-58e6d300-2d84-488b-8819-b6fe80128167 req-b7af4587-eca3-4043-90b0-119a46d450cd service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received event network-vif-unplugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-58e6d300-2d84-488b-8819-b6fe80128167 req-b7af4587-eca3-4043-90b0-119a46d450cd service nova] Acquiring lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-58e6d300-2d84-488b-8819-b6fe80128167 req-b7af4587-eca3-4043-90b0-119a46d450cd service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-58e6d300-2d84-488b-8819-b6fe80128167 req-b7af4587-eca3-4043-90b0-119a46d450cd service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG nova.compute.manager [req-58e6d300-2d84-488b-8819-b6fe80128167 req-b7af4587-eca3-4043-90b0-119a46d450cd service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] No waiting events found dispatching network-vif-unplugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG nova.compute.manager [req-58e6d300-2d84-488b-8819-b6fe80128167 req-b7af4587-eca3-4043-90b0-119a46d450cd service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received event network-vif-unplugged-b5d6eb99-a00c-4440-98d6-6432b493f131 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 02:04:31 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Instance destroyed successfully.
Nov 02 02:04:31 user nova-compute[74996]: DEBUG nova.objects.instance [None req-48867195-68cd-4fa0-879a-bc857173a0e8 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lazy-loading 'resources' on Instance uuid e38704a7-f8a0-482c-bd51-26a90d37b71d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-48867195-68cd-4fa0-879a-bc857173a0e8 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:46:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1755702352',display_name='tempest-ServerRescueNegativeTestJSON-server-1755702352',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1755702352',id=31,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:51:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d89083c24ba475f9159a80fddfe9159',ramdisk_id='',reservation_id='r-oqxxr67v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1433266011',owner_user_name='tempest-ServerRescueNegativeTestJSON-1433266011-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:53:43Z,user_data=None,user_id='87e5cf8786fe44b5a5305f3be11d64c2',uuid=e38704a7-f8a0-482c-bd51-26a90d37b71d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5d6eb99-a00c-4440-98d6-6432b493f131", "address": "fa:16:3e:67:64:10", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d6eb99-a0", "ovs_interfaceid": "b5d6eb99-a00c-4440-98d6-6432b493f131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-48867195-68cd-4fa0-879a-bc857173a0e8 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Converting VIF {"id": "b5d6eb99-a00c-4440-98d6-6432b493f131", "address": "fa:16:3e:67:64:10", "network": {"id": "81a443a7-0a10-4c81-9903-853291c58596", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-288238423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d89083c24ba475f9159a80fddfe9159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d6eb99-a0", "ovs_interfaceid": "b5d6eb99-a00c-4440-98d6-6432b493f131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-48867195-68cd-4fa0-879a-bc857173a0e8 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:64:10,bridge_name='br-int',has_traffic_filtering=True,id=b5d6eb99-a00c-4440-98d6-6432b493f131,network=Network(81a443a7-0a10-4c81-9903-853291c58596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5d6eb99-a0') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG os_vif [None req-48867195-68cd-4fa0-879a-bc857173a0e8 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:64:10,bridge_name='br-int',has_traffic_filtering=True,id=b5d6eb99-a00c-4440-98d6-6432b493f131,network=Network(81a443a7-0a10-4c81-9903-853291c58596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5d6eb99-a0') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5d6eb99-a0, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60f507ca-da06-4e72-b3d2-6de62c3b06d6) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:31 user nova-compute[74996]: INFO os_vif [None req-48867195-68cd-4fa0-879a-bc857173a0e8 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:64:10,bridge_name='br-int',has_traffic_filtering=True,id=b5d6eb99-a00c-4440-98d6-6432b493f131,network=Network(81a443a7-0a10-4c81-9903-853291c58596),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5d6eb99-a0')
Nov 02 02:04:31 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-48867195-68cd-4fa0-879a-bc857173a0e8 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Deleting instance files /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d_del
Nov 02 02:04:31 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-48867195-68cd-4fa0-879a-bc857173a0e8 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Deletion of /opt/stack/data/nova/instances/e38704a7-f8a0-482c-bd51-26a90d37b71d_del complete
Nov 02 02:04:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:31 user nova-compute[74996]: INFO nova.compute.manager [None req-48867195-68cd-4fa0-879a-bc857173a0e8 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Took 0.79 seconds to destroy the instance on the hypervisor.
Nov 02 02:04:31 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-48867195-68cd-4fa0-879a-bc857173a0e8 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 02:04:31 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 02:04:32 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:04:32 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Took 0.79 seconds to deallocate network for instance.
Nov 02 02:04:32 user nova-compute[74996]: DEBUG nova.compute.manager [req-8e269846-1abc-47bd-9ee3-27505c750244 req-69cb4e3e-9250-4685-9cbb-cff1162dad2f service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received event network-vif-deleted-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:04:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-48867195-68cd-4fa0-879a-bc857173a0e8 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:04:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-48867195-68cd-4fa0-879a-bc857173a0e8 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:04:33 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-48867195-68cd-4fa0-879a-bc857173a0e8 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:04:33 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-48867195-68cd-4fa0-879a-bc857173a0e8 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:04:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-48867195-68cd-4fa0-879a-bc857173a0e8 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:04:33 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-48867195-68cd-4fa0-879a-bc857173a0e8 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Deleted allocations for instance e38704a7-f8a0-482c-bd51-26a90d37b71d
Nov 02 02:04:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-48867195-68cd-4fa0-879a-bc857173a0e8 tempest-ServerRescueNegativeTestJSON-1433266011 tempest-ServerRescueNegativeTestJSON-1433266011-project-member] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.107s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:04:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-4b67314d-2f08-424d-aeb4-b52e9f0dfcd8 req-e3802412-fb1f-4399-97f9-7b4ef2a8cae1 service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received event network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:04:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4b67314d-2f08-424d-aeb4-b52e9f0dfcd8 req-e3802412-fb1f-4399-97f9-7b4ef2a8cae1 service nova] Acquiring lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:04:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4b67314d-2f08-424d-aeb4-b52e9f0dfcd8 req-e3802412-fb1f-4399-97f9-7b4ef2a8cae1 service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:04:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4b67314d-2f08-424d-aeb4-b52e9f0dfcd8 req-e3802412-fb1f-4399-97f9-7b4ef2a8cae1 service nova] Lock "e38704a7-f8a0-482c-bd51-26a90d37b71d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:04:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-4b67314d-2f08-424d-aeb4-b52e9f0dfcd8 req-e3802412-fb1f-4399-97f9-7b4ef2a8cae1 service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] No waiting events found dispatching network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:04:33 user nova-compute[74996]: WARNING nova.compute.manager [req-4b67314d-2f08-424d-aeb4-b52e9f0dfcd8 req-e3802412-fb1f-4399-97f9-7b4ef2a8cae1 service nova] [instance: e38704a7-f8a0-482c-bd51-26a90d37b71d] Received unexpected event network-vif-plugged-b5d6eb99-a00c-4440-98d6-6432b493f131 for instance with vm_state deleted and task_state None.
Nov 02 02:04:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:34 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:04:35 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:04:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:04:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:04:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:04:35 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 02:04:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e773f71-2d35-4daa-ae68-e1e7f4b9d94d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e773f71-2d35-4daa-ae68-e1e7f4b9d94d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e773f71-2d35-4daa-ae68-e1e7f4b9d94d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e773f71-2d35-4daa-ae68-e1e7f4b9d94d/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:36 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:04:36 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:04:36 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8530MB free_disk=24.948894500732422GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 02:04:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:04:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:04:36 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 17b25747-b89d-43f0-a28a-afcf40d35e70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:04:36 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 04bbae43-881f-455a-bcd2-c1be2e82f0dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:04:36 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:04:36 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 02:04:36 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 02:04:37 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:04:37 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:04:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:37 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 02:04:37 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.322s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:04:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dmLOMViX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:04:41 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:04:41 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:04:41 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:04:41 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:04:41 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[949e20c6-9958-425a-877b-331381e0b1c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 02:04:41 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc25fa42-fb16-40db-a958-3fa3c9cb7ddf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db] added
Nov 02 02:04:41 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec2e0b1-1039-41c2-a0dd-cb923f945e59]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1928d785-c8fe-4f77-a0a5-56010f9bec76]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dmLOMViX {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dmLOMViX" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b30b5c-94f4-4cf5-805a-27357683afa1]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dmLOMViX'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b2b02e-30d0-44d4-83f1-d58f415c05f3]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb15598-cf7c-466d-b10c-d59d0e9cc7ea]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 02:04:41 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 02:04:41 user nova-compute[74996]:  {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:04:41 user nova-compute[74996]: WARNING os_brick.initiator.connectors.iscsi [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 02:04:41 user nova-compute[74996]: 
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc055d27-80b7-4fb4-a29c-c6f972b455bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db, portal: 172.16.0.220,3260]
Nov 02 02:04:41 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db, portal: 172.16.0.220,3260] successful.
Nov 02 02:04:41 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b319d23-8607-4ad5-b305-5ef6b7bd4b60]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2744370-f84a-456b-933d-8109e35f38c3]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)
Nov 02 02:04:41 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)
Nov 02 02:04:41 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0901fd51-b7a4-4663-923a-8e241f8606ee]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:41 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 02:04:42 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:04:42 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:04:42 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:04:42 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 02:04:42 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:04:42 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 02:04:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dmLOMViX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 02:04:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:04:42 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '26261386533383266', 'path': '/dev/sdb'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:04:42 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261386533383266', 'path': '/dev/sdb'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 02:04:42 user nova-compute[74996]: DEBUG nova.objects.instance [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'flavor' on Instance uuid 04bbae43-881f-455a-bcd2-c1be2e82f0dc {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:04:42 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 02:04:42 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:04:42 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 02:04:42 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:04:42 user nova-compute[74996]:   <serial>d864c413-1bfb-4383-bc1a-8e5d8a5728db</serial>
Nov 02 02:04:42 user nova-compute[74996]: </disk>
Nov 02 02:04:42 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 02:04:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:04:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:04:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] No VIF found with MAC fa:16:3e:73:2c:81, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 02:04:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-65a74a39-c0ba-470f-8dd9-29d021a05c62 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.765s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:04:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d15ba85c-f2a9-4c74-9181-d737924a5ced tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:04:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d15ba85c-f2a9-4c74-9181-d737924a5ced tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:04:44 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d15ba85c-f2a9-4c74-9181-d737924a5ced tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 02:04:44 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d15ba85c-f2a9-4c74-9181-d737924a5ced tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74996) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 02 02:04:44 user nova-compute[74996]: DEBUG nova.objects.instance [None req-d15ba85c-f2a9-4c74-9181-d737924a5ced tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'flavor' on Instance uuid 04bbae43-881f-455a-bcd2-c1be2e82f0dc {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:04:44 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:04:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:44 user nova-compute[74996]: DEBUG nova.compute.manager [req-7a138f9e-9a72-49cd-bcc0-747df8ad2f5f req-4751ca17-c86f-4fe9-9bfe-6e73248bc9ad service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Received event network-vif-unplugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:04:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7a138f9e-9a72-49cd-bcc0-747df8ad2f5f req-4751ca17-c86f-4fe9-9bfe-6e73248bc9ad service nova] Acquiring lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:04:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7a138f9e-9a72-49cd-bcc0-747df8ad2f5f req-4751ca17-c86f-4fe9-9bfe-6e73248bc9ad service nova] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:04:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7a138f9e-9a72-49cd-bcc0-747df8ad2f5f req-4751ca17-c86f-4fe9-9bfe-6e73248bc9ad service nova] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:04:44 user nova-compute[74996]: DEBUG nova.compute.manager [req-7a138f9e-9a72-49cd-bcc0-747df8ad2f5f req-4751ca17-c86f-4fe9-9bfe-6e73248bc9ad service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] No waiting events found dispatching network-vif-unplugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:04:44 user nova-compute[74996]: WARNING nova.compute.manager [req-7a138f9e-9a72-49cd-bcc0-747df8ad2f5f req-4751ca17-c86f-4fe9-9bfe-6e73248bc9ad service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Received unexpected event network-vif-unplugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 for instance with vm_state active and task_state powering-off.
Nov 02 02:04:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:44 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Instance destroyed successfully.
Nov 02 02:04:44 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d15ba85c-f2a9-4c74-9181-d737924a5ced tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 02:04:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d15ba85c-f2a9-4c74-9181-d737924a5ced tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.872s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:04:45 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:04:45 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 02:04:45 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Didn't find any instances for network info cache update. {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 02:04:46 user nova-compute[74996]: DEBUG nova.compute.manager [req-0bab14b8-c4f0-4cda-83ae-716da4abde1f req-48a8ad0d-9315-4577-a648-e5653a3794fc service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Received event network-vif-plugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:04:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0bab14b8-c4f0-4cda-83ae-716da4abde1f req-48a8ad0d-9315-4577-a648-e5653a3794fc service nova] Acquiring lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:04:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0bab14b8-c4f0-4cda-83ae-716da4abde1f req-48a8ad0d-9315-4577-a648-e5653a3794fc service nova] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:04:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0bab14b8-c4f0-4cda-83ae-716da4abde1f req-48a8ad0d-9315-4577-a648-e5653a3794fc service nova] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:04:46 user nova-compute[74996]: DEBUG nova.compute.manager [req-0bab14b8-c4f0-4cda-83ae-716da4abde1f req-48a8ad0d-9315-4577-a648-e5653a3794fc service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] No waiting events found dispatching network-vif-plugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:04:46 user nova-compute[74996]: WARNING nova.compute.manager [req-0bab14b8-c4f0-4cda-83ae-716da4abde1f req-48a8ad0d-9315-4577-a648-e5653a3794fc service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Received unexpected event network-vif-plugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 for instance with vm_state stopped and task_state None.
Nov 02 02:04:46 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:47 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:04:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QZRazhvK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:04:49 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:04:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:04:49 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:04:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:04:49 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9044aae9-6ee7-49a5-b86d-fd249d428acf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 02:04:49 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2faef8-8929-4ce5-a3a8-233783c985e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2] added
Nov 02 02:04:49 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd64fc5-0e1b-4121-93ff-e424876fd78f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4838f837-32cc-4a9c-8e8e-8ce64bff87eb]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QZRazhvK {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QZRazhvK" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96db3e8-6699-40cd-8733-0e4546cd7c0f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QZRazhvK'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[770e663e-11d9-4657-a4f7-e553242ad9fb]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9424de83-5662-4909-b7fb-8a0dd7abbda7]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)
Nov 02 02:04:49 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)
Nov 02 02:04:49 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d525f6-7a98-4f4e-9637-bd2c62d89d13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2, portal: 172.16.0.220,3260]
Nov 02 02:04:49 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2, portal: 172.16.0.220,3260] successful.
Nov 02 02:04:49 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ef97db-84cd-429a-b87a-1797d08c994a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[90170d6d-8d28-4416-8e47-5263f529bc98]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)
Nov 02 02:04:49 user nova-compute[74996]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 (non-flash)
Nov 02 02:04:49 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)
Nov 02 02:04:49 user nova-compute[74996]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 (non-flash)
Nov 02 02:04:49 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d68136c-1076-4935-b437-ec8df89e58d9]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 02:04:49 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QZRazhvK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 02:04:50 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:04:50 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '26430373634326665', 'path': '/dev/sdc'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:04:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430373634326665', 'path': '/dev/sdc'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 02:04:50 user nova-compute[74996]: DEBUG nova.objects.instance [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lazy-loading 'flavor' on Instance uuid 17b25747-b89d-43f0-a28a-afcf40d35e70 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:04:50 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 02:04:50 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:04:50 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 02:04:50 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:04:50 user nova-compute[74996]:   <serial>71cfe966-edb3-43d2-b513-077aa1f67ec2</serial>
Nov 02 02:04:50 user nova-compute[74996]: </disk>
Nov 02 02:04:50 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JmpNdeBC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:04:51 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:04:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:04:51 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:04:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:04:51 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cc4516-c981-4e75-a89d-922f5a2911bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 02:04:51 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fea2d3a-097d-48bd-b145-ddb25bac460a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2] added
Nov 02 02:04:51 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a98d67-fcad-4c05-a032-cc29dfb1b4f4]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd19dff3-377c-4363-81e9-2d4a11562bee]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JmpNdeBC {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JmpNdeBC" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6597f9f-a16f-427b-aa31-f8b82fbad323]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JmpNdeBC'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8c742b-7379-4b26-8686-19aa183dd090]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a143da18-b6c9-4231-b030-4e9801a8f89c]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)
Nov 02 02:04:51 user nova-compute[74996]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 (non-flash)
Nov 02 02:04:51 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)
Nov 02 02:04:51 user nova-compute[74996]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 (non-flash)
Nov 02 02:04:51 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] No VIF found with MAC fa:16:3e:9e:8e:1e, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cb698c-5db0-4c1a-9259-478a8ee4cc42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2, portal: 172.16.0.220,3260]
Nov 02 02:04:51 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2, portal: 172.16.0.220,3260] successful.
Nov 02 02:04:51 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a285c0f-0f57-4612-a87c-0d366cb33465]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3469f56-6b2d-4f89-8fc3-cb164e7f645a]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)
Nov 02 02:04:51 user nova-compute[74996]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 (non-flash)
Nov 02 02:04:51 user nova-compute[74996]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 (non-flash)
Nov 02 02:04:51 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)
Nov 02 02:04:51 user nova-compute[74996]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 (non-flash)
Nov 02 02:04:51 user nova-compute[74996]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 (non-flash)
Nov 02 02:04:51 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[81847d8f-6987-44af-9949-a47287db8306]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JmpNdeBC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-400aedc1-15b8-418c-a6b8-773cb46804db tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.335s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:04:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:52 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:04:52 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23661316165636362', 'path': '/dev/sdd'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:04:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661316165636362', 'path': '/dev/sdd'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 02:04:52 user nova-compute[74996]: DEBUG nova.objects.instance [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lazy-loading 'flavor' on Instance uuid 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:04:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 02:04:52 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:04:52 user nova-compute[74996]:   <source dev="/dev/sdd"/>
Nov 02 02:04:52 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:04:52 user nova-compute[74996]:   <serial>784ad61c-3447-483f-a3e0-a08fd6ee45f2</serial>
Nov 02 02:04:52 user nova-compute[74996]: </disk>
Nov 02 02:04:52 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 02:04:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:04:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:04:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] No VIF found with MAC fa:16:3e:39:1d:17, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 02:04:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-9215848d-484a-4cbe-b887-027b6651518a tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.148s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:04:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:04:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "17b25747-b89d-43f0-a28a-afcf40d35e70" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:04:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:04:54 user nova-compute[74996]: INFO nova.compute.manager [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Detaching volume 71cfe966-edb3-43d2-b513-077aa1f67ec2
Nov 02 02:04:54 user nova-compute[74996]: INFO nova.virt.block_device [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Attempting to driver detach volume 71cfe966-edb3-43d2-b513-077aa1f67ec2 from mountpoint /dev/vdb
Nov 02 02:04:54 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Attempting to detach device vdb from instance 17b25747-b89d-43f0-a28a-afcf40d35e70 from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 02:04:54 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 02:04:54 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:04:54 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 02:04:54 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:04:54 user nova-compute[74996]:   <serial>71cfe966-edb3-43d2-b513-077aa1f67ec2</serial>
Nov 02 02:04:54 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 02:04:54 user nova-compute[74996]: </disk>
Nov 02 02:04:54 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 02:04:54 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Successfully detached device vdb from instance 17b25747-b89d-43f0-a28a-afcf40d35e70 from the persistent domain config.
Nov 02 02:04:54 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 17b25747-b89d-43f0-a28a-afcf40d35e70 from the live domain config. {{(pid=74996) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 02:04:54 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 02:04:54 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:04:54 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 02:04:54 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:04:54 user nova-compute[74996]:   <serial>71cfe966-edb3-43d2-b513-077aa1f67ec2</serial>
Nov 02 02:04:54 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 02:04:54 user nova-compute[74996]: </disk>
Nov 02 02:04:54 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 02:04:54 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 17b25747-b89d-43f0-a28a-afcf40d35e70 {{(pid=74996) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 02:04:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:01 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:05:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:05:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:05:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:05:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:05:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:05:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:05:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Verify base images {{(pid=74996) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 02 02:05:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Image id f544db05-269f-4ce2-a9db-e2f89ecf2dd8 yields fingerprint d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 {{(pid=74996) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 02 02:05:01 user nova-compute[74996]: INFO nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] image f544db05-269f-4ce2-a9db-e2f89ecf2dd8 at (/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8): checking
Nov 02 02:05:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] image f544db05-269f-4ce2-a9db-e2f89ecf2dd8 at (/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8): image is in use {{(pid=74996) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 02 02:05:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74996) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 02 02:05:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] 04bbae43-881f-455a-bcd2-c1be2e82f0dc is a valid instance name {{(pid=74996) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 02 02:05:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] 04bbae43-881f-455a-bcd2-c1be2e82f0dc has a disk file {{(pid=74996) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 02 02:05:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:05:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 04bbae43-881f-455a-bcd2-c1be2e82f0dc is backed by d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 {{(pid=74996) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 02 02:05:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d is a valid instance name {{(pid=74996) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 02 02:05:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d has a disk file {{(pid=74996) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 02 02:05:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e773f71-2d35-4daa-ae68-e1e7f4b9d94d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e773f71-2d35-4daa-ae68-e1e7f4b9d94d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:05:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d is backed by d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 {{(pid=74996) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 02 02:05:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] 17b25747-b89d-43f0-a28a-afcf40d35e70 is a valid instance name {{(pid=74996) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 02 02:05:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] 17b25747-b89d-43f0-a28a-afcf40d35e70 has a disk file {{(pid=74996) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 02 02:05:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:05:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 17b25747-b89d-43f0-a28a-afcf40d35e70 is backed by d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 {{(pid=74996) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 02 02:05:01 user nova-compute[74996]: WARNING nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5b278b65f8330a198d52bbd1f0602d7780f0e90d
Nov 02 02:05:01 user nova-compute[74996]: WARNING nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/44a9a1f7b3dc70ce8ec5563589cc5ebee7e6a690
Nov 02 02:05:01 user nova-compute[74996]: WARNING nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/133907414d1cd507ae1d146bf8ab715819c37cfc
Nov 02 02:05:01 user nova-compute[74996]: WARNING nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/70e5486255d0a2eca2d4ae726d067be83d3f6a58
Nov 02 02:05:01 user nova-compute[74996]: WARNING nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/26666f56e17f51b88dab0cd41224b323e1307080
Nov 02 02:05:01 user nova-compute[74996]: WARNING nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3d032a2ff47563bbe3779f90684970680f864932
Nov 02 02:05:01 user nova-compute[74996]: WARNING nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/69ec96197ba9723fd3445b24df2ed1658bfc0275
Nov 02 02:05:01 user nova-compute[74996]: INFO nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Active base files: /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8
Nov 02 02:05:01 user nova-compute[74996]: INFO nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Removable base files: /opt/stack/data/nova/instances/_base/5b278b65f8330a198d52bbd1f0602d7780f0e90d /opt/stack/data/nova/instances/_base/44a9a1f7b3dc70ce8ec5563589cc5ebee7e6a690 /opt/stack/data/nova/instances/_base/133907414d1cd507ae1d146bf8ab715819c37cfc /opt/stack/data/nova/instances/_base/70e5486255d0a2eca2d4ae726d067be83d3f6a58 /opt/stack/data/nova/instances/_base/26666f56e17f51b88dab0cd41224b323e1307080 /opt/stack/data/nova/instances/_base/3d032a2ff47563bbe3779f90684970680f864932 /opt/stack/data/nova/instances/_base/69ec96197ba9723fd3445b24df2ed1658bfc0275
Nov 02 02:05:01 user nova-compute[74996]: INFO nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5b278b65f8330a198d52bbd1f0602d7780f0e90d
Nov 02 02:05:01 user nova-compute[74996]: INFO nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/44a9a1f7b3dc70ce8ec5563589cc5ebee7e6a690
Nov 02 02:05:01 user nova-compute[74996]: INFO nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/133907414d1cd507ae1d146bf8ab715819c37cfc
Nov 02 02:05:01 user nova-compute[74996]: INFO nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/70e5486255d0a2eca2d4ae726d067be83d3f6a58
Nov 02 02:05:01 user nova-compute[74996]: INFO nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/26666f56e17f51b88dab0cd41224b323e1307080
Nov 02 02:05:01 user nova-compute[74996]: INFO nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3d032a2ff47563bbe3779f90684970680f864932
Nov 02 02:05:01 user nova-compute[74996]: INFO nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/69ec96197ba9723fd3445b24df2ed1658bfc0275
Nov 02 02:05:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Verification complete {{(pid=74996) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 02 02:05:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Verify swap images {{(pid=74996) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 02 02:05:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.imagecache [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Verify ephemeral images {{(pid=74996) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 02 02:05:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:05:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:05:14 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 17b25747-b89d-43f0-a28a-afcf40d35e70 is timed out.
Nov 02 02:05:14 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Successfully detached device vdb from instance 17b25747-b89d-43f0-a28a-afcf40d35e70 from the live domain config.
Nov 02 02:05:14 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QZRazhvK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:05:14 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:05:14 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e39c02-573e-40e4-be6f-c2168ccff80e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 02:05:14 user nova-compute[74996]: No targets found.
Nov 02 02:05:14 user nova-compute[74996]: iSNS:
Nov 02 02:05:14 user nova-compute[74996]: No targets found.
Nov 02 02:05:14 user nova-compute[74996]: STATIC:
Nov 02 02:05:14 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2
Nov 02 02:05:14 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 02:05:14 user nova-compute[74996]:                 Iface Name: default
Nov 02 02:05:14 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db
Nov 02 02:05:14 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 02:05:14 user nova-compute[74996]:                 Iface Name: default
Nov 02 02:05:14 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2
Nov 02 02:05:14 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 02:05:14 user nova-compute[74996]:                 Iface Name: default
Nov 02 02:05:14 user nova-compute[74996]: FIRMWARE:
Nov 02 02:05:14 user nova-compute[74996]: No targets found.
Nov 02 02:05:14 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 02:05:14 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 02:05:14 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2107e3-645f-4bc2-b73b-cfa16922c394]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5e6f69-1fa4-4c00-80bd-04c384494ecf]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)
Nov 02 02:05:14 user nova-compute[74996]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 (non-flash)
Nov 02 02:05:14 user nova-compute[74996]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 (non-flash)
Nov 02 02:05:14 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)
Nov 02 02:05:14 user nova-compute[74996]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 (non-flash)
Nov 02 02:05:14 user nova-compute[74996]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 (non-flash)
Nov 02 02:05:14 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830c7b2050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2'): ({'sdc'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Removing single pathed devices sdc {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c299d4c-a560-4a09-ab5b-42fc4d329994]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[324c53c0-99f9-4923-8212-dfa414664aa7]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Flushing IO for device /dev/sdc {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[816cbf71-d05e-4f5d-983a-c3801d091d20]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbe2199-c6bf-404d-8ade-88c89088e505]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[802fa8ef-5cee-4e72-a5ce-1ac98825a0c4]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ec5d1d-666f-4b32-be91-4facd89a3ff1]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2, portal: 172.16.0.220,3260]
Nov 02 02:05:14 user nova-compute[74996]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2, portal: 172.16.0.220,3260] successful.
Nov 02 02:05:14 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cfe966-edb3-43d2-b513-077aa1f67ec2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e87542-b115-4ddc-8b9f-87a30dad8abc]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] <== disconnect_volume: return (274ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:05:14 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 02:05:15 user nova-compute[74996]: DEBUG nova.objects.instance [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lazy-loading 'flavor' on Instance uuid 17b25747-b89d-43f0-a28a-afcf40d35e70 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:05:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-f13be1ac-816b-4cb4-935e-c663d72ad52c tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.797s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:05:16 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:05:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:05:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Acquiring lock "f4dbbf62-95bd-47e7-bbf1-16e143746a45" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:05:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "f4dbbf62-95bd-47e7-bbf1-16e143746a45" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:05:32 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 02:05:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:05:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:05:32 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 02:05:32 user nova-compute[74996]: INFO nova.compute.claims [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Claim successful on node user
Nov 02 02:05:32 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:05:32 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:05:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.316s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:05:33 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 02:05:33 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 02:05:33 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 02:05:33 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 02:05:33 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 02:05:33 user nova-compute[74996]: DEBUG nova.policy [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd189b000f4cd4c9cb835abd85b9180f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c4de34aca164d5abbff0ff11b44762b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 02:05:33 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 02:05:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 02:05:33 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Creating image(s)
Nov 02 02:05:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:05:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "/opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:05:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "/opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:05:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.180s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:05:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:05:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:05:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.182s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:05:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk 1073741824" returned: 0 in 0.056s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:05:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:05:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:33 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Successfully created port: 4728343d-18b1-4199-a165-e0e8aa414f2b {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 02:05:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.191s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:05:33 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 02:05:33 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Cannot resize image /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Ensure instance console log exists: /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Successfully updated port: 4728343d-18b1-4199-a165-e0e8aa414f2b {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Acquiring lock "refresh_cache-f4dbbf62-95bd-47e7-bbf1-16e143746a45" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Acquired lock "refresh_cache-f4dbbf62-95bd-47e7-bbf1-16e143746a45" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.compute.manager [req-9982abbe-f7da-4527-a048-9a7e05773f43 req-b0ae0b87-469d-457e-94a3-61388e97255c service nova] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Received event network-changed-4728343d-18b1-4199-a165-e0e8aa414f2b {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.compute.manager [req-9982abbe-f7da-4527-a048-9a7e05773f43 req-b0ae0b87-469d-457e-94a3-61388e97255c service nova] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Refreshing instance network info cache due to event network-changed-4728343d-18b1-4199-a165-e0e8aa414f2b. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9982abbe-f7da-4527-a048-9a7e05773f43 req-b0ae0b87-469d-457e-94a3-61388e97255c service nova] Acquiring lock "refresh_cache-f4dbbf62-95bd-47e7-bbf1-16e143746a45" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.network.neutron [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Updating instance_info_cache with network_info: [{"id": "4728343d-18b1-4199-a165-e0e8aa414f2b", "address": "fa:16:3e:3f:81:e4", "network": {"id": "76ec976d-a10a-4c58-8b3c-7db507c2bcd5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1016707767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c4de34aca164d5abbff0ff11b44762b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4728343d-18", "ovs_interfaceid": "4728343d-18b1-4199-a165-e0e8aa414f2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Releasing lock "refresh_cache-f4dbbf62-95bd-47e7-bbf1-16e143746a45" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Instance network_info: |[{"id": "4728343d-18b1-4199-a165-e0e8aa414f2b", "address": "fa:16:3e:3f:81:e4", "network": {"id": "76ec976d-a10a-4c58-8b3c-7db507c2bcd5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1016707767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c4de34aca164d5abbff0ff11b44762b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4728343d-18", "ovs_interfaceid": "4728343d-18b1-4199-a165-e0e8aa414f2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9982abbe-f7da-4527-a048-9a7e05773f43 req-b0ae0b87-469d-457e-94a3-61388e97255c service nova] Acquired lock "refresh_cache-f4dbbf62-95bd-47e7-bbf1-16e143746a45" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.network.neutron [req-9982abbe-f7da-4527-a048-9a7e05773f43 req-b0ae0b87-469d-457e-94a3-61388e97255c service nova] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Refreshing network info cache for port 4728343d-18b1-4199-a165-e0e8aa414f2b {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Start _get_guest_xml network_info=[{"id": "4728343d-18b1-4199-a165-e0e8aa414f2b", "address": "fa:16:3e:3f:81:e4", "network": {"id": "76ec976d-a10a-4c58-8b3c-7db507c2bcd5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1016707767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c4de34aca164d5abbff0ff11b44762b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4728343d-18", "ovs_interfaceid": "4728343d-18b1-4199-a165-e0e8aa414f2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 02:05:34 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:05:34 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:05:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-963081613',display_name='tempest-ServersNegativeTestJSON-server-963081613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-963081613',id=46,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c4de34aca164d5abbff0ff11b44762b',ramdisk_id='',reservation_id='r-frctbyrs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-235429949',owner_user_name='tempest-ServersNegativeTestJSON-235429949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T02:05:33Z,user_data=None,user_id='d189b000f4cd4c9cb835abd85b9180f1',uuid=f4dbbf62-95bd-47e7-bbf1-16e143746a45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4728343d-18b1-4199-a165-e0e8aa414f2b", "address": "fa:16:3e:3f:81:e4", "network": {"id": "76ec976d-a10a-4c58-8b3c-7db507c2bcd5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1016707767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c4de34aca164d5abbff0ff11b44762b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4728343d-18", "ovs_interfaceid": "4728343d-18b1-4199-a165-e0e8aa414f2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Converting VIF {"id": "4728343d-18b1-4199-a165-e0e8aa414f2b", "address": "fa:16:3e:3f:81:e4", "network": {"id": "76ec976d-a10a-4c58-8b3c-7db507c2bcd5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1016707767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c4de34aca164d5abbff0ff11b44762b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4728343d-18", "ovs_interfaceid": "4728343d-18b1-4199-a165-e0e8aa414f2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:81:e4,bridge_name='br-int',has_traffic_filtering=True,id=4728343d-18b1-4199-a165-e0e8aa414f2b,network=Network(76ec976d-a10a-4c58-8b3c-7db507c2bcd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4728343d-18') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.objects.instance [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lazy-loading 'pci_devices' on Instance uuid f4dbbf62-95bd-47e7-bbf1-16e143746a45 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] End _get_guest_xml xml=<domain type="kvm">
Nov 02 02:05:34 user nova-compute[74996]:   <uuid>f4dbbf62-95bd-47e7-bbf1-16e143746a45</uuid>
Nov 02 02:05:34 user nova-compute[74996]:   <name>instance-0000002e</name>
Nov 02 02:05:34 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 02:05:34 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 02:05:34 user nova-compute[74996]:   <metadata>
Nov 02 02:05:34 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 02:05:34 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 02:05:34 user nova-compute[74996]:       <nova:name>tempest-ServersNegativeTestJSON-server-963081613</nova:name>
Nov 02 02:05:34 user nova-compute[74996]:       <nova:creationTime>2023-11-02 02:05:34</nova:creationTime>
Nov 02 02:05:34 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 02:05:34 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 02:05:34 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 02:05:34 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 02:05:34 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 02:05:34 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 02:05:34 user nova-compute[74996]:       </nova:flavor>
Nov 02 02:05:34 user nova-compute[74996]:       <nova:owner>
Nov 02 02:05:34 user nova-compute[74996]:         <nova:user uuid="d189b000f4cd4c9cb835abd85b9180f1">tempest-ServersNegativeTestJSON-235429949-project-member</nova:user>
Nov 02 02:05:34 user nova-compute[74996]:         <nova:project uuid="2c4de34aca164d5abbff0ff11b44762b">tempest-ServersNegativeTestJSON-235429949</nova:project>
Nov 02 02:05:34 user nova-compute[74996]:       </nova:owner>
Nov 02 02:05:34 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 02:05:34 user nova-compute[74996]:       <nova:ports>
Nov 02 02:05:34 user nova-compute[74996]:         <nova:port uuid="4728343d-18b1-4199-a165-e0e8aa414f2b">
Nov 02 02:05:34 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 02 02:05:34 user nova-compute[74996]:         </nova:port>
Nov 02 02:05:34 user nova-compute[74996]:       </nova:ports>
Nov 02 02:05:34 user nova-compute[74996]:     </nova:instance>
Nov 02 02:05:34 user nova-compute[74996]:   </metadata>
Nov 02 02:05:34 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 02:05:34 user nova-compute[74996]:     <system>
Nov 02 02:05:34 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 02:05:34 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 02:05:34 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 02:05:34 user nova-compute[74996]:       <entry name="serial">f4dbbf62-95bd-47e7-bbf1-16e143746a45</entry>
Nov 02 02:05:34 user nova-compute[74996]:       <entry name="uuid">f4dbbf62-95bd-47e7-bbf1-16e143746a45</entry>
Nov 02 02:05:34 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 02:05:34 user nova-compute[74996]:     </system>
Nov 02 02:05:34 user nova-compute[74996]:   </sysinfo>
Nov 02 02:05:34 user nova-compute[74996]:   <os>
Nov 02 02:05:34 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 02:05:34 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 02:05:34 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 02:05:34 user nova-compute[74996]:   </os>
Nov 02 02:05:34 user nova-compute[74996]:   <features>
Nov 02 02:05:34 user nova-compute[74996]:     <acpi/>
Nov 02 02:05:34 user nova-compute[74996]:     <apic/>
Nov 02 02:05:34 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 02:05:34 user nova-compute[74996]:   </features>
Nov 02 02:05:34 user nova-compute[74996]:   <clock offset="utc">
Nov 02 02:05:34 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 02:05:34 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 02:05:34 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 02:05:34 user nova-compute[74996]:   </clock>
Nov 02 02:05:34 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 02:05:34 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 02:05:34 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 02:05:34 user nova-compute[74996]:   </cpu>
Nov 02 02:05:34 user nova-compute[74996]:   <devices>
Nov 02 02:05:34 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 02:05:34 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 02:05:34 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk"/>
Nov 02 02:05:34 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 02:05:34 user nova-compute[74996]:     </disk>
Nov 02 02:05:34 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 02:05:34 user nova-compute[74996]:       <mac address="fa:16:3e:3f:81:e4"/>
Nov 02 02:05:34 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 02:05:34 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 02:05:34 user nova-compute[74996]:       <target dev="tap4728343d-18"/>
Nov 02 02:05:34 user nova-compute[74996]:     </interface>
Nov 02 02:05:34 user nova-compute[74996]:     <serial type="pty">
Nov 02 02:05:34 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/console.log" append="off"/>
Nov 02 02:05:34 user nova-compute[74996]:     </serial>
Nov 02 02:05:34 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 02:05:34 user nova-compute[74996]:     <video>
Nov 02 02:05:34 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 02:05:34 user nova-compute[74996]:     </video>
Nov 02 02:05:34 user nova-compute[74996]:     <rng model="virtio">
Nov 02 02:05:34 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 02:05:34 user nova-compute[74996]:     </rng>
Nov 02 02:05:34 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 02:05:34 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 02:05:34 user nova-compute[74996]:       <stats period="10"/>
Nov 02 02:05:34 user nova-compute[74996]:     </memballoon>
Nov 02 02:05:34 user nova-compute[74996]:   </devices>
Nov 02 02:05:34 user nova-compute[74996]: </domain>
Nov 02 02:05:34 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:05:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-963081613',display_name='tempest-ServersNegativeTestJSON-server-963081613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-963081613',id=46,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c4de34aca164d5abbff0ff11b44762b',ramdisk_id='',reservation_id='r-frctbyrs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-235429949',owner_user_name='tempest-ServersNegativeTestJSON-235429949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T02:05:33Z,user_data=None,user_id='d189b000f4cd4c9cb835abd85b9180f1',uuid=f4dbbf62-95bd-47e7-bbf1-16e143746a45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4728343d-18b1-4199-a165-e0e8aa414f2b", "address": "fa:16:3e:3f:81:e4", "network": {"id": "76ec976d-a10a-4c58-8b3c-7db507c2bcd5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1016707767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c4de34aca164d5abbff0ff11b44762b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4728343d-18", "ovs_interfaceid": "4728343d-18b1-4199-a165-e0e8aa414f2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Converting VIF {"id": "4728343d-18b1-4199-a165-e0e8aa414f2b", "address": "fa:16:3e:3f:81:e4", "network": {"id": "76ec976d-a10a-4c58-8b3c-7db507c2bcd5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1016707767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c4de34aca164d5abbff0ff11b44762b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4728343d-18", "ovs_interfaceid": "4728343d-18b1-4199-a165-e0e8aa414f2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:81:e4,bridge_name='br-int',has_traffic_filtering=True,id=4728343d-18b1-4199-a165-e0e8aa414f2b,network=Network(76ec976d-a10a-4c58-8b3c-7db507c2bcd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4728343d-18') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG os_vif [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:81:e4,bridge_name='br-int',has_traffic_filtering=True,id=4728343d-18b1-4199-a165-e0e8aa414f2b,network=Network(76ec976d-a10a-4c58-8b3c-7db507c2bcd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4728343d-18') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0d35f2f0-47c1-5a1b-8693-a7d4b246c44f', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4728343d-18, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4728343d-18, col_values=(('qos', UUID('2f71950d-760d-4e6e-bc2e-0b0b53d37d89')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4728343d-18, col_values=(('external_ids', {'iface-id': '4728343d-18b1-4199-a165-e0e8aa414f2b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:81:e4', 'vm-uuid': 'f4dbbf62-95bd-47e7-bbf1-16e143746a45'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:05:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:34 user nova-compute[74996]: INFO os_vif [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:81:e4,bridge_name='br-int',has_traffic_filtering=True,id=4728343d-18b1-4199-a165-e0e8aa414f2b,network=Network(76ec976d-a10a-4c58-8b3c-7db507c2bcd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4728343d-18')
Nov 02 02:05:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:05:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] No VIF found with MAC fa:16:3e:3f:81:e4, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 02:05:35 user nova-compute[74996]: DEBUG nova.network.neutron [req-9982abbe-f7da-4527-a048-9a7e05773f43 req-b0ae0b87-469d-457e-94a3-61388e97255c service nova] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Updated VIF entry in instance network info cache for port 4728343d-18b1-4199-a165-e0e8aa414f2b. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 02:05:35 user nova-compute[74996]: DEBUG nova.network.neutron [req-9982abbe-f7da-4527-a048-9a7e05773f43 req-b0ae0b87-469d-457e-94a3-61388e97255c service nova] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Updating instance_info_cache with network_info: [{"id": "4728343d-18b1-4199-a165-e0e8aa414f2b", "address": "fa:16:3e:3f:81:e4", "network": {"id": "76ec976d-a10a-4c58-8b3c-7db507c2bcd5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1016707767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c4de34aca164d5abbff0ff11b44762b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4728343d-18", "ovs_interfaceid": "4728343d-18b1-4199-a165-e0e8aa414f2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:05:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9982abbe-f7da-4527-a048-9a7e05773f43 req-b0ae0b87-469d-457e-94a3-61388e97255c service nova] Releasing lock "refresh_cache-f4dbbf62-95bd-47e7-bbf1-16e143746a45" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:05:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-9c6bd88f-a696-420b-b647-3ec0e18f37df req-8f484908-9981-48f2-947c-bc3384f08f49 service nova] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Received event network-vif-plugged-4728343d-18b1-4199-a165-e0e8aa414f2b {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:05:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9c6bd88f-a696-420b-b647-3ec0e18f37df req-8f484908-9981-48f2-947c-bc3384f08f49 service nova] Acquiring lock "f4dbbf62-95bd-47e7-bbf1-16e143746a45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:05:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9c6bd88f-a696-420b-b647-3ec0e18f37df req-8f484908-9981-48f2-947c-bc3384f08f49 service nova] Lock "f4dbbf62-95bd-47e7-bbf1-16e143746a45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:05:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9c6bd88f-a696-420b-b647-3ec0e18f37df req-8f484908-9981-48f2-947c-bc3384f08f49 service nova] Lock "f4dbbf62-95bd-47e7-bbf1-16e143746a45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:05:36 user nova-compute[74996]: DEBUG nova.compute.manager [req-9c6bd88f-a696-420b-b647-3ec0e18f37df req-8f484908-9981-48f2-947c-bc3384f08f49 service nova] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] No waiting events found dispatching network-vif-plugged-4728343d-18b1-4199-a165-e0e8aa414f2b {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:05:36 user nova-compute[74996]: WARNING nova.compute.manager [req-9c6bd88f-a696-420b-b647-3ec0e18f37df req-8f484908-9981-48f2-947c-bc3384f08f49 service nova] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Received unexpected event network-vif-plugged-4728343d-18b1-4199-a165-e0e8aa414f2b for instance with vm_state building and task_state spawning.
Nov 02 02:05:36 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:05:36 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:05:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:05:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:05:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:05:36 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 02:05:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:05:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:05:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 02:05:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:05:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:05:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:05:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:05:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e773f71-2d35-4daa-ae68-e1e7f4b9d94d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e773f71-2d35-4daa-ae68-e1e7f4b9d94d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:05:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e773f71-2d35-4daa-ae68-e1e7f4b9d94d/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e773f71-2d35-4daa-ae68-e1e7f4b9d94d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:05:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 02:05:38 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 02:05:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 02:05:38 user nova-compute[74996]: DEBUG nova.compute.manager [req-7ca7243b-8149-40cd-8327-b77221c185a1 req-7c2eb076-05d2-4266-9fe7-f609ec00f268 service nova] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Received event network-vif-plugged-4728343d-18b1-4199-a165-e0e8aa414f2b {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:05:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7ca7243b-8149-40cd-8327-b77221c185a1 req-7c2eb076-05d2-4266-9fe7-f609ec00f268 service nova] Acquiring lock "f4dbbf62-95bd-47e7-bbf1-16e143746a45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:05:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7ca7243b-8149-40cd-8327-b77221c185a1 req-7c2eb076-05d2-4266-9fe7-f609ec00f268 service nova] Lock "f4dbbf62-95bd-47e7-bbf1-16e143746a45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:05:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7ca7243b-8149-40cd-8327-b77221c185a1 req-7c2eb076-05d2-4266-9fe7-f609ec00f268 service nova] Lock "f4dbbf62-95bd-47e7-bbf1-16e143746a45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:05:38 user nova-compute[74996]: DEBUG nova.compute.manager [req-7ca7243b-8149-40cd-8327-b77221c185a1 req-7c2eb076-05d2-4266-9fe7-f609ec00f268 service nova] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] No waiting events found dispatching network-vif-plugged-4728343d-18b1-4199-a165-e0e8aa414f2b {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:05:38 user nova-compute[74996]: WARNING nova.compute.manager [req-7ca7243b-8149-40cd-8327-b77221c185a1 req-7c2eb076-05d2-4266-9fe7-f609ec00f268 service nova] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Received unexpected event network-vif-plugged-4728343d-18b1-4199-a165-e0e8aa414f2b for instance with vm_state building and task_state spawning.
Nov 02 02:05:38 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Instance spawned successfully.
Nov 02 02:05:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 02:05:38 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:05:38 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:05:38 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8629MB free_disk=24.945724487304688GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 02:05:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:05:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:05:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:05:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:05:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:05:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:05:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:05:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:05:38 user nova-compute[74996]: INFO nova.compute.manager [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Took 5.70 seconds to spawn the instance on the hypervisor.
Nov 02 02:05:38 user nova-compute[74996]: DEBUG nova.compute.manager [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 02:05:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:38 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 17b25747-b89d-43f0-a28a-afcf40d35e70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:05:38 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 04bbae43-881f-455a-bcd2-c1be2e82f0dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:05:38 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:05:38 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance f4dbbf62-95bd-47e7-bbf1-16e143746a45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:05:38 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 02:05:38 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 02:05:39 user nova-compute[74996]: INFO nova.compute.manager [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Took 6.35 seconds to build instance.
Nov 02 02:05:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7e871602-451c-47ca-ae46-6c171416ce79 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "f4dbbf62-95bd-47e7-bbf1-16e143746a45" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.454s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:05:39 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:05:39 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:05:39 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 02:05:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.388s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:05:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:42 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:05:42 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:05:42 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:05:42 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 02:05:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:44 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:05:44 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:05:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:45 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:05:45 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 02:05:45 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Rebuilding the list of instances to heal {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 02:05:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-17b25747-b89d-43f0-a28a-afcf40d35e70" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:05:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-17b25747-b89d-43f0-a28a-afcf40d35e70" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:05:45 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 02:05:45 user nova-compute[74996]: DEBUG nova.objects.instance [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lazy-loading 'info_cache' on Instance uuid 17b25747-b89d-43f0-a28a-afcf40d35e70 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:05:45 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Updating instance_info_cache with network_info: [{"id": "dffb12c9-41c5-480c-bb0f-f2a3fab03b8c", "address": "fa:16:3e:9e:8e:1e", "network": {"id": "aea5e8b6-0fff-4614-b29c-d62929cce6ab", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1836711877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3ff0532d194b0c9181d9dde14227b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffb12c9-41", "ovs_interfaceid": "dffb12c9-41c5-480c-bb0f-f2a3fab03b8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:05:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-17b25747-b89d-43f0-a28a-afcf40d35e70" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:05:45 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 02:05:45 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:05:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:05:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:05:46 user nova-compute[74996]: INFO nova.compute.manager [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Detaching volume 784ad61c-3447-483f-a3e0-a08fd6ee45f2
Nov 02 02:05:46 user nova-compute[74996]: INFO nova.virt.block_device [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Attempting to driver detach volume 784ad61c-3447-483f-a3e0-a08fd6ee45f2 from mountpoint /dev/vdb
Nov 02 02:05:46 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Attempting to detach device vdb from instance 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 02:05:46 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 02:05:46 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:05:46 user nova-compute[74996]:   <source dev="/dev/sdd"/>
Nov 02 02:05:46 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:05:46 user nova-compute[74996]:   <serial>784ad61c-3447-483f-a3e0-a08fd6ee45f2</serial>
Nov 02 02:05:46 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 02:05:46 user nova-compute[74996]: </disk>
Nov 02 02:05:46 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 02:05:46 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Successfully detached device vdb from instance 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d from the persistent domain config.
Nov 02 02:05:46 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d from the live domain config. {{(pid=74996) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 02:05:46 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 02:05:46 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:05:46 user nova-compute[74996]:   <source dev="/dev/sdd"/>
Nov 02 02:05:46 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:05:46 user nova-compute[74996]:   <serial>784ad61c-3447-483f-a3e0-a08fd6ee45f2</serial>
Nov 02 02:05:46 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 02:05:46 user nova-compute[74996]: </disk>
Nov 02 02:05:46 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 02:05:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:05:46 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d {{(pid=74996) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 02:05:47 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:05:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "17b25747-b89d-43f0-a28a-afcf40d35e70" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:05:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:05:50 user nova-compute[74996]: DEBUG nova.objects.instance [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lazy-loading 'flavor' on Instance uuid 17b25747-b89d-43f0-a28a-afcf40d35e70 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:05:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:05:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "17b25747-b89d-43f0-a28a-afcf40d35e70" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:05:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:05:50 user nova-compute[74996]: INFO nova.compute.manager [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Attaching volume cf5bdca9-64f6-425d-9b95-651c8dde243d to /dev/vdb
Nov 02 02:05:50 user nova-compute[74996]: DEBUG os_brick.utils [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:05:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:05:50 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3928fb7-2428-42e9-b8ac-9198a759a682]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:05:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:05:50 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[426c3bed-fada-4e6a-8dc8-6b7278005a33]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:05:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:05:50 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcffd82a-03a7-4a2b-97ed-045c02aee1a0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:05:50 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5631123b-e38f-4fd2-8ef9-45d3b92add1d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:05:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 02:05:50 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 02:05:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:05:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 02:05:50 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 02:05:50 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[963dc710-6b33-411d-979c-faf9ba6e35ac]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:05:50 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 02:05:50 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 02:05:50 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 02:05:50 user nova-compute[74996]: DEBUG os_brick.utils [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:05:50 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Updating existing volume attachment record: 655843b6-3385-404c-9f70-aa606a3d293c {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 02:05:52 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:05:52 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Cleaning up deleted instances {{(pid=74996) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 02:05:52 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] There are 0 instances to clean {{(pid=74996) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 02:05:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:55 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:05:57 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:05:57 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74996) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 02:05:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:04 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:06:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:06 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d is timed out.
Nov 02 02:06:06 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Successfully detached device vdb from instance 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d from the live domain config.
Nov 02 02:06:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JmpNdeBC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:06:06 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:06:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a36b0cb-0f6b-4448-bb4c-80e5d9946a12]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 02:06:06 user nova-compute[74996]: No targets found.
Nov 02 02:06:06 user nova-compute[74996]: iSNS:
Nov 02 02:06:06 user nova-compute[74996]: No targets found.
Nov 02 02:06:06 user nova-compute[74996]: STATIC:
Nov 02 02:06:06 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2
Nov 02 02:06:06 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 02:06:06 user nova-compute[74996]:                 Iface Name: default
Nov 02 02:06:06 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db
Nov 02 02:06:06 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 02:06:06 user nova-compute[74996]:                 Iface Name: default
Nov 02 02:06:06 user nova-compute[74996]: FIRMWARE:
Nov 02 02:06:06 user nova-compute[74996]: No targets found.
Nov 02 02:06:06 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 02:06:06 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 02:06:06 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1a68fd-0ee8-4f2f-8b64-c8d5cca65e8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[58815fd5-e236-42ff-a5d1-cd69c7a8dd90]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)
Nov 02 02:06:06 user nova-compute[74996]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 (non-flash)
Nov 02 02:06:06 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)
Nov 02 02:06:06 user nova-compute[74996]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 (non-flash)
Nov 02 02:06:06 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f83141c0dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2'): ({'sdd'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Removing single pathed devices sdd {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[94830597-e1ee-4dd9-83d8-b7f48704bf72]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1433c922-a1e5-4e0f-88e2-673d61fd7447]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Flushing IO for device /dev/sdd {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a7e7f4-edf6-4c3b-a468-2299135dc042]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99599e4-3115-430c-b9fe-0fe3d595f340]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] SCSI volumes sdd have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[827aaced-7562-4de9-a66e-900602543cdf]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5731705-bc7c-4683-9753-56a4266336b6]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2, portal: 172.16.0.220,3260]
Nov 02 02:06:06 user nova-compute[74996]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2, portal: 172.16.0.220,3260] successful.
Nov 02 02:06:06 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab26d2f-6e8e-4c01-8a49-3d9f0cc1f845]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] <== disconnect_volume: return (312ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:06:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 02:06:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:10 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:10 user nova-compute[74996]: DEBUG nova.objects.instance [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lazy-loading 'flavor' on Instance uuid 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:06:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8114abe0-895b-4849-ab45-3224208c3d50 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.776s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:06:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 24.597s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:06:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:06:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:06:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:06:10 user nova-compute[74996]: INFO nova.compute.manager [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Terminating instance
Nov 02 02:06:10 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 02:06:10 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 02:06:10 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gLhjkKJI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:06:10 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:06:10 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:06:10 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:06:10 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:06:10 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:06:10 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:06:10 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 02:06:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:10 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1a99a2-6476-4a2d-bc58-e463697d916d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:10 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 02:06:10 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:06:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:10 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade8f2cf-e700-4d78-9bda-98e86ab7b7ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:10 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d] added
Nov 02 02:06:10 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[625a0d53-1822-41ea-9e07-4970a6a1294b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49b4919-0e18-4c42-941f-38a784e25000]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gLhjkKJI {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gLhjkKJI" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1000ede6-b586-4c7b-8f88-e72a4b52deca]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gLhjkKJI'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4f55ea-850c-4f52-bb4c-c4a97c077026]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[315ba282-4c09-43f1-b034-c347e3bcbf14]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)
Nov 02 02:06:11 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)
Nov 02 02:06:11 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[767b0bc5-b73c-4570-9d74-f4f9640bd856]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d, portal: 172.16.0.220,3260]
Nov 02 02:06:11 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d, portal: 172.16.0.220,3260] successful.
Nov 02 02:06:11 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9306a6-7c2e-4288-949e-27ef36cf9ac8]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebed1b42-7f25-4514-835b-9d7af5ca9926]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)
Nov 02 02:06:11 user nova-compute[74996]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d (non-flash)
Nov 02 02:06:11 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)
Nov 02 02:06:11 user nova-compute[74996]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d (non-flash)
Nov 02 02:06:11 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG nova.compute.manager [req-8f4003e0-890f-4937-bed8-f773b8a47a73 req-c0aeea65-f9b9-4ced-adcd-e995a32f6152 service nova] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Received event network-vif-unplugged-3c23df81-7b74-48b3-8f38-d458707b3e7d {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8f4003e0-890f-4937-bed8-f773b8a47a73 req-c0aeea65-f9b9-4ced-adcd-e995a32f6152 service nova] Acquiring lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8f4003e0-890f-4937-bed8-f773b8a47a73 req-c0aeea65-f9b9-4ced-adcd-e995a32f6152 service nova] Lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8f4003e0-890f-4937-bed8-f773b8a47a73 req-c0aeea65-f9b9-4ced-adcd-e995a32f6152 service nova] Lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG nova.compute.manager [req-8f4003e0-890f-4937-bed8-f773b8a47a73 req-c0aeea65-f9b9-4ced-adcd-e995a32f6152 service nova] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] No waiting events found dispatching network-vif-unplugged-3c23df81-7b74-48b3-8f38-d458707b3e7d {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG nova.compute.manager [req-8f4003e0-890f-4937-bed8-f773b8a47a73 req-c0aeea65-f9b9-4ced-adcd-e995a32f6152 service nova] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Received event network-vif-unplugged-3c23df81-7b74-48b3-8f38-d458707b3e7d for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[888b8602-36d0-4c9b-9ccc-7c42490dc85d]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gLhjkKJI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 02:06:11 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Instance destroyed successfully.
Nov 02 02:06:11 user nova-compute[74996]: DEBUG nova.objects.instance [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lazy-loading 'resources' on Instance uuid 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:02:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-910655328',display_name='tempest-VolumesSnapshotTestJSON-instance-910655328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-910655328',id=45,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZS/+1qUmQXcFQlvNoicPEBbgGCJ2Q392vsjnWjUn5B3t7q0M2eRNzdYFqZHNtZARt8tarE2ggKT9xybU063ujYA5fo4cvce0QNlbXg45VDldzox5KVqKU3hs5cLYwxrA==',key_name='tempest-keypair-650627317',keypairs=<?>,launch_index=0,launched_at=2023-11-02T02:02:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='971ca9cd14604f619cc269252bdc0983',ramdisk_id='',reservation_id='r-ncsekunm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1059088146',owner_user_name='tempest-VolumesSnapshotTestJSON-1059088146-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T02:02:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a32baeba9e0491392e9bd9475b1dddd',uuid=8e773f71-2d35-4daa-ae68-e1e7f4b9d94d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c23df81-7b74-48b3-8f38-d458707b3e7d", "address": "fa:16:3e:39:1d:17", "network": {"id": "5d5d58ab-0d25-4d7e-b535-857923f4a7a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1163860226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "971ca9cd14604f619cc269252bdc0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c23df81-7b", "ovs_interfaceid": "3c23df81-7b74-48b3-8f38-d458707b3e7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Converting VIF {"id": "3c23df81-7b74-48b3-8f38-d458707b3e7d", "address": "fa:16:3e:39:1d:17", "network": {"id": "5d5d58ab-0d25-4d7e-b535-857923f4a7a8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1163860226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "971ca9cd14604f619cc269252bdc0983", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c23df81-7b", "ovs_interfaceid": "3c23df81-7b74-48b3-8f38-d458707b3e7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:1d:17,bridge_name='br-int',has_traffic_filtering=True,id=3c23df81-7b74-48b3-8f38-d458707b3e7d,network=Network(5d5d58ab-0d25-4d7e-b535-857923f4a7a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c23df81-7b') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG os_vif [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:1d:17,bridge_name='br-int',has_traffic_filtering=True,id=3c23df81-7b74-48b3-8f38-d458707b3e7d,network=Network(5d5d58ab-0d25-4d7e-b535-857923f4a7a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c23df81-7b') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c23df81-7b, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b6c2e43-f789-4968-88ed-fbd27806b40b) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:11 user nova-compute[74996]: INFO os_vif [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:1d:17,bridge_name='br-int',has_traffic_filtering=True,id=3c23df81-7b74-48b3-8f38-d458707b3e7d,network=Network(5d5d58ab-0d25-4d7e-b535-857923f4a7a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c23df81-7b')
Nov 02 02:06:11 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 02:06:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JmpNdeBC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:06:11 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:06:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23566393136653262', 'path': '/dev/sdc'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566393136653262', 'path': '/dev/sdc'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.502s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG nova.objects.instance [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lazy-loading 'flavor' on Instance uuid 17b25747-b89d-43f0-a28a-afcf40d35e70 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2f4e9b-8d4a-4d30-acb3-dbe07df59610]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 02:06:12 user nova-compute[74996]: No targets found.
Nov 02 02:06:12 user nova-compute[74996]: iSNS:
Nov 02 02:06:12 user nova-compute[74996]: No targets found.
Nov 02 02:06:12 user nova-compute[74996]: STATIC:
Nov 02 02:06:12 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d
Nov 02 02:06:12 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 02:06:12 user nova-compute[74996]:                 Iface Name: default
Nov 02 02:06:12 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db
Nov 02 02:06:12 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 02:06:12 user nova-compute[74996]:                 Iface Name: default
Nov 02 02:06:12 user nova-compute[74996]: FIRMWARE:
Nov 02 02:06:12 user nova-compute[74996]: No targets found.
Nov 02 02:06:12 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 02:06:12 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 02:06:12 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:784ad61c-3447-483f-a3e0-a08fd6ee45f2', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 02:06:12 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:06:12 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 02:06:12 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:06:12 user nova-compute[74996]:   <serial>cf5bdca9-64f6-425d-9b95-651c8dde243d</serial>
Nov 02 02:06:12 user nova-compute[74996]: </disk>
Nov 02 02:06:12 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a8cec6-dec2-4954-93d1-a9287125266f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f907743e-54ff-4035-a2f8-34569a245c25]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)
Nov 02 02:06:12 user nova-compute[74996]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d (non-flash)
Nov 02 02:06:12 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)
Nov 02 02:06:12 user nova-compute[74996]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d (non-flash)
Nov 02 02:06:12 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830c406680>, {}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Disconnecting from: [] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.067s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] <== disconnect_volume: return (569ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 02:06:12 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Deleting instance files /opt/stack/data/nova/instances/8e773f71-2d35-4daa-ae68-e1e7f4b9d94d_del
Nov 02 02:06:12 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Deletion of /opt/stack/data/nova/instances/8e773f71-2d35-4daa-ae68-e1e7f4b9d94d_del complete
Nov 02 02:06:12 user nova-compute[74996]: INFO nova.compute.manager [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Took 1.44 seconds to destroy the instance on the hypervisor.
Nov 02 02:06:12 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] No VIF found with MAC fa:16:3e:9e:8e:1e, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 02:06:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1a9768b6-110b-4cd8-b50b-f3bbbd6d4fc0 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.314s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:06:13 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:06:13 user nova-compute[74996]: DEBUG nova.compute.manager [req-ccf6988d-4955-4743-a757-852ffdbc4aa2 req-0a935d5a-e1b4-4267-9352-0cbab82b70c6 service nova] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Received event network-vif-deleted-3c23df81-7b74-48b3-8f38-d458707b3e7d {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:06:13 user nova-compute[74996]: INFO nova.compute.manager [req-ccf6988d-4955-4743-a757-852ffdbc4aa2 req-0a935d5a-e1b4-4267-9352-0cbab82b70c6 service nova] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Neutron deleted interface 3c23df81-7b74-48b3-8f38-d458707b3e7d; detaching it from the instance and deleting it from the info cache
Nov 02 02:06:13 user nova-compute[74996]: DEBUG nova.network.neutron [req-ccf6988d-4955-4743-a757-852ffdbc4aa2 req-0a935d5a-e1b4-4267-9352-0cbab82b70c6 service nova] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:06:13 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Took 0.72 seconds to deallocate network for instance.
Nov 02 02:06:13 user nova-compute[74996]: DEBUG nova.compute.manager [req-ccf6988d-4955-4743-a757-852ffdbc4aa2 req-0a935d5a-e1b4-4267-9352-0cbab82b70c6 service nova] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Detach interface failed, port_id=3c23df81-7b74-48b3-8f38-d458707b3e7d, reason: Instance 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d could not be found. {{(pid=74996) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 02:06:13 user nova-compute[74996]: WARNING nova.volume.cinder [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Attachment bdc17fc5-3eba-423a-bdeb-cfce6bc59308 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = bdc17fc5-3eba-423a-bdeb-cfce6bc59308. (HTTP 404) (Request-ID: req-8a7607fd-0377-4090-b235-787e618d8aad)
Nov 02 02:06:13 user nova-compute[74996]: INFO nova.compute.manager [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Took 0.03 seconds to detach 1 volumes for instance.
Nov 02 02:06:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:06:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:06:13 user nova-compute[74996]: DEBUG nova.compute.manager [req-9d90854b-46c3-48f8-b86c-55f70171b83e req-ef13a2af-320c-44cb-95f2-089b54d0b9ca service nova] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Received event network-vif-plugged-3c23df81-7b74-48b3-8f38-d458707b3e7d {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:06:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9d90854b-46c3-48f8-b86c-55f70171b83e req-ef13a2af-320c-44cb-95f2-089b54d0b9ca service nova] Acquiring lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:06:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9d90854b-46c3-48f8-b86c-55f70171b83e req-ef13a2af-320c-44cb-95f2-089b54d0b9ca service nova] Lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:06:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9d90854b-46c3-48f8-b86c-55f70171b83e req-ef13a2af-320c-44cb-95f2-089b54d0b9ca service nova] Lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:06:13 user nova-compute[74996]: DEBUG nova.compute.manager [req-9d90854b-46c3-48f8-b86c-55f70171b83e req-ef13a2af-320c-44cb-95f2-089b54d0b9ca service nova] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] No waiting events found dispatching network-vif-plugged-3c23df81-7b74-48b3-8f38-d458707b3e7d {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:06:13 user nova-compute[74996]: WARNING nova.compute.manager [req-9d90854b-46c3-48f8-b86c-55f70171b83e req-ef13a2af-320c-44cb-95f2-089b54d0b9ca service nova] [instance: 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d] Received unexpected event network-vif-plugged-3c23df81-7b74-48b3-8f38-d458707b3e7d for instance with vm_state deleted and task_state None.
Nov 02 02:06:13 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:06:13 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:06:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:06:13 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Deleted allocations for instance 8e773f71-2d35-4daa-ae68-e1e7f4b9d94d
Nov 02 02:06:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1a80c723-5440-49b0-a262-9eb871e01921 tempest-VolumesSnapshotTestJSON-1059088146 tempest-VolumesSnapshotTestJSON-1059088146-project-member] Lock "8e773f71-2d35-4daa-ae68-e1e7f4b9d94d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.643s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:06:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "17b25747-b89d-43f0-a28a-afcf40d35e70" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:06:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:06:14 user nova-compute[74996]: INFO nova.compute.manager [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Detaching volume cf5bdca9-64f6-425d-9b95-651c8dde243d
Nov 02 02:06:14 user nova-compute[74996]: INFO nova.virt.block_device [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Attempting to driver detach volume cf5bdca9-64f6-425d-9b95-651c8dde243d from mountpoint /dev/vdb
Nov 02 02:06:14 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Attempting to detach device vdb from instance 17b25747-b89d-43f0-a28a-afcf40d35e70 from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 02:06:14 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 02:06:14 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:06:14 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 02:06:14 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:06:14 user nova-compute[74996]:   <serial>cf5bdca9-64f6-425d-9b95-651c8dde243d</serial>
Nov 02 02:06:14 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 02:06:14 user nova-compute[74996]: </disk>
Nov 02 02:06:14 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 02:06:14 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Successfully detached device vdb from instance 17b25747-b89d-43f0-a28a-afcf40d35e70 from the persistent domain config.
Nov 02 02:06:14 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 17b25747-b89d-43f0-a28a-afcf40d35e70 from the live domain config. {{(pid=74996) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 02:06:14 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 02:06:14 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:06:14 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 02:06:14 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:06:14 user nova-compute[74996]:   <serial>cf5bdca9-64f6-425d-9b95-651c8dde243d</serial>
Nov 02 02:06:14 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 02:06:14 user nova-compute[74996]: </disk>
Nov 02 02:06:14 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 02:06:15 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 17b25747-b89d-43f0-a28a-afcf40d35e70 {{(pid=74996) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 02:06:16 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:23 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:06:23 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid 17b25747-b89d-43f0-a28a-afcf40d35e70 {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 02:06:23 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid 04bbae43-881f-455a-bcd2-c1be2e82f0dc {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 02:06:23 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid f4dbbf62-95bd-47e7-bbf1-16e143746a45 {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 02:06:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "17b25747-b89d-43f0-a28a-afcf40d35e70" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:06:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:06:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:06:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "f4dbbf62-95bd-47e7-bbf1-16e143746a45" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:06:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "f4dbbf62-95bd-47e7-bbf1-16e143746a45" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:06:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:06:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "f4dbbf62-95bd-47e7-bbf1-16e143746a45" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:06:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:06:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:06:34 user nova-compute[74996]: DEBUG nova.objects.instance [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'flavor' on Instance uuid 04bbae43-881f-455a-bcd2-c1be2e82f0dc {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:06:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "refresh_cache-04bbae43-881f-455a-bcd2-c1be2e82f0dc" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:06:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquired lock "refresh_cache-04bbae43-881f-455a-bcd2-c1be2e82f0dc" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:06:34 user nova-compute[74996]: DEBUG nova.network.neutron [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 02:06:34 user nova-compute[74996]: DEBUG nova.objects.instance [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'info_cache' on Instance uuid 04bbae43-881f-455a-bcd2-c1be2e82f0dc {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.objects.base [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Object Instance<04bbae43-881f-455a-bcd2-c1be2e82f0dc> lazy-loaded attributes: flavor,info_cache {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 02:06:35 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 17b25747-b89d-43f0-a28a-afcf40d35e70 is timed out.
Nov 02 02:06:35 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Successfully detached device vdb from instance 17b25747-b89d-43f0-a28a-afcf40d35e70 from the live domain config.
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gLhjkKJI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:06:35 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd3de47-d688-442e-88ab-efc2751a5423]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 02:06:35 user nova-compute[74996]: No targets found.
Nov 02 02:06:35 user nova-compute[74996]: iSNS:
Nov 02 02:06:35 user nova-compute[74996]: No targets found.
Nov 02 02:06:35 user nova-compute[74996]: STATIC:
Nov 02 02:06:35 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d
Nov 02 02:06:35 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 02:06:35 user nova-compute[74996]:                 Iface Name: default
Nov 02 02:06:35 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db
Nov 02 02:06:35 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 02:06:35 user nova-compute[74996]:                 Iface Name: default
Nov 02 02:06:35 user nova-compute[74996]: FIRMWARE:
Nov 02 02:06:35 user nova-compute[74996]: No targets found.
Nov 02 02:06:35 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 02:06:35 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 02:06:35 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[62385083-4f0a-426b-b848-cb32cb152f06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe925ad-3f5b-4052-a905-0d3ac040ef4b]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)
Nov 02 02:06:35 user nova-compute[74996]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d (non-flash)
Nov 02 02:06:35 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)
Nov 02 02:06:35 user nova-compute[74996]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d (non-flash)
Nov 02 02:06:35 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830c7b28c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d'): ({'sdc'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Removing single pathed devices sdc {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42f7f61-fc6e-4197-b846-1d2ad833da15]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f9646b-f99c-47ff-934b-52f1341276b7]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Flushing IO for device /dev/sdc {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e44767e-e9d4-4896-aca9-9641bf080b9f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[faee133c-d746-4e36-908d-452ad7481654]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.network.neutron [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Updating instance_info_cache with network_info: [{"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57eb70d-ce76-46ba-b7fa-2b5e85ee57d6]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Releasing lock "refresh_cache-04bbae43-881f-455a-bcd2-c1be2e82f0dc" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:06:35 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Instance destroyed successfully.
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.objects.instance [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'resources' on Instance uuid 04bbae43-881f-455a-bcd2-c1be2e82f0dc {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.objects.base [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Object Instance<04bbae43-881f-455a-bcd2-c1be2e82f0dc> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-737287584',display_name='tempest-AttachVolumeTestJSON-server-737287584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-737287584',id=44,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeIW/CNmoj21FtRCsqg1lXO54HxCaIvv1uBUUE6B0bU+AGTCthBvSHQimH9CWWXBX3zHlj6txcR4awRuWt6j/DhBo4E/0517ba1Qrhay/0zFwqi/ch9Lcgb2pyyzhBOxA==',key_name='tempest-keypair-535762259',keypairs=<?>,launch_index=0,launched_at=2023-11-02T02:02:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fee0ae54cb9642e68d847235ebe13875',ramdisk_id='',reservation_id='r-44fx7s8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1064832613',owner_user_name='tempest-AttachVolumeTestJSON-1064832613-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T02:04:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd49c6f202cc46b496df91de55c53c65',uuid=04bbae43-881f-455a-bcd2-c1be2e82f0dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Converting VIF {"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:2c:81,bridge_name='br-int',has_traffic_filtering=True,id=46cdee0a-7249-457f-b3d1-e69a6ed62504,network=Network(699807b0-2588-4e44-967e-e11023d25985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cdee0a-72') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_vif [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:2c:81,bridge_name='br-int',has_traffic_filtering=True,id=46cdee0a-7249-457f-b3d1-e69a6ed62504,network=Network(699807b0-2588-4e44-967e-e11023d25985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cdee0a-72') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d4085e-229a-4206-b5d1-9cf111b1dfa1]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d, portal: 172.16.0.220,3260]
Nov 02 02:06:35 user nova-compute[74996]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d, portal: 172.16.0.220,3260] successful.
Nov 02 02:06:35 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46cdee0a-72, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d97c1b8-18cb-4721-8317-9a57b585aa0d) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:06:35 user nova-compute[74996]: INFO os_vif [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:2c:81,bridge_name='br-int',has_traffic_filtering=True,id=46cdee0a-7249-457f-b3d1-e69a6ed62504,network=Network(699807b0-2588-4e44-967e-e11023d25985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cdee0a-72')
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dmLOMViX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:06:35 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5bdca9-64f6-425d-9b95-651c8dde243d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7da9aee-f09b-40f0-b311-7e177d180847]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] <== disconnect_volume: return (288ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.013s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6634970c-956d-4456-8820-b643dfe27aaa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 02:06:35 user nova-compute[74996]: No targets found.
Nov 02 02:06:35 user nova-compute[74996]: iSNS:
Nov 02 02:06:35 user nova-compute[74996]: No targets found.
Nov 02 02:06:35 user nova-compute[74996]: STATIC:
Nov 02 02:06:35 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db
Nov 02 02:06:35 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 02:06:35 user nova-compute[74996]:                 Iface Name: default
Nov 02 02:06:35 user nova-compute[74996]: FIRMWARE:
Nov 02 02:06:35 user nova-compute[74996]: No targets found.
Nov 02 02:06:35 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 02:06:35 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 02:06:35 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b61bf18-73b5-4d62-9760-469af1132f10]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[129e76c2-2abf-43e4-90d3-0c5123e8f3ca]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)
Nov 02 02:06:35 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)
Nov 02 02:06:35 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830c2ebe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db'): ({'sdb'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Removing single pathed devices sdb {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76b3da2-7e6d-49bb-87e1-1b457a8de6c7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[598a47dd-b2a1-41a2-b204-720dbc836817]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Flushing IO for device /dev/sdb {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fe3e22-ad8a-41ca-8127-107d555ab669]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56f61f4-bc2b-4487-a95f-39badf9ac72b]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b82a10-11ee-48cc-9721-44809c2d02f9]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5ca909-9d3d-4863-907f-d9801eb8c7a7]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db, portal: 172.16.0.220,3260]
Nov 02 02:06:35 user nova-compute[74996]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db, portal: 172.16.0.220,3260] successful.
Nov 02 02:06:35 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[081b174e-2a9b-47c2-8458-fca422951dcf]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] <== disconnect_volume: return (307ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Start _get_guest_xml network_info=[{"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2218302f-b5de-4ba2-9f2d-e7ecabb888b0', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dmLOMViX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '04bbae43-881f-455a-bcd2-c1be2e82f0dc', 'attached_at': '', 'detached_at': '', 'volume_id': 'd864c413-1bfb-4383-bc1a-8e5d8a5728db', 'serial': 'd864c413-1bfb-4383-bc1a-8e5d8a5728db'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'volume_type': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.objects.instance [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'numa_topology' on Instance uuid 04bbae43-881f-455a-bcd2-c1be2e82f0dc {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.objects.base [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Object Instance<04bbae43-881f-455a-bcd2-c1be2e82f0dc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 02:06:35 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:06:35 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.objects.instance [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'vcpu_model' on Instance uuid 04bbae43-881f-455a-bcd2-c1be2e82f0dc {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.objects.base [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Object Instance<04bbae43-881f-455a-bcd2-c1be2e82f0dc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dmLOMViX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:06:35 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:06:35 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:06:35 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c633e500-a7fc-41ee-b854-ee4c5e99a80d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 02:06:35 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3363a3bf-63df-475a-92a7-750daed2aa43]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db] added
Nov 02 02:06:35 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[daaf5e0a-b8ec-4826-988c-ba4b1e352b9b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2924678d-5b07-4321-83e9-ee8fba508576]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dmLOMViX {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dmLOMViX" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ff2f39-7388-424a-b4dd-2fbb219f3b5a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dmLOMViX'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8458be57-e04a-4678-8c41-3d25a48f1bc3]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5c7b3c-09c6-4dbb-9e43-d994f69b10b5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 02:06:36 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 02:06:36 user nova-compute[74996]:  {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:06:36 user nova-compute[74996]: WARNING os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 02:06:36 user nova-compute[74996]: 
Nov 02 02:06:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b29b81-64cd-4e04-a619-11e54ee5fee5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db, portal: 172.16.0.220,3260]
Nov 02 02:06:36 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db, portal: 172.16.0.220,3260] successful.
Nov 02 02:06:36 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4af955-b34b-4fcf-94fd-29ee07ea08f4]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a1df91-55be-4573-b453-526c6e476fc1]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)
Nov 02 02:06:36 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)
Nov 02 02:06:36 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.233s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6885235a-51c5-4723-8ca9-ecfe3778537a]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dmLOMViX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG nova.objects.instance [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lazy-loading 'flavor' on Instance uuid 17b25747-b89d-43f0-a28a-afcf40d35e70 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-aa1c99c9-6c84-42da-9ab7-49f6ee843926 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.734s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 13.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:06:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.262s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] <== connect_volume: return (1264ms) {'type': 'block', 'scsi_wwn': '26261386533383266', 'path': '/dev/sdb'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261386533383266', 'path': '/dev/sdb'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-737287584',display_name='tempest-AttachVolumeTestJSON-server-737287584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-737287584',id=44,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeIW/CNmoj21FtRCsqg1lXO54HxCaIvv1uBUUE6B0bU+AGTCthBvSHQimH9CWWXBX3zHlj6txcR4awRuWt6j/DhBo4E/0517ba1Qrhay/0zFwqi/ch9Lcgb2pyyzhBOxA==',key_name='tempest-keypair-535762259',keypairs=<?>,launch_index=0,launched_at=2023-11-02T02:02:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fee0ae54cb9642e68d847235ebe13875',ramdisk_id='',reservation_id='r-44fx7s8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1064832613',owner_user_name='tempest-AttachVolumeTestJSON-1064832613-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T02:04:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd49c6f202cc46b496df91de55c53c65',uuid=04bbae43-881f-455a-bcd2-c1be2e82f0dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Converting VIF {"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:2c:81,bridge_name='br-int',has_traffic_filtering=True,id=46cdee0a-7249-457f-b3d1-e69a6ed62504,network=Network(699807b0-2588-4e44-967e-e11023d25985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cdee0a-72') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG nova.objects.instance [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'pci_devices' on Instance uuid 04bbae43-881f-455a-bcd2-c1be2e82f0dc {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG nova.objects.base [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Object Instance<04bbae43-881f-455a-bcd2-c1be2e82f0dc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] End _get_guest_xml xml=<domain type="kvm">
Nov 02 02:06:37 user nova-compute[74996]:   <uuid>04bbae43-881f-455a-bcd2-c1be2e82f0dc</uuid>
Nov 02 02:06:37 user nova-compute[74996]:   <name>instance-0000002c</name>
Nov 02 02:06:37 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 02:06:37 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 02:06:37 user nova-compute[74996]:   <metadata>
Nov 02 02:06:37 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 02:06:37 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 02:06:37 user nova-compute[74996]:       <nova:name>tempest-AttachVolumeTestJSON-server-737287584</nova:name>
Nov 02 02:06:37 user nova-compute[74996]:       <nova:creationTime>2023-11-02 02:06:35</nova:creationTime>
Nov 02 02:06:37 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 02:06:37 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 02:06:37 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 02:06:37 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 02:06:37 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 02:06:37 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 02:06:37 user nova-compute[74996]:       </nova:flavor>
Nov 02 02:06:37 user nova-compute[74996]:       <nova:owner>
Nov 02 02:06:37 user nova-compute[74996]:         <nova:user uuid="dd49c6f202cc46b496df91de55c53c65">tempest-AttachVolumeTestJSON-1064832613-project-member</nova:user>
Nov 02 02:06:37 user nova-compute[74996]:         <nova:project uuid="fee0ae54cb9642e68d847235ebe13875">tempest-AttachVolumeTestJSON-1064832613</nova:project>
Nov 02 02:06:37 user nova-compute[74996]:       </nova:owner>
Nov 02 02:06:37 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 02:06:37 user nova-compute[74996]:       <nova:ports>
Nov 02 02:06:37 user nova-compute[74996]:         <nova:port uuid="46cdee0a-7249-457f-b3d1-e69a6ed62504">
Nov 02 02:06:37 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 02:06:37 user nova-compute[74996]:         </nova:port>
Nov 02 02:06:37 user nova-compute[74996]:       </nova:ports>
Nov 02 02:06:37 user nova-compute[74996]:     </nova:instance>
Nov 02 02:06:37 user nova-compute[74996]:   </metadata>
Nov 02 02:06:37 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 02:06:37 user nova-compute[74996]:     <system>
Nov 02 02:06:37 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 02:06:37 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 02:06:37 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 02:06:37 user nova-compute[74996]:       <entry name="serial">04bbae43-881f-455a-bcd2-c1be2e82f0dc</entry>
Nov 02 02:06:37 user nova-compute[74996]:       <entry name="uuid">04bbae43-881f-455a-bcd2-c1be2e82f0dc</entry>
Nov 02 02:06:37 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 02:06:37 user nova-compute[74996]:     </system>
Nov 02 02:06:37 user nova-compute[74996]:   </sysinfo>
Nov 02 02:06:37 user nova-compute[74996]:   <os>
Nov 02 02:06:37 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 02:06:37 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 02:06:37 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 02:06:37 user nova-compute[74996]:   </os>
Nov 02 02:06:37 user nova-compute[74996]:   <features>
Nov 02 02:06:37 user nova-compute[74996]:     <acpi/>
Nov 02 02:06:37 user nova-compute[74996]:     <apic/>
Nov 02 02:06:37 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 02:06:37 user nova-compute[74996]:   </features>
Nov 02 02:06:37 user nova-compute[74996]:   <clock offset="utc">
Nov 02 02:06:37 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 02:06:37 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 02:06:37 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 02:06:37 user nova-compute[74996]:   </clock>
Nov 02 02:06:37 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 02:06:37 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 02:06:37 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 02:06:37 user nova-compute[74996]:   </cpu>
Nov 02 02:06:37 user nova-compute[74996]:   <devices>
Nov 02 02:06:37 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 02:06:37 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 02:06:37 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk"/>
Nov 02 02:06:37 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 02:06:37 user nova-compute[74996]:     </disk>
Nov 02 02:06:37 user nova-compute[74996]:     <disk type="block" device="disk">
Nov 02 02:06:37 user nova-compute[74996]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:06:37 user nova-compute[74996]:       <source dev="/dev/sdb"/>
Nov 02 02:06:37 user nova-compute[74996]:       <target dev="vdb" bus="virtio"/>
Nov 02 02:06:37 user nova-compute[74996]:       <serial>d864c413-1bfb-4383-bc1a-8e5d8a5728db</serial>
Nov 02 02:06:37 user nova-compute[74996]:     </disk>
Nov 02 02:06:37 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 02:06:37 user nova-compute[74996]:       <mac address="fa:16:3e:73:2c:81"/>
Nov 02 02:06:37 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 02:06:37 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 02:06:37 user nova-compute[74996]:       <target dev="tap46cdee0a-72"/>
Nov 02 02:06:37 user nova-compute[74996]:     </interface>
Nov 02 02:06:37 user nova-compute[74996]:     <serial type="pty">
Nov 02 02:06:37 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/console.log" append="off"/>
Nov 02 02:06:37 user nova-compute[74996]:     </serial>
Nov 02 02:06:37 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 02:06:37 user nova-compute[74996]:     <video>
Nov 02 02:06:37 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 02:06:37 user nova-compute[74996]:     </video>
Nov 02 02:06:37 user nova-compute[74996]:     <rng model="virtio">
Nov 02 02:06:37 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 02:06:37 user nova-compute[74996]:     </rng>
Nov 02 02:06:37 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 02:06:37 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 02:06:37 user nova-compute[74996]:       <stats period="10"/>
Nov 02 02:06:37 user nova-compute[74996]:     </memballoon>
Nov 02 02:06:37 user nova-compute[74996]:   </devices>
Nov 02 02:06:37 user nova-compute[74996]: </domain>
Nov 02 02:06:37 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG nova.objects.instance [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'trusted_certs' on Instance uuid 04bbae43-881f-455a-bcd2-c1be2e82f0dc {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG nova.objects.base [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Object Instance<04bbae43-881f-455a-bcd2-c1be2e82f0dc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.177s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Cannot resize image /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG nova.objects.instance [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'migration_context' on Instance uuid 04bbae43-881f-455a-bcd2-c1be2e82f0dc {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG nova.objects.base [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Object Instance<04bbae43-881f-455a-bcd2-c1be2e82f0dc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-737287584',display_name='tempest-AttachVolumeTestJSON-server-737287584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-737287584',id=44,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeIW/CNmoj21FtRCsqg1lXO54HxCaIvv1uBUUE6B0bU+AGTCthBvSHQimH9CWWXBX3zHlj6txcR4awRuWt6j/DhBo4E/0517ba1Qrhay/0zFwqi/ch9Lcgb2pyyzhBOxA==',key_name='tempest-keypair-535762259',keypairs=<?>,launch_index=0,launched_at=2023-11-02T02:02:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='fee0ae54cb9642e68d847235ebe13875',ramdisk_id='',reservation_id='r-44fx7s8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1064832613',owner_user_name='tempest-AttachVolumeTestJSON-1064832613-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T02:04:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd49c6f202cc46b496df91de55c53c65',uuid=04bbae43-881f-455a-bcd2-c1be2e82f0dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Converting VIF {"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:2c:81,bridge_name='br-int',has_traffic_filtering=True,id=46cdee0a-7249-457f-b3d1-e69a6ed62504,network=Network(699807b0-2588-4e44-967e-e11023d25985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cdee0a-72') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG os_vif [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:2c:81,bridge_name='br-int',has_traffic_filtering=True,id=46cdee0a-7249-457f-b3d1-e69a6ed62504,network=Network(699807b0-2588-4e44-967e-e11023d25985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cdee0a-72') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '632c27b2-a6a7-54bf-8066-3a6d296025b1', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:06:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46cdee0a-72, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:06:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap46cdee0a-72, col_values=(('qos', UUID('8a5d2c9e-4839-4a93-aa23-63119659bcc0')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:06:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap46cdee0a-72, col_values=(('external_ids', {'iface-id': '46cdee0a-7249-457f-b3d1-e69a6ed62504', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:2c:81', 'vm-uuid': '04bbae43-881f-455a-bcd2-c1be2e82f0dc'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:06:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:06:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:38 user nova-compute[74996]: INFO os_vif [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:2c:81,bridge_name='br-int',has_traffic_filtering=True,id=46cdee0a-7249-457f-b3d1-e69a6ed62504,network=Network(699807b0-2588-4e44-967e-e11023d25985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cdee0a-72')
Nov 02 02:06:38 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:06:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:06:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:06:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:06:38 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 02:06:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:39 user nova-compute[74996]: DEBUG nova.compute.manager [req-930452da-c538-4092-9b3a-eb6d53a57241 req-a6907298-ad5a-463c-b61b-90b54ac4ae1d service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Received event network-vif-plugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:06:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-930452da-c538-4092-9b3a-eb6d53a57241 req-a6907298-ad5a-463c-b61b-90b54ac4ae1d service nova] Acquiring lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:06:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-930452da-c538-4092-9b3a-eb6d53a57241 req-a6907298-ad5a-463c-b61b-90b54ac4ae1d service nova] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:06:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-930452da-c538-4092-9b3a-eb6d53a57241 req-a6907298-ad5a-463c-b61b-90b54ac4ae1d service nova] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:06:39 user nova-compute[74996]: DEBUG nova.compute.manager [req-930452da-c538-4092-9b3a-eb6d53a57241 req-a6907298-ad5a-463c-b61b-90b54ac4ae1d service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] No waiting events found dispatching network-vif-plugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:06:39 user nova-compute[74996]: WARNING nova.compute.manager [req-930452da-c538-4092-9b3a-eb6d53a57241 req-a6907298-ad5a-463c-b61b-90b54ac4ae1d service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Received unexpected event network-vif-plugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 for instance with vm_state stopped and task_state powering-on.
Nov 02 02:06:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:40 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 02:06:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:06:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:06:41 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:06:41 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:06:41 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8651MB free_disk=24.943538665771484GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 02:06:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:06:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:06:41 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 17b25747-b89d-43f0-a28a-afcf40d35e70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:06:41 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 04bbae43-881f-455a-bcd2-c1be2e82f0dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:06:41 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance f4dbbf62-95bd-47e7-bbf1-16e143746a45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:06:41 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 02:06:41 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 02:06:41 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Refreshing inventories for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 02:06:41 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Updating ProviderTree inventory for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 02:06:41 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Updating inventory in ProviderTree for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 02:06:41 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Refreshing aggregate associations for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259, aggregates: None {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 02:06:41 user nova-compute[74996]: DEBUG nova.compute.manager [req-8bea89b2-7c91-4112-bcb3-5939092bd424 req-733b1f09-f3c9-4ce5-8409-c86be6dd43c4 service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Received event network-vif-plugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:06:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8bea89b2-7c91-4112-bcb3-5939092bd424 req-733b1f09-f3c9-4ce5-8409-c86be6dd43c4 service nova] Acquiring lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:06:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8bea89b2-7c91-4112-bcb3-5939092bd424 req-733b1f09-f3c9-4ce5-8409-c86be6dd43c4 service nova] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:06:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8bea89b2-7c91-4112-bcb3-5939092bd424 req-733b1f09-f3c9-4ce5-8409-c86be6dd43c4 service nova] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:06:41 user nova-compute[74996]: DEBUG nova.compute.manager [req-8bea89b2-7c91-4112-bcb3-5939092bd424 req-733b1f09-f3c9-4ce5-8409-c86be6dd43c4 service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] No waiting events found dispatching network-vif-plugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:06:41 user nova-compute[74996]: WARNING nova.compute.manager [req-8bea89b2-7c91-4112-bcb3-5939092bd424 req-733b1f09-f3c9-4ce5-8409-c86be6dd43c4 service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Received unexpected event network-vif-plugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 for instance with vm_state stopped and task_state powering-on.
Nov 02 02:06:41 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Refreshing trait associations for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 02:06:41 user nova-compute[74996]: DEBUG nova.compute.manager [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 02:06:41 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Instance rebooted successfully.
Nov 02 02:06:41 user nova-compute[74996]: DEBUG nova.compute.manager [None req-36e8cb1a-0db4-4df6-83bf-8a937b6e681d tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 02:06:41 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:06:41 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:06:41 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 02:06:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.374s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:06:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:44 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:06:44 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:06:44 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:06:44 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:06:44 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 02:06:45 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:06:45 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 02:06:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-04bbae43-881f-455a-bcd2-c1be2e82f0dc" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:06:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-04bbae43-881f-455a-bcd2-c1be2e82f0dc" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:06:45 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 02:06:45 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Updating instance_info_cache with network_info: [{"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:06:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-04bbae43-881f-455a-bcd2-c1be2e82f0dc" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:06:45 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 02:06:47 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:06:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:48 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:06:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:06:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:07:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:07:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:07:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:07:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:07:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:07:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:07:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:07:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Acquiring lock "9a6472bf-1254-4255-b887-5ea38a2bd96e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:07:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "9a6472bf-1254-4255-b887-5ea38a2bd96e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:07:23 user nova-compute[74996]: DEBUG nova.compute.manager [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 02:07:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:07:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:07:24 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 02:07:24 user nova-compute[74996]: INFO nova.compute.claims [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Claim successful on node user
Nov 02 02:07:24 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:07:24 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:07:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.317s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:07:24 user nova-compute[74996]: DEBUG nova.compute.manager [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 02:07:24 user nova-compute[74996]: DEBUG nova.compute.manager [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 02:07:24 user nova-compute[74996]: DEBUG nova.network.neutron [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 02:07:24 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 02:07:24 user nova-compute[74996]: DEBUG nova.compute.manager [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 02:07:24 user nova-compute[74996]: DEBUG nova.policy [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd189b000f4cd4c9cb835abd85b9180f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c4de34aca164d5abbff0ff11b44762b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 02:07:24 user nova-compute[74996]: DEBUG nova.compute.manager [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 02:07:24 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 02:07:24 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Creating image(s)
Nov 02 02:07:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Acquiring lock "/opt/stack/data/nova/instances/9a6472bf-1254-4255-b887-5ea38a2bd96e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:07:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "/opt/stack/data/nova/instances/9a6472bf-1254-4255-b887-5ea38a2bd96e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:07:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "/opt/stack/data/nova/instances/9a6472bf-1254-4255-b887-5ea38a2bd96e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:07:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:07:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.185s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:07:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:07:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:07:24 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:07:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.187s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:07:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/9a6472bf-1254-4255-b887-5ea38a2bd96e/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:07:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/9a6472bf-1254-4255-b887-5ea38a2bd96e/disk 1073741824" returned: 0 in 0.051s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:07:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:07:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:07:25 user nova-compute[74996]: DEBUG nova.network.neutron [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Successfully created port: 1d784007-9222-4c4e-9927-477e51e17327 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 02:07:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.220s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:07:25 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9a6472bf-1254-4255-b887-5ea38a2bd96e/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 02:07:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a6472bf-1254-4255-b887-5ea38a2bd96e/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:07:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a6472bf-1254-4255-b887-5ea38a2bd96e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:07:25 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Cannot resize image /opt/stack/data/nova/instances/9a6472bf-1254-4255-b887-5ea38a2bd96e/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 02:07:25 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 02:07:25 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Ensure instance console log exists: /opt/stack/data/nova/instances/9a6472bf-1254-4255-b887-5ea38a2bd96e/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 02:07:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:07:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:07:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:07:25 user nova-compute[74996]: DEBUG nova.network.neutron [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Successfully updated port: 1d784007-9222-4c4e-9927-477e51e17327 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 02:07:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Acquiring lock "refresh_cache-9a6472bf-1254-4255-b887-5ea38a2bd96e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:07:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Acquired lock "refresh_cache-9a6472bf-1254-4255-b887-5ea38a2bd96e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:07:25 user nova-compute[74996]: DEBUG nova.network.neutron [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.compute.manager [req-ec7830b7-feb6-44de-a2c9-e76b421d3424 req-52e24797-604b-4bac-a9a8-7732922c0364 service nova] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Received event network-changed-1d784007-9222-4c4e-9927-477e51e17327 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.compute.manager [req-ec7830b7-feb6-44de-a2c9-e76b421d3424 req-52e24797-604b-4bac-a9a8-7732922c0364 service nova] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Refreshing instance network info cache due to event network-changed-1d784007-9222-4c4e-9927-477e51e17327. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ec7830b7-feb6-44de-a2c9-e76b421d3424 req-52e24797-604b-4bac-a9a8-7732922c0364 service nova] Acquiring lock "refresh_cache-9a6472bf-1254-4255-b887-5ea38a2bd96e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.network.neutron [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.network.neutron [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Updating instance_info_cache with network_info: [{"id": "1d784007-9222-4c4e-9927-477e51e17327", "address": "fa:16:3e:a4:ec:14", "network": {"id": "76ec976d-a10a-4c58-8b3c-7db507c2bcd5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1016707767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c4de34aca164d5abbff0ff11b44762b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d784007-92", "ovs_interfaceid": "1d784007-9222-4c4e-9927-477e51e17327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Releasing lock "refresh_cache-9a6472bf-1254-4255-b887-5ea38a2bd96e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.compute.manager [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Instance network_info: |[{"id": "1d784007-9222-4c4e-9927-477e51e17327", "address": "fa:16:3e:a4:ec:14", "network": {"id": "76ec976d-a10a-4c58-8b3c-7db507c2bcd5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1016707767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c4de34aca164d5abbff0ff11b44762b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d784007-92", "ovs_interfaceid": "1d784007-9222-4c4e-9927-477e51e17327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ec7830b7-feb6-44de-a2c9-e76b421d3424 req-52e24797-604b-4bac-a9a8-7732922c0364 service nova] Acquired lock "refresh_cache-9a6472bf-1254-4255-b887-5ea38a2bd96e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.network.neutron [req-ec7830b7-feb6-44de-a2c9-e76b421d3424 req-52e24797-604b-4bac-a9a8-7732922c0364 service nova] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Refreshing network info cache for port 1d784007-9222-4c4e-9927-477e51e17327 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Start _get_guest_xml network_info=[{"id": "1d784007-9222-4c4e-9927-477e51e17327", "address": "fa:16:3e:a4:ec:14", "network": {"id": "76ec976d-a10a-4c58-8b3c-7db507c2bcd5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1016707767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c4de34aca164d5abbff0ff11b44762b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d784007-92", "ovs_interfaceid": "1d784007-9222-4c4e-9927-477e51e17327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 02:07:26 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:07:26 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-106498995',display_name='tempest-ServersNegativeTestJSON-server-106498995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-106498995',id=47,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c4de34aca164d5abbff0ff11b44762b',ramdisk_id='',reservation_id='r-m5i2byfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-235429949',owner_user_name='tempest-ServersNegativeTestJSON-235429949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T02:07:25Z,user_data=None,user_id='d189b000f4cd4c9cb835abd85b9180f1',uuid=9a6472bf-1254-4255-b887-5ea38a2bd96e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d784007-9222-4c4e-9927-477e51e17327", "address": "fa:16:3e:a4:ec:14", "network": {"id": "76ec976d-a10a-4c58-8b3c-7db507c2bcd5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1016707767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c4de34aca164d5abbff0ff11b44762b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d784007-92", "ovs_interfaceid": "1d784007-9222-4c4e-9927-477e51e17327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Converting VIF {"id": "1d784007-9222-4c4e-9927-477e51e17327", "address": "fa:16:3e:a4:ec:14", "network": {"id": "76ec976d-a10a-4c58-8b3c-7db507c2bcd5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1016707767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c4de34aca164d5abbff0ff11b44762b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d784007-92", "ovs_interfaceid": "1d784007-9222-4c4e-9927-477e51e17327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:ec:14,bridge_name='br-int',has_traffic_filtering=True,id=1d784007-9222-4c4e-9927-477e51e17327,network=Network(76ec976d-a10a-4c58-8b3c-7db507c2bcd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d784007-92') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.objects.instance [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a6472bf-1254-4255-b887-5ea38a2bd96e {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] End _get_guest_xml xml=<domain type="kvm">
Nov 02 02:07:26 user nova-compute[74996]:   <uuid>9a6472bf-1254-4255-b887-5ea38a2bd96e</uuid>
Nov 02 02:07:26 user nova-compute[74996]:   <name>instance-0000002f</name>
Nov 02 02:07:26 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 02:07:26 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 02:07:26 user nova-compute[74996]:   <metadata>
Nov 02 02:07:26 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 02:07:26 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 02:07:26 user nova-compute[74996]:       <nova:name>tempest-ServersNegativeTestJSON-server-106498995</nova:name>
Nov 02 02:07:26 user nova-compute[74996]:       <nova:creationTime>2023-11-02 02:07:26</nova:creationTime>
Nov 02 02:07:26 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 02:07:26 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 02:07:26 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 02:07:26 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 02:07:26 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 02:07:26 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 02:07:26 user nova-compute[74996]:       </nova:flavor>
Nov 02 02:07:26 user nova-compute[74996]:       <nova:owner>
Nov 02 02:07:26 user nova-compute[74996]:         <nova:user uuid="d189b000f4cd4c9cb835abd85b9180f1">tempest-ServersNegativeTestJSON-235429949-project-member</nova:user>
Nov 02 02:07:26 user nova-compute[74996]:         <nova:project uuid="2c4de34aca164d5abbff0ff11b44762b">tempest-ServersNegativeTestJSON-235429949</nova:project>
Nov 02 02:07:26 user nova-compute[74996]:       </nova:owner>
Nov 02 02:07:26 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 02:07:26 user nova-compute[74996]:       <nova:ports>
Nov 02 02:07:26 user nova-compute[74996]:         <nova:port uuid="1d784007-9222-4c4e-9927-477e51e17327">
Nov 02 02:07:26 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 02 02:07:26 user nova-compute[74996]:         </nova:port>
Nov 02 02:07:26 user nova-compute[74996]:       </nova:ports>
Nov 02 02:07:26 user nova-compute[74996]:     </nova:instance>
Nov 02 02:07:26 user nova-compute[74996]:   </metadata>
Nov 02 02:07:26 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 02:07:26 user nova-compute[74996]:     <system>
Nov 02 02:07:26 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 02:07:26 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 02:07:26 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 02:07:26 user nova-compute[74996]:       <entry name="serial">9a6472bf-1254-4255-b887-5ea38a2bd96e</entry>
Nov 02 02:07:26 user nova-compute[74996]:       <entry name="uuid">9a6472bf-1254-4255-b887-5ea38a2bd96e</entry>
Nov 02 02:07:26 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 02:07:26 user nova-compute[74996]:     </system>
Nov 02 02:07:26 user nova-compute[74996]:   </sysinfo>
Nov 02 02:07:26 user nova-compute[74996]:   <os>
Nov 02 02:07:26 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 02:07:26 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 02:07:26 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 02:07:26 user nova-compute[74996]:   </os>
Nov 02 02:07:26 user nova-compute[74996]:   <features>
Nov 02 02:07:26 user nova-compute[74996]:     <acpi/>
Nov 02 02:07:26 user nova-compute[74996]:     <apic/>
Nov 02 02:07:26 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 02:07:26 user nova-compute[74996]:   </features>
Nov 02 02:07:26 user nova-compute[74996]:   <clock offset="utc">
Nov 02 02:07:26 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 02:07:26 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 02:07:26 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 02:07:26 user nova-compute[74996]:   </clock>
Nov 02 02:07:26 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 02:07:26 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 02:07:26 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 02:07:26 user nova-compute[74996]:   </cpu>
Nov 02 02:07:26 user nova-compute[74996]:   <devices>
Nov 02 02:07:26 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 02:07:26 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 02:07:26 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/9a6472bf-1254-4255-b887-5ea38a2bd96e/disk"/>
Nov 02 02:07:26 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 02:07:26 user nova-compute[74996]:     </disk>
Nov 02 02:07:26 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 02:07:26 user nova-compute[74996]:       <mac address="fa:16:3e:a4:ec:14"/>
Nov 02 02:07:26 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 02:07:26 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 02:07:26 user nova-compute[74996]:       <target dev="tap1d784007-92"/>
Nov 02 02:07:26 user nova-compute[74996]:     </interface>
Nov 02 02:07:26 user nova-compute[74996]:     <serial type="pty">
Nov 02 02:07:26 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/9a6472bf-1254-4255-b887-5ea38a2bd96e/console.log" append="off"/>
Nov 02 02:07:26 user nova-compute[74996]:     </serial>
Nov 02 02:07:26 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 02:07:26 user nova-compute[74996]:     <video>
Nov 02 02:07:26 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 02:07:26 user nova-compute[74996]:     </video>
Nov 02 02:07:26 user nova-compute[74996]:     <rng model="virtio">
Nov 02 02:07:26 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 02:07:26 user nova-compute[74996]:     </rng>
Nov 02 02:07:26 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 02:07:26 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 02:07:26 user nova-compute[74996]:       <stats period="10"/>
Nov 02 02:07:26 user nova-compute[74996]:     </memballoon>
Nov 02 02:07:26 user nova-compute[74996]:   </devices>
Nov 02 02:07:26 user nova-compute[74996]: </domain>
Nov 02 02:07:26 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-106498995',display_name='tempest-ServersNegativeTestJSON-server-106498995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-106498995',id=47,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c4de34aca164d5abbff0ff11b44762b',ramdisk_id='',reservation_id='r-m5i2byfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-235429949',owner_user_name='tempest-ServersNegativeTestJSON-235429949-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T02:07:25Z,user_data=None,user_id='d189b000f4cd4c9cb835abd85b9180f1',uuid=9a6472bf-1254-4255-b887-5ea38a2bd96e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d784007-9222-4c4e-9927-477e51e17327", "address": "fa:16:3e:a4:ec:14", "network": {"id": "76ec976d-a10a-4c58-8b3c-7db507c2bcd5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1016707767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c4de34aca164d5abbff0ff11b44762b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d784007-92", "ovs_interfaceid": "1d784007-9222-4c4e-9927-477e51e17327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Converting VIF {"id": "1d784007-9222-4c4e-9927-477e51e17327", "address": "fa:16:3e:a4:ec:14", "network": {"id": "76ec976d-a10a-4c58-8b3c-7db507c2bcd5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1016707767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c4de34aca164d5abbff0ff11b44762b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d784007-92", "ovs_interfaceid": "1d784007-9222-4c4e-9927-477e51e17327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:ec:14,bridge_name='br-int',has_traffic_filtering=True,id=1d784007-9222-4c4e-9927-477e51e17327,network=Network(76ec976d-a10a-4c58-8b3c-7db507c2bcd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d784007-92') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG os_vif [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:ec:14,bridge_name='br-int',has_traffic_filtering=True,id=1d784007-9222-4c4e-9927-477e51e17327,network=Network(76ec976d-a10a-4c58-8b3c-7db507c2bcd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d784007-92') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b91c2dc3-79f8-5f3a-84f4-db5b731ded0e', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d784007-92, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d784007-92, col_values=(('qos', UUID('46a2bc16-17ef-4f26-88f8-fd65101b6551')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d784007-92, col_values=(('external_ids', {'iface-id': '1d784007-9222-4c4e-9927-477e51e17327', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:ec:14', 'vm-uuid': '9a6472bf-1254-4255-b887-5ea38a2bd96e'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:07:26 user nova-compute[74996]: INFO os_vif [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:ec:14,bridge_name='br-int',has_traffic_filtering=True,id=1d784007-9222-4c4e-9927-477e51e17327,network=Network(76ec976d-a10a-4c58-8b3c-7db507c2bcd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d784007-92')
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] No VIF found with MAC fa:16:3e:a4:ec:14, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.network.neutron [req-ec7830b7-feb6-44de-a2c9-e76b421d3424 req-52e24797-604b-4bac-a9a8-7732922c0364 service nova] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Updated VIF entry in instance network info cache for port 1d784007-9222-4c4e-9927-477e51e17327. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG nova.network.neutron [req-ec7830b7-feb6-44de-a2c9-e76b421d3424 req-52e24797-604b-4bac-a9a8-7732922c0364 service nova] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Updating instance_info_cache with network_info: [{"id": "1d784007-9222-4c4e-9927-477e51e17327", "address": "fa:16:3e:a4:ec:14", "network": {"id": "76ec976d-a10a-4c58-8b3c-7db507c2bcd5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1016707767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c4de34aca164d5abbff0ff11b44762b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d784007-92", "ovs_interfaceid": "1d784007-9222-4c4e-9927-477e51e17327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:07:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ec7830b7-feb6-44de-a2c9-e76b421d3424 req-52e24797-604b-4bac-a9a8-7732922c0364 service nova] Releasing lock "refresh_cache-9a6472bf-1254-4255-b887-5ea38a2bd96e" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:07:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:07:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:07:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:07:27 user nova-compute[74996]: DEBUG nova.compute.manager [req-72c37a23-805c-469a-85b4-954243c5aa97 req-3c041ece-0977-43e3-be56-fe9b54da3c0b service nova] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Received event network-vif-plugged-1d784007-9222-4c4e-9927-477e51e17327 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:07:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-72c37a23-805c-469a-85b4-954243c5aa97 req-3c041ece-0977-43e3-be56-fe9b54da3c0b service nova] Acquiring lock "9a6472bf-1254-4255-b887-5ea38a2bd96e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:07:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-72c37a23-805c-469a-85b4-954243c5aa97 req-3c041ece-0977-43e3-be56-fe9b54da3c0b service nova] Lock "9a6472bf-1254-4255-b887-5ea38a2bd96e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:07:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-72c37a23-805c-469a-85b4-954243c5aa97 req-3c041ece-0977-43e3-be56-fe9b54da3c0b service nova] Lock "9a6472bf-1254-4255-b887-5ea38a2bd96e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:07:27 user nova-compute[74996]: DEBUG nova.compute.manager [req-72c37a23-805c-469a-85b4-954243c5aa97 req-3c041ece-0977-43e3-be56-fe9b54da3c0b service nova] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] No waiting events found dispatching network-vif-plugged-1d784007-9222-4c4e-9927-477e51e17327 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:07:27 user nova-compute[74996]: WARNING nova.compute.manager [req-72c37a23-805c-469a-85b4-954243c5aa97 req-3c041ece-0977-43e3-be56-fe9b54da3c0b service nova] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Received unexpected event network-vif-plugged-1d784007-9222-4c4e-9927-477e51e17327 for instance with vm_state building and task_state spawning.
Nov 02 02:07:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:07:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:07:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:07:29 user nova-compute[74996]: DEBUG nova.compute.manager [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 02:07:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 02:07:29 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Instance spawned successfully.
Nov 02 02:07:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 02:07:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:07:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:07:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:07:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:07:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:07:29 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:07:30 user nova-compute[74996]: DEBUG nova.compute.manager [req-c42fcfca-6d7c-4b6c-897d-486b4688b771 req-12ddb436-b050-4825-a6b1-f3c339cb1e83 service nova] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Received event network-vif-plugged-1d784007-9222-4c4e-9927-477e51e17327 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:07:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c42fcfca-6d7c-4b6c-897d-486b4688b771 req-12ddb436-b050-4825-a6b1-f3c339cb1e83 service nova] Acquiring lock "9a6472bf-1254-4255-b887-5ea38a2bd96e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:07:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c42fcfca-6d7c-4b6c-897d-486b4688b771 req-12ddb436-b050-4825-a6b1-f3c339cb1e83 service nova] Lock "9a6472bf-1254-4255-b887-5ea38a2bd96e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:07:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c42fcfca-6d7c-4b6c-897d-486b4688b771 req-12ddb436-b050-4825-a6b1-f3c339cb1e83 service nova] Lock "9a6472bf-1254-4255-b887-5ea38a2bd96e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:07:30 user nova-compute[74996]: DEBUG nova.compute.manager [req-c42fcfca-6d7c-4b6c-897d-486b4688b771 req-12ddb436-b050-4825-a6b1-f3c339cb1e83 service nova] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] No waiting events found dispatching network-vif-plugged-1d784007-9222-4c4e-9927-477e51e17327 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:07:30 user nova-compute[74996]: WARNING nova.compute.manager [req-c42fcfca-6d7c-4b6c-897d-486b4688b771 req-12ddb436-b050-4825-a6b1-f3c339cb1e83 service nova] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Received unexpected event network-vif-plugged-1d784007-9222-4c4e-9927-477e51e17327 for instance with vm_state building and task_state spawning.
Nov 02 02:07:30 user nova-compute[74996]: INFO nova.compute.manager [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 02 02:07:30 user nova-compute[74996]: DEBUG nova.compute.manager [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 02:07:30 user nova-compute[74996]: INFO nova.compute.manager [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Took 6.11 seconds to build instance.
Nov 02 02:07:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-483eaca3-7f89-41f3-aaf3-403aa32faf85 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "9a6472bf-1254-4255-b887-5ea38a2bd96e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.248s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:07:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:07:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:07:38 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:07:38 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:07:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:07:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:07:38 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:07:38 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 02:07:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:07:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:07:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:07:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:07:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74996) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 02 02:07:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:07:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:07:38 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:07:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:07:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:07:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:07:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:07:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:07:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a6472bf-1254-4255-b887-5ea38a2bd96e/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:07:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a6472bf-1254-4255-b887-5ea38a2bd96e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:07:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a6472bf-1254-4255-b887-5ea38a2bd96e/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:07:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a6472bf-1254-4255-b887-5ea38a2bd96e/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:07:40 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:07:40 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:07:40 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8437MB free_disk=24.932342529296875GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 02:07:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:07:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:07:40 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 17b25747-b89d-43f0-a28a-afcf40d35e70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:07:40 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 04bbae43-881f-455a-bcd2-c1be2e82f0dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:07:40 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance f4dbbf62-95bd-47e7-bbf1-16e143746a45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:07:40 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 9a6472bf-1254-4255-b887-5ea38a2bd96e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:07:40 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 02:07:40 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 02:07:40 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:07:40 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:07:40 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 02:07:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.296s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:07:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:07:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:07:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:07:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:07:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:07:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:07:43 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:07:43 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:07:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:07:44 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:07:44 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 02:07:45 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:07:45 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 02:07:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-f4dbbf62-95bd-47e7-bbf1-16e143746a45" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:07:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-f4dbbf62-95bd-47e7-bbf1-16e143746a45" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:07:45 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 02:07:45 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Updating instance_info_cache with network_info: [{"id": "4728343d-18b1-4199-a165-e0e8aa414f2b", "address": "fa:16:3e:3f:81:e4", "network": {"id": "76ec976d-a10a-4c58-8b3c-7db507c2bcd5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1016707767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c4de34aca164d5abbff0ff11b44762b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4728343d-18", "ovs_interfaceid": "4728343d-18b1-4199-a165-e0e8aa414f2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:07:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-f4dbbf62-95bd-47e7-bbf1-16e143746a45" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:07:45 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 02:07:45 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:07:46 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:07:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:07:49 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:07:50 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:07:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:07:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:07:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:07:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:08 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:08:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:08:16 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:08:16 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:16 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:08:16 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:08:16 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:08:16 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-15286889-be7f-42eb-bb58-407fd8325b27 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "17b25747-b89d-43f0-a28a-afcf40d35e70" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:08:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-15286889-be7f-42eb-bb58-407fd8325b27 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:08:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-15286889-be7f-42eb-bb58-407fd8325b27 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "17b25747-b89d-43f0-a28a-afcf40d35e70-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:08:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-15286889-be7f-42eb-bb58-407fd8325b27 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:08:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-15286889-be7f-42eb-bb58-407fd8325b27 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:08:21 user nova-compute[74996]: INFO nova.compute.manager [None req-15286889-be7f-42eb-bb58-407fd8325b27 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Terminating instance
Nov 02 02:08:21 user nova-compute[74996]: DEBUG nova.compute.manager [None req-15286889-be7f-42eb-bb58-407fd8325b27 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 02:08:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:22 user nova-compute[74996]: DEBUG nova.compute.manager [req-53de139a-dc92-4925-9ae6-2575856181b0 req-84128ec4-2dd6-44e8-8da8-3f0ca6bb05c2 service nova] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Received event network-vif-unplugged-dffb12c9-41c5-480c-bb0f-f2a3fab03b8c {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:08:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-53de139a-dc92-4925-9ae6-2575856181b0 req-84128ec4-2dd6-44e8-8da8-3f0ca6bb05c2 service nova] Acquiring lock "17b25747-b89d-43f0-a28a-afcf40d35e70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:08:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-53de139a-dc92-4925-9ae6-2575856181b0 req-84128ec4-2dd6-44e8-8da8-3f0ca6bb05c2 service nova] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:08:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-53de139a-dc92-4925-9ae6-2575856181b0 req-84128ec4-2dd6-44e8-8da8-3f0ca6bb05c2 service nova] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:08:22 user nova-compute[74996]: DEBUG nova.compute.manager [req-53de139a-dc92-4925-9ae6-2575856181b0 req-84128ec4-2dd6-44e8-8da8-3f0ca6bb05c2 service nova] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] No waiting events found dispatching network-vif-unplugged-dffb12c9-41c5-480c-bb0f-f2a3fab03b8c {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:08:22 user nova-compute[74996]: DEBUG nova.compute.manager [req-53de139a-dc92-4925-9ae6-2575856181b0 req-84128ec4-2dd6-44e8-8da8-3f0ca6bb05c2 service nova] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Received event network-vif-unplugged-dffb12c9-41c5-480c-bb0f-f2a3fab03b8c for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 02:08:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:22 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Instance destroyed successfully.
Nov 02 02:08:22 user nova-compute[74996]: DEBUG nova.objects.instance [None req-15286889-be7f-42eb-bb58-407fd8325b27 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lazy-loading 'resources' on Instance uuid 17b25747-b89d-43f0-a28a-afcf40d35e70 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:08:22 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-15286889-be7f-42eb-bb58-407fd8325b27 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T01:59:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-612943796',display_name='tempest-SnapshotDataIntegrityTests-server-612943796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-612943796',id=43,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESrUC6mYWrWUNIBk1I0dgZ3j1zVhLZEHffFd3VUO4GyGOr1bM1s3UwSaWBLKK8sjdfcErihkdQnX31z965uf1VCh93Cufutq41Bt4TQ5V8+UP/pF5fBiR9wLl4H/hdGVw==',key_name='tempest-keypair-1292055540',keypairs=<?>,launch_index=0,launched_at=2023-11-02T01:59:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca3ff0532d194b0c9181d9dde14227b8',ramdisk_id='',reservation_id='r-ac2luzd2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1802508939',owner_user_name='tempest-SnapshotDataIntegrityTests-1802508939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T01:59:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2876f617a1b948afb52ccb54d3d37a38',uuid=17b25747-b89d-43f0-a28a-afcf40d35e70,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dffb12c9-41c5-480c-bb0f-f2a3fab03b8c", "address": "fa:16:3e:9e:8e:1e", "network": {"id": "aea5e8b6-0fff-4614-b29c-d62929cce6ab", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1836711877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3ff0532d194b0c9181d9dde14227b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffb12c9-41", "ovs_interfaceid": "dffb12c9-41c5-480c-bb0f-f2a3fab03b8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 02:08:22 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-15286889-be7f-42eb-bb58-407fd8325b27 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Converting VIF {"id": "dffb12c9-41c5-480c-bb0f-f2a3fab03b8c", "address": "fa:16:3e:9e:8e:1e", "network": {"id": "aea5e8b6-0fff-4614-b29c-d62929cce6ab", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1836711877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca3ff0532d194b0c9181d9dde14227b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdffb12c9-41", "ovs_interfaceid": "dffb12c9-41c5-480c-bb0f-f2a3fab03b8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:08:22 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-15286889-be7f-42eb-bb58-407fd8325b27 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:8e:1e,bridge_name='br-int',has_traffic_filtering=True,id=dffb12c9-41c5-480c-bb0f-f2a3fab03b8c,network=Network(aea5e8b6-0fff-4614-b29c-d62929cce6ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdffb12c9-41') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:08:22 user nova-compute[74996]: DEBUG os_vif [None req-15286889-be7f-42eb-bb58-407fd8325b27 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:8e:1e,bridge_name='br-int',has_traffic_filtering=True,id=dffb12c9-41c5-480c-bb0f-f2a3fab03b8c,network=Network(aea5e8b6-0fff-4614-b29c-d62929cce6ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdffb12c9-41') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 02:08:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdffb12c9-41, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:08:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:08:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd975876-e504-4b74-9b20-f142a3f6d8ba) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:08:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:22 user nova-compute[74996]: INFO os_vif [None req-15286889-be7f-42eb-bb58-407fd8325b27 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:8e:1e,bridge_name='br-int',has_traffic_filtering=True,id=dffb12c9-41c5-480c-bb0f-f2a3fab03b8c,network=Network(aea5e8b6-0fff-4614-b29c-d62929cce6ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdffb12c9-41')
Nov 02 02:08:22 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-15286889-be7f-42eb-bb58-407fd8325b27 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Deleting instance files /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70_del
Nov 02 02:08:22 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-15286889-be7f-42eb-bb58-407fd8325b27 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Deletion of /opt/stack/data/nova/instances/17b25747-b89d-43f0-a28a-afcf40d35e70_del complete
Nov 02 02:08:23 user nova-compute[74996]: INFO nova.compute.manager [None req-15286889-be7f-42eb-bb58-407fd8325b27 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Took 1.09 seconds to destroy the instance on the hypervisor.
Nov 02 02:08:23 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-15286889-be7f-42eb-bb58-407fd8325b27 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 02:08:23 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 02:08:23 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 02:08:23 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:08:23 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Took 0.85 seconds to deallocate network for instance.
Nov 02 02:08:23 user nova-compute[74996]: DEBUG nova.compute.manager [req-54becf34-f0f4-4da6-bd20-603351b4a34e req-90176fa1-7cfb-4bb6-befd-606df15c91bb service nova] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Received event network-vif-deleted-dffb12c9-41c5-480c-bb0f-f2a3fab03b8c {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:08:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-15286889-be7f-42eb-bb58-407fd8325b27 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:08:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-15286889-be7f-42eb-bb58-407fd8325b27 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:08:24 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-15286889-be7f-42eb-bb58-407fd8325b27 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:08:24 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-15286889-be7f-42eb-bb58-407fd8325b27 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:08:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-15286889-be7f-42eb-bb58-407fd8325b27 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:08:24 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-15286889-be7f-42eb-bb58-407fd8325b27 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Deleted allocations for instance 17b25747-b89d-43f0-a28a-afcf40d35e70
Nov 02 02:08:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-15286889-be7f-42eb-bb58-407fd8325b27 tempest-SnapshotDataIntegrityTests-1802508939 tempest-SnapshotDataIntegrityTests-1802508939-project-member] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.355s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:08:24 user nova-compute[74996]: DEBUG nova.compute.manager [req-0b3931b6-7cb2-43f2-bb7b-3872dcd79fa5 req-cec9fe0c-b88a-49a5-a41d-490d4f68a64b service nova] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Received event network-vif-plugged-dffb12c9-41c5-480c-bb0f-f2a3fab03b8c {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:08:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0b3931b6-7cb2-43f2-bb7b-3872dcd79fa5 req-cec9fe0c-b88a-49a5-a41d-490d4f68a64b service nova] Acquiring lock "17b25747-b89d-43f0-a28a-afcf40d35e70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:08:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0b3931b6-7cb2-43f2-bb7b-3872dcd79fa5 req-cec9fe0c-b88a-49a5-a41d-490d4f68a64b service nova] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:08:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0b3931b6-7cb2-43f2-bb7b-3872dcd79fa5 req-cec9fe0c-b88a-49a5-a41d-490d4f68a64b service nova] Lock "17b25747-b89d-43f0-a28a-afcf40d35e70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:08:24 user nova-compute[74996]: DEBUG nova.compute.manager [req-0b3931b6-7cb2-43f2-bb7b-3872dcd79fa5 req-cec9fe0c-b88a-49a5-a41d-490d4f68a64b service nova] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] No waiting events found dispatching network-vif-plugged-dffb12c9-41c5-480c-bb0f-f2a3fab03b8c {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:08:24 user nova-compute[74996]: WARNING nova.compute.manager [req-0b3931b6-7cb2-43f2-bb7b-3872dcd79fa5 req-cec9fe0c-b88a-49a5-a41d-490d4f68a64b service nova] [instance: 17b25747-b89d-43f0-a28a-afcf40d35e70] Received unexpected event network-vif-plugged-dffb12c9-41c5-480c-bb0f-f2a3fab03b8c for instance with vm_state deleted and task_state None.
Nov 02 02:08:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:08:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:08:26 user nova-compute[74996]: INFO nova.compute.manager [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Detaching volume d864c413-1bfb-4383-bc1a-8e5d8a5728db
Nov 02 02:08:26 user nova-compute[74996]: INFO nova.virt.block_device [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Attempting to driver detach volume d864c413-1bfb-4383-bc1a-8e5d8a5728db from mountpoint /dev/vdb
Nov 02 02:08:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Attempting to detach device vdb from instance 04bbae43-881f-455a-bcd2-c1be2e82f0dc from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 02:08:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 02:08:26 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:08:26 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 02:08:26 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:08:26 user nova-compute[74996]:   <serial>d864c413-1bfb-4383-bc1a-8e5d8a5728db</serial>
Nov 02 02:08:26 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 02:08:26 user nova-compute[74996]: </disk>
Nov 02 02:08:26 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 02:08:26 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Successfully detached device vdb from instance 04bbae43-881f-455a-bcd2-c1be2e82f0dc from the persistent domain config.
Nov 02 02:08:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 04bbae43-881f-455a-bcd2-c1be2e82f0dc from the live domain config. {{(pid=74996) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 02:08:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 02:08:26 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:08:26 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 02:08:26 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:08:26 user nova-compute[74996]:   <serial>d864c413-1bfb-4383-bc1a-8e5d8a5728db</serial>
Nov 02 02:08:26 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 02 02:08:26 user nova-compute[74996]: </disk>
Nov 02 02:08:26 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 02:08:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 04bbae43-881f-455a-bcd2-c1be2e82f0dc {{(pid=74996) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 02:08:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:39 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:08:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:08:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:08:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:08:39 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 02:08:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:08:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:08:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:08:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:08:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:08:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:08:39 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:08:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:08:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a6472bf-1254-4255-b887-5ea38a2bd96e/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:08:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a6472bf-1254-4255-b887-5ea38a2bd96e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:08:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a6472bf-1254-4255-b887-5ea38a2bd96e/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:08:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a6472bf-1254-4255-b887-5ea38a2bd96e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:08:40 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:08:40 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:08:40 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8573MB free_disk=24.93097686767578GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 02:08:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:08:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:08:41 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 04bbae43-881f-455a-bcd2-c1be2e82f0dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:08:41 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance f4dbbf62-95bd-47e7-bbf1-16e143746a45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:08:41 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 9a6472bf-1254-4255-b887-5ea38a2bd96e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:08:41 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 02:08:41 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 02:08:41 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:08:41 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:08:41 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 02:08:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.275s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:08:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:42 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:08:42 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:08:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:43 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:08:45 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Rebuilding the list of instances to heal {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-04bbae43-881f-455a-bcd2-c1be2e82f0dc" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-04bbae43-881f-455a-bcd2-c1be2e82f0dc" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG nova.objects.instance [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lazy-loading 'info_cache' on Instance uuid 04bbae43-881f-455a-bcd2-c1be2e82f0dc {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Updating instance_info_cache with network_info: [{"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-04bbae43-881f-455a-bcd2-c1be2e82f0dc" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 02:08:46 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 04bbae43-881f-455a-bcd2-c1be2e82f0dc is timed out.
Nov 02 02:08:46 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Successfully detached device vdb from instance 04bbae43-881f-455a-bcd2-c1be2e82f0dc from the live domain config.
Nov 02 02:08:46 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dmLOMViX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:08:46 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:08:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33599e5-1876-4b0d-b5b2-4f9506fb534e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 02:08:46 user nova-compute[74996]: No targets found.
Nov 02 02:08:46 user nova-compute[74996]: iSNS:
Nov 02 02:08:46 user nova-compute[74996]: No targets found.
Nov 02 02:08:46 user nova-compute[74996]: STATIC:
Nov 02 02:08:46 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db
Nov 02 02:08:46 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 02:08:46 user nova-compute[74996]:                 Iface Name: default
Nov 02 02:08:46 user nova-compute[74996]: FIRMWARE:
Nov 02 02:08:46 user nova-compute[74996]: No targets found.
Nov 02 02:08:46 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 02:08:46 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 02:08:46 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ede799-2bb5-4988-9e28-fdf66e33245e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2577a048-7750-450e-bbbf-55ed4afeafb1]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)
Nov 02 02:08:46 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db (non-flash)
Nov 02 02:08:46 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830c416680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db'): ({'sdb'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Removing single pathed devices sdb {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3ae103-4664-4ae1-8d00-46660fb06a6e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c16789-cd69-4146-ba05-c8fb7121821a]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Flushing IO for device /dev/sdb {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a15df5-4c9d-40bc-831f-8b29c3643e79]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.064s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2f6be0-b30d-4b6b-8ff0-3ebc15c01534]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 02:08:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:08:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:08:47 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a699ae30-fee7-450c-9c33-18cf95d6bea2]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:08:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:08:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:08:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:08:47 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe30cf9-6a29-441f-b5f1-bb1efb98d2ab]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:08:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db, portal: 172.16.0.220,3260]
Nov 02 02:08:47 user nova-compute[74996]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db, portal: 172.16.0.220,3260] successful.
Nov 02 02:08:47 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:08:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:08:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d864c413-1bfb-4383-bc1a-8e5d8a5728db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:08:47 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b127ef-84c7-45ae-aa05-1aa77f0f59f1]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:08:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:08:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:08:47 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] <== disconnect_volume: return (311ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:08:47 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 02:08:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:48 user nova-compute[74996]: DEBUG nova.objects.instance [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'flavor' on Instance uuid 04bbae43-881f-455a-bcd2-c1be2e82f0dc {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:08:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d0aa689b-1998-4341-88b2-6bb8888c25ea tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.867s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:08:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c4e616f6-01a1-4b37-98bc-cf188c226228 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:08:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c4e616f6-01a1-4b37-98bc-cf188c226228 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:08:48 user nova-compute[74996]: DEBUG nova.compute.manager [None req-c4e616f6-01a1-4b37-98bc-cf188c226228 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 02:08:48 user nova-compute[74996]: DEBUG nova.compute.manager [None req-c4e616f6-01a1-4b37-98bc-cf188c226228 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74996) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 02 02:08:48 user nova-compute[74996]: DEBUG nova.objects.instance [None req-c4e616f6-01a1-4b37-98bc-cf188c226228 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'flavor' on Instance uuid 04bbae43-881f-455a-bcd2-c1be2e82f0dc {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:08:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:49 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:08:49 user nova-compute[74996]: DEBUG nova.compute.manager [req-0785eced-1041-4dc7-9006-1f8c402d1279 req-a358925e-2ba2-4431-b96d-3aef5dd51d8d service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Received event network-vif-unplugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:08:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0785eced-1041-4dc7-9006-1f8c402d1279 req-a358925e-2ba2-4431-b96d-3aef5dd51d8d service nova] Acquiring lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:08:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0785eced-1041-4dc7-9006-1f8c402d1279 req-a358925e-2ba2-4431-b96d-3aef5dd51d8d service nova] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:08:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0785eced-1041-4dc7-9006-1f8c402d1279 req-a358925e-2ba2-4431-b96d-3aef5dd51d8d service nova] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:08:49 user nova-compute[74996]: DEBUG nova.compute.manager [req-0785eced-1041-4dc7-9006-1f8c402d1279 req-a358925e-2ba2-4431-b96d-3aef5dd51d8d service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] No waiting events found dispatching network-vif-unplugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:08:49 user nova-compute[74996]: WARNING nova.compute.manager [req-0785eced-1041-4dc7-9006-1f8c402d1279 req-a358925e-2ba2-4431-b96d-3aef5dd51d8d service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Received unexpected event network-vif-unplugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 for instance with vm_state active and task_state powering-off.
Nov 02 02:08:49 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Instance destroyed successfully.
Nov 02 02:08:49 user nova-compute[74996]: DEBUG nova.compute.manager [None req-c4e616f6-01a1-4b37-98bc-cf188c226228 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 02:08:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c4e616f6-01a1-4b37-98bc-cf188c226228 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.830s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:08:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:51 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:08:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-720aeb5a-99fa-4a50-b2fb-ca59264f5043 req-dae498bc-56cd-4669-99fd-4761c4fddd2d service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Received event network-vif-plugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:08:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-720aeb5a-99fa-4a50-b2fb-ca59264f5043 req-dae498bc-56cd-4669-99fd-4761c4fddd2d service nova] Acquiring lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:08:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-720aeb5a-99fa-4a50-b2fb-ca59264f5043 req-dae498bc-56cd-4669-99fd-4761c4fddd2d service nova] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:08:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-720aeb5a-99fa-4a50-b2fb-ca59264f5043 req-dae498bc-56cd-4669-99fd-4761c4fddd2d service nova] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:08:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-720aeb5a-99fa-4a50-b2fb-ca59264f5043 req-dae498bc-56cd-4669-99fd-4761c4fddd2d service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] No waiting events found dispatching network-vif-plugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:08:51 user nova-compute[74996]: WARNING nova.compute.manager [req-720aeb5a-99fa-4a50-b2fb-ca59264f5043 req-dae498bc-56cd-4669-99fd-4761c4fddd2d service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Received unexpected event network-vif-plugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 for instance with vm_state stopped and task_state None.
Nov 02 02:08:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:08:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:08:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:08:59 user nova-compute[74996]: DEBUG nova.compute.manager [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 02:08:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:08:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:08:59 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 02:08:59 user nova-compute[74996]: INFO nova.compute.claims [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Claim successful on node user
Nov 02 02:08:59 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:08:59 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:09:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:09:00 user nova-compute[74996]: DEBUG nova.compute.manager [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 02:09:00 user nova-compute[74996]: DEBUG nova.compute.manager [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 02:09:00 user nova-compute[74996]: DEBUG nova.network.neutron [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 02:09:00 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 02:09:00 user nova-compute[74996]: DEBUG nova.compute.manager [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 02:09:00 user nova-compute[74996]: DEBUG nova.policy [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '832530cd183e4944994e8032ac37c621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7cdc1a0ba64a25821d5c99b20de231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 02:09:00 user nova-compute[74996]: DEBUG nova.compute.manager [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 02:09:00 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 02:09:00 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Creating image(s)
Nov 02 02:09:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "/opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:09:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "/opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:09:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "/opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:09:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:09:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.173s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:09:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:09:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:09:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:09:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:09:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:09:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk 1073741824" returned: 0 in 0.050s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:09:00 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:09:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:09:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.176s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:09:00 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 02:09:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:09:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:09:01 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Cannot resize image /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 02:09:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 02:09:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Ensure instance console log exists: /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 02:09:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:09:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:09:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:09:01 user nova-compute[74996]: DEBUG nova.network.neutron [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Successfully created port: 181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 02:09:01 user nova-compute[74996]: DEBUG nova.network.neutron [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Successfully updated port: 181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 02:09:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "refresh_cache-3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:09:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquired lock "refresh_cache-3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:09:01 user nova-compute[74996]: DEBUG nova.network.neutron [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 02:09:01 user nova-compute[74996]: DEBUG nova.compute.manager [req-29515d37-b0dc-4506-87e2-84743f44aba2 req-2923930b-73aa-413a-a812-6d6ab084fa9d service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Received event network-changed-181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:09:01 user nova-compute[74996]: DEBUG nova.compute.manager [req-29515d37-b0dc-4506-87e2-84743f44aba2 req-2923930b-73aa-413a-a812-6d6ab084fa9d service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Refreshing instance network info cache due to event network-changed-181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 02:09:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-29515d37-b0dc-4506-87e2-84743f44aba2 req-2923930b-73aa-413a-a812-6d6ab084fa9d service nova] Acquiring lock "refresh_cache-3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:09:01 user nova-compute[74996]: DEBUG nova.network.neutron [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.network.neutron [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Updating instance_info_cache with network_info: [{"id": "181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1", "address": "fa:16:3e:9b:6d:bc", "network": {"id": "3578933b-907b-439c-92d0-4311826a0163", "bridge": "br-int", "label": "tempest-TestStampPattern-1622075405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7cdc1a0ba64a25821d5c99b20de231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181e7d4d-be", "ovs_interfaceid": "181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Releasing lock "refresh_cache-3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.compute.manager [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Instance network_info: |[{"id": "181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1", "address": "fa:16:3e:9b:6d:bc", "network": {"id": "3578933b-907b-439c-92d0-4311826a0163", "bridge": "br-int", "label": "tempest-TestStampPattern-1622075405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7cdc1a0ba64a25821d5c99b20de231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181e7d4d-be", "ovs_interfaceid": "181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-29515d37-b0dc-4506-87e2-84743f44aba2 req-2923930b-73aa-413a-a812-6d6ab084fa9d service nova] Acquired lock "refresh_cache-3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.network.neutron [req-29515d37-b0dc-4506-87e2-84743f44aba2 req-2923930b-73aa-413a-a812-6d6ab084fa9d service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Refreshing network info cache for port 181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Start _get_guest_xml network_info=[{"id": "181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1", "address": "fa:16:3e:9b:6d:bc", "network": {"id": "3578933b-907b-439c-92d0-4311826a0163", "bridge": "br-int", "label": "tempest-TestStampPattern-1622075405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7cdc1a0ba64a25821d5c99b20de231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181e7d4d-be", "ovs_interfaceid": "181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 02:09:02 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:09:02 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:08:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1171162396',display_name='tempest-TestStampPattern-server-1171162396',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1171162396',id=48,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKJHuw6Qr4/PNCfq6n+9tvXVKbxGaOJVnul0YErELd6vC57iiAiOyevzzMq1POKS4qzqhx+V78eYjcL2zfkyulhd6D3nM2HSkapGvB1Xf65v7OsTXK2YbtKtdN7HwXQcw==',key_name='tempest-TestStampPattern-1523316715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d7cdc1a0ba64a25821d5c99b20de231',ramdisk_id='',reservation_id='r-ol0uqehs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-856812097',owner_user_name='tempest-TestStampPattern-856812097-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T02:09:00Z,user_data=None,user_id='832530cd183e4944994e8032ac37c621',uuid=3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1", "address": "fa:16:3e:9b:6d:bc", "network": {"id": "3578933b-907b-439c-92d0-4311826a0163", "bridge": "br-int", "label": "tempest-TestStampPattern-1622075405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7cdc1a0ba64a25821d5c99b20de231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181e7d4d-be", "ovs_interfaceid": "181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Converting VIF {"id": "181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1", "address": "fa:16:3e:9b:6d:bc", "network": {"id": "3578933b-907b-439c-92d0-4311826a0163", "bridge": "br-int", "label": "tempest-TestStampPattern-1622075405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7cdc1a0ba64a25821d5c99b20de231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181e7d4d-be", "ovs_interfaceid": "181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:6d:bc,bridge_name='br-int',has_traffic_filtering=True,id=181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1,network=Network(3578933b-907b-439c-92d0-4311826a0163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181e7d4d-be') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.objects.instance [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lazy-loading 'pci_devices' on Instance uuid 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] End _get_guest_xml xml=<domain type="kvm">
Nov 02 02:09:02 user nova-compute[74996]:   <uuid>3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa</uuid>
Nov 02 02:09:02 user nova-compute[74996]:   <name>instance-00000030</name>
Nov 02 02:09:02 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 02:09:02 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 02:09:02 user nova-compute[74996]:   <metadata>
Nov 02 02:09:02 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 02:09:02 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 02:09:02 user nova-compute[74996]:       <nova:name>tempest-TestStampPattern-server-1171162396</nova:name>
Nov 02 02:09:02 user nova-compute[74996]:       <nova:creationTime>2023-11-02 02:09:02</nova:creationTime>
Nov 02 02:09:02 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 02:09:02 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 02:09:02 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 02:09:02 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 02:09:02 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 02:09:02 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 02:09:02 user nova-compute[74996]:       </nova:flavor>
Nov 02 02:09:02 user nova-compute[74996]:       <nova:owner>
Nov 02 02:09:02 user nova-compute[74996]:         <nova:user uuid="832530cd183e4944994e8032ac37c621">tempest-TestStampPattern-856812097-project-member</nova:user>
Nov 02 02:09:02 user nova-compute[74996]:         <nova:project uuid="0d7cdc1a0ba64a25821d5c99b20de231">tempest-TestStampPattern-856812097</nova:project>
Nov 02 02:09:02 user nova-compute[74996]:       </nova:owner>
Nov 02 02:09:02 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 02:09:02 user nova-compute[74996]:       <nova:ports>
Nov 02 02:09:02 user nova-compute[74996]:         <nova:port uuid="181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1">
Nov 02 02:09:02 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 02 02:09:02 user nova-compute[74996]:         </nova:port>
Nov 02 02:09:02 user nova-compute[74996]:       </nova:ports>
Nov 02 02:09:02 user nova-compute[74996]:     </nova:instance>
Nov 02 02:09:02 user nova-compute[74996]:   </metadata>
Nov 02 02:09:02 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 02:09:02 user nova-compute[74996]:     <system>
Nov 02 02:09:02 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 02:09:02 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 02:09:02 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 02:09:02 user nova-compute[74996]:       <entry name="serial">3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa</entry>
Nov 02 02:09:02 user nova-compute[74996]:       <entry name="uuid">3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa</entry>
Nov 02 02:09:02 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 02:09:02 user nova-compute[74996]:     </system>
Nov 02 02:09:02 user nova-compute[74996]:   </sysinfo>
Nov 02 02:09:02 user nova-compute[74996]:   <os>
Nov 02 02:09:02 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 02:09:02 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 02:09:02 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 02:09:02 user nova-compute[74996]:   </os>
Nov 02 02:09:02 user nova-compute[74996]:   <features>
Nov 02 02:09:02 user nova-compute[74996]:     <acpi/>
Nov 02 02:09:02 user nova-compute[74996]:     <apic/>
Nov 02 02:09:02 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 02:09:02 user nova-compute[74996]:   </features>
Nov 02 02:09:02 user nova-compute[74996]:   <clock offset="utc">
Nov 02 02:09:02 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 02:09:02 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 02:09:02 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 02:09:02 user nova-compute[74996]:   </clock>
Nov 02 02:09:02 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 02:09:02 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 02:09:02 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 02:09:02 user nova-compute[74996]:   </cpu>
Nov 02 02:09:02 user nova-compute[74996]:   <devices>
Nov 02 02:09:02 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 02:09:02 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 02:09:02 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk"/>
Nov 02 02:09:02 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 02:09:02 user nova-compute[74996]:     </disk>
Nov 02 02:09:02 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 02:09:02 user nova-compute[74996]:       <mac address="fa:16:3e:9b:6d:bc"/>
Nov 02 02:09:02 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 02:09:02 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 02:09:02 user nova-compute[74996]:       <target dev="tap181e7d4d-be"/>
Nov 02 02:09:02 user nova-compute[74996]:     </interface>
Nov 02 02:09:02 user nova-compute[74996]:     <serial type="pty">
Nov 02 02:09:02 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/console.log" append="off"/>
Nov 02 02:09:02 user nova-compute[74996]:     </serial>
Nov 02 02:09:02 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 02:09:02 user nova-compute[74996]:     <video>
Nov 02 02:09:02 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 02:09:02 user nova-compute[74996]:     </video>
Nov 02 02:09:02 user nova-compute[74996]:     <rng model="virtio">
Nov 02 02:09:02 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 02:09:02 user nova-compute[74996]:     </rng>
Nov 02 02:09:02 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 02:09:02 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 02:09:02 user nova-compute[74996]:       <stats period="10"/>
Nov 02 02:09:02 user nova-compute[74996]:     </memballoon>
Nov 02 02:09:02 user nova-compute[74996]:   </devices>
Nov 02 02:09:02 user nova-compute[74996]: </domain>
Nov 02 02:09:02 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:08:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1171162396',display_name='tempest-TestStampPattern-server-1171162396',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1171162396',id=48,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKJHuw6Qr4/PNCfq6n+9tvXVKbxGaOJVnul0YErELd6vC57iiAiOyevzzMq1POKS4qzqhx+V78eYjcL2zfkyulhd6D3nM2HSkapGvB1Xf65v7OsTXK2YbtKtdN7HwXQcw==',key_name='tempest-TestStampPattern-1523316715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d7cdc1a0ba64a25821d5c99b20de231',ramdisk_id='',reservation_id='r-ol0uqehs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-856812097',owner_user_name='tempest-TestStampPattern-856812097-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T02:09:00Z,user_data=None,user_id='832530cd183e4944994e8032ac37c621',uuid=3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1", "address": "fa:16:3e:9b:6d:bc", "network": {"id": "3578933b-907b-439c-92d0-4311826a0163", "bridge": "br-int", "label": "tempest-TestStampPattern-1622075405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7cdc1a0ba64a25821d5c99b20de231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181e7d4d-be", "ovs_interfaceid": "181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Converting VIF {"id": "181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1", "address": "fa:16:3e:9b:6d:bc", "network": {"id": "3578933b-907b-439c-92d0-4311826a0163", "bridge": "br-int", "label": "tempest-TestStampPattern-1622075405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7cdc1a0ba64a25821d5c99b20de231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181e7d4d-be", "ovs_interfaceid": "181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:6d:bc,bridge_name='br-int',has_traffic_filtering=True,id=181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1,network=Network(3578933b-907b-439c-92d0-4311826a0163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181e7d4d-be') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG os_vif [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:6d:bc,bridge_name='br-int',has_traffic_filtering=True,id=181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1,network=Network(3578933b-907b-439c-92d0-4311826a0163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181e7d4d-be') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eda47dde-f748-5cac-9ebc-243ea64c1835', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap181e7d4d-be, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap181e7d4d-be, col_values=(('qos', UUID('10e19a19-e003-4f68-87a0-691c9a94a318')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap181e7d4d-be, col_values=(('external_ids', {'iface-id': '181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:6d:bc', 'vm-uuid': '3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:02 user nova-compute[74996]: INFO os_vif [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:6d:bc,bridge_name='br-int',has_traffic_filtering=True,id=181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1,network=Network(3578933b-907b-439c-92d0-4311826a0163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181e7d4d-be')
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] No VIF found with MAC fa:16:3e:9b:6d:bc, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.network.neutron [req-29515d37-b0dc-4506-87e2-84743f44aba2 req-2923930b-73aa-413a-a812-6d6ab084fa9d service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Updated VIF entry in instance network info cache for port 181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG nova.network.neutron [req-29515d37-b0dc-4506-87e2-84743f44aba2 req-2923930b-73aa-413a-a812-6d6ab084fa9d service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Updating instance_info_cache with network_info: [{"id": "181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1", "address": "fa:16:3e:9b:6d:bc", "network": {"id": "3578933b-907b-439c-92d0-4311826a0163", "bridge": "br-int", "label": "tempest-TestStampPattern-1622075405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7cdc1a0ba64a25821d5c99b20de231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181e7d4d-be", "ovs_interfaceid": "181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:09:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-29515d37-b0dc-4506-87e2-84743f44aba2 req-2923930b-73aa-413a-a812-6d6ab084fa9d service nova] Releasing lock "refresh_cache-3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:09:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:03 user nova-compute[74996]: DEBUG nova.compute.manager [req-5e775fbc-9d6e-49b5-8458-a60a98b4a540 req-4c58cdb3-0916-41f2-b8db-824500f7fb4c service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Received event network-vif-plugged-181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:09:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5e775fbc-9d6e-49b5-8458-a60a98b4a540 req-4c58cdb3-0916-41f2-b8db-824500f7fb4c service nova] Acquiring lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:09:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5e775fbc-9d6e-49b5-8458-a60a98b4a540 req-4c58cdb3-0916-41f2-b8db-824500f7fb4c service nova] Lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:09:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5e775fbc-9d6e-49b5-8458-a60a98b4a540 req-4c58cdb3-0916-41f2-b8db-824500f7fb4c service nova] Lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:09:03 user nova-compute[74996]: DEBUG nova.compute.manager [req-5e775fbc-9d6e-49b5-8458-a60a98b4a540 req-4c58cdb3-0916-41f2-b8db-824500f7fb4c service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] No waiting events found dispatching network-vif-plugged-181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:09:03 user nova-compute[74996]: WARNING nova.compute.manager [req-5e775fbc-9d6e-49b5-8458-a60a98b4a540 req-4c58cdb3-0916-41f2-b8db-824500f7fb4c service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Received unexpected event network-vif-plugged-181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1 for instance with vm_state building and task_state spawning.
Nov 02 02:09:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:05 user nova-compute[74996]: DEBUG nova.compute.manager [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 02:09:05 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 02:09:05 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Instance spawned successfully.
Nov 02 02:09:05 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 02:09:05 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:09:05 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:09:05 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:09:05 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:09:05 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:09:05 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:09:05 user nova-compute[74996]: INFO nova.compute.manager [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Took 5.64 seconds to spawn the instance on the hypervisor.
Nov 02 02:09:05 user nova-compute[74996]: DEBUG nova.compute.manager [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 02:09:05 user nova-compute[74996]: INFO nova.compute.manager [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Took 6.32 seconds to build instance.
Nov 02 02:09:05 user nova-compute[74996]: DEBUG nova.compute.manager [req-a5677c1d-4b04-461c-90fd-5ae506d595cf req-ecdfa388-9a7b-4592-8b91-31928b183df7 service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Received event network-vif-plugged-181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:09:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a5677c1d-4b04-461c-90fd-5ae506d595cf req-ecdfa388-9a7b-4592-8b91-31928b183df7 service nova] Acquiring lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:09:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a5677c1d-4b04-461c-90fd-5ae506d595cf req-ecdfa388-9a7b-4592-8b91-31928b183df7 service nova] Lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:09:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a5677c1d-4b04-461c-90fd-5ae506d595cf req-ecdfa388-9a7b-4592-8b91-31928b183df7 service nova] Lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:09:05 user nova-compute[74996]: DEBUG nova.compute.manager [req-a5677c1d-4b04-461c-90fd-5ae506d595cf req-ecdfa388-9a7b-4592-8b91-31928b183df7 service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] No waiting events found dispatching network-vif-plugged-181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:09:05 user nova-compute[74996]: WARNING nova.compute.manager [req-a5677c1d-4b04-461c-90fd-5ae506d595cf req-ecdfa388-9a7b-4592-8b91-31928b183df7 service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Received unexpected event network-vif-plugged-181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1 for instance with vm_state active and task_state None.
Nov 02 02:09:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-420a489f-f7be-45a3-84bb-c356650c03a4 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.410s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:09:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cbc2c4c6-5483-45cb-867a-e71bcc15f9d7 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Acquiring lock "9a6472bf-1254-4255-b887-5ea38a2bd96e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cbc2c4c6-5483-45cb-867a-e71bcc15f9d7 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "9a6472bf-1254-4255-b887-5ea38a2bd96e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cbc2c4c6-5483-45cb-867a-e71bcc15f9d7 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Acquiring lock "9a6472bf-1254-4255-b887-5ea38a2bd96e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cbc2c4c6-5483-45cb-867a-e71bcc15f9d7 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "9a6472bf-1254-4255-b887-5ea38a2bd96e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cbc2c4c6-5483-45cb-867a-e71bcc15f9d7 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "9a6472bf-1254-4255-b887-5ea38a2bd96e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:09:14 user nova-compute[74996]: INFO nova.compute.manager [None req-cbc2c4c6-5483-45cb-867a-e71bcc15f9d7 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Terminating instance
Nov 02 02:09:14 user nova-compute[74996]: DEBUG nova.compute.manager [None req-cbc2c4c6-5483-45cb-867a-e71bcc15f9d7 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG nova.compute.manager [req-c333f52b-aa94-4f40-b1e3-b92532fbf777 req-1d3338fe-f797-404d-a7fe-e175ac3afbeb service nova] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Received event network-vif-unplugged-1d784007-9222-4c4e-9927-477e51e17327 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c333f52b-aa94-4f40-b1e3-b92532fbf777 req-1d3338fe-f797-404d-a7fe-e175ac3afbeb service nova] Acquiring lock "9a6472bf-1254-4255-b887-5ea38a2bd96e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c333f52b-aa94-4f40-b1e3-b92532fbf777 req-1d3338fe-f797-404d-a7fe-e175ac3afbeb service nova] Lock "9a6472bf-1254-4255-b887-5ea38a2bd96e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-c333f52b-aa94-4f40-b1e3-b92532fbf777 req-1d3338fe-f797-404d-a7fe-e175ac3afbeb service nova] Lock "9a6472bf-1254-4255-b887-5ea38a2bd96e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG nova.compute.manager [req-c333f52b-aa94-4f40-b1e3-b92532fbf777 req-1d3338fe-f797-404d-a7fe-e175ac3afbeb service nova] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] No waiting events found dispatching network-vif-unplugged-1d784007-9222-4c4e-9927-477e51e17327 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG nova.compute.manager [req-c333f52b-aa94-4f40-b1e3-b92532fbf777 req-1d3338fe-f797-404d-a7fe-e175ac3afbeb service nova] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Received event network-vif-unplugged-1d784007-9222-4c4e-9927-477e51e17327 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:14 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Instance destroyed successfully.
Nov 02 02:09:14 user nova-compute[74996]: DEBUG nova.objects.instance [None req-cbc2c4c6-5483-45cb-867a-e71bcc15f9d7 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lazy-loading 'resources' on Instance uuid 9a6472bf-1254-4255-b887-5ea38a2bd96e {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-cbc2c4c6-5483-45cb-867a-e71bcc15f9d7 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-106498995',display_name='tempest-ServersNegativeTestJSON-server-106498995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-106498995',id=47,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T02:07:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c4de34aca164d5abbff0ff11b44762b',ramdisk_id='',reservation_id='r-m5i2byfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-235429949',owner_user_name='tempest-ServersNegativeTestJSON-235429949-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T02:07:30Z,user_data=None,user_id='d189b000f4cd4c9cb835abd85b9180f1',uuid=9a6472bf-1254-4255-b887-5ea38a2bd96e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d784007-9222-4c4e-9927-477e51e17327", "address": "fa:16:3e:a4:ec:14", "network": {"id": "76ec976d-a10a-4c58-8b3c-7db507c2bcd5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1016707767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c4de34aca164d5abbff0ff11b44762b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d784007-92", "ovs_interfaceid": "1d784007-9222-4c4e-9927-477e51e17327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-cbc2c4c6-5483-45cb-867a-e71bcc15f9d7 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Converting VIF {"id": "1d784007-9222-4c4e-9927-477e51e17327", "address": "fa:16:3e:a4:ec:14", "network": {"id": "76ec976d-a10a-4c58-8b3c-7db507c2bcd5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1016707767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c4de34aca164d5abbff0ff11b44762b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d784007-92", "ovs_interfaceid": "1d784007-9222-4c4e-9927-477e51e17327", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-cbc2c4c6-5483-45cb-867a-e71bcc15f9d7 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:ec:14,bridge_name='br-int',has_traffic_filtering=True,id=1d784007-9222-4c4e-9927-477e51e17327,network=Network(76ec976d-a10a-4c58-8b3c-7db507c2bcd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d784007-92') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG os_vif [None req-cbc2c4c6-5483-45cb-867a-e71bcc15f9d7 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:ec:14,bridge_name='br-int',has_traffic_filtering=True,id=1d784007-9222-4c4e-9927-477e51e17327,network=Network(76ec976d-a10a-4c58-8b3c-7db507c2bcd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d784007-92') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d784007-92, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46a2bc16-17ef-4f26-88f8-fd65101b6551) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:14 user nova-compute[74996]: INFO os_vif [None req-cbc2c4c6-5483-45cb-867a-e71bcc15f9d7 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:ec:14,bridge_name='br-int',has_traffic_filtering=True,id=1d784007-9222-4c4e-9927-477e51e17327,network=Network(76ec976d-a10a-4c58-8b3c-7db507c2bcd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d784007-92')
Nov 02 02:09:14 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-cbc2c4c6-5483-45cb-867a-e71bcc15f9d7 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Deleting instance files /opt/stack/data/nova/instances/9a6472bf-1254-4255-b887-5ea38a2bd96e_del
Nov 02 02:09:14 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-cbc2c4c6-5483-45cb-867a-e71bcc15f9d7 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Deletion of /opt/stack/data/nova/instances/9a6472bf-1254-4255-b887-5ea38a2bd96e_del complete
Nov 02 02:09:14 user nova-compute[74996]: INFO nova.compute.manager [None req-cbc2c4c6-5483-45cb-867a-e71bcc15f9d7 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 02 02:09:14 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-cbc2c4c6-5483-45cb-867a-e71bcc15f9d7 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 02:09:14 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 02:09:15 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:09:15 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Took 0.85 seconds to deallocate network for instance.
Nov 02 02:09:15 user nova-compute[74996]: DEBUG nova.compute.manager [req-66a96f31-7fd0-40d5-b12d-c199a281ac5e req-104771be-9001-4797-b4f6-09e6b1320f61 service nova] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Received event network-vif-deleted-1d784007-9222-4c4e-9927-477e51e17327 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:09:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cbc2c4c6-5483-45cb-867a-e71bcc15f9d7 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:09:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cbc2c4c6-5483-45cb-867a-e71bcc15f9d7 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:09:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:15 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-cbc2c4c6-5483-45cb-867a-e71bcc15f9d7 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:09:15 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-cbc2c4c6-5483-45cb-867a-e71bcc15f9d7 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:09:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cbc2c4c6-5483-45cb-867a-e71bcc15f9d7 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:09:16 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-cbc2c4c6-5483-45cb-867a-e71bcc15f9d7 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Deleted allocations for instance 9a6472bf-1254-4255-b887-5ea38a2bd96e
Nov 02 02:09:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-cbc2c4c6-5483-45cb-867a-e71bcc15f9d7 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "9a6472bf-1254-4255-b887-5ea38a2bd96e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.957s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:09:16 user nova-compute[74996]: DEBUG nova.compute.manager [req-24b8bcd2-5027-43ef-b83b-d594ea851ab4 req-56fa1cb3-36ae-4a18-8ea2-1d36e02ad6fa service nova] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Received event network-vif-plugged-1d784007-9222-4c4e-9927-477e51e17327 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:09:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-24b8bcd2-5027-43ef-b83b-d594ea851ab4 req-56fa1cb3-36ae-4a18-8ea2-1d36e02ad6fa service nova] Acquiring lock "9a6472bf-1254-4255-b887-5ea38a2bd96e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:09:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-24b8bcd2-5027-43ef-b83b-d594ea851ab4 req-56fa1cb3-36ae-4a18-8ea2-1d36e02ad6fa service nova] Lock "9a6472bf-1254-4255-b887-5ea38a2bd96e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:09:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-24b8bcd2-5027-43ef-b83b-d594ea851ab4 req-56fa1cb3-36ae-4a18-8ea2-1d36e02ad6fa service nova] Lock "9a6472bf-1254-4255-b887-5ea38a2bd96e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:09:16 user nova-compute[74996]: DEBUG nova.compute.manager [req-24b8bcd2-5027-43ef-b83b-d594ea851ab4 req-56fa1cb3-36ae-4a18-8ea2-1d36e02ad6fa service nova] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] No waiting events found dispatching network-vif-plugged-1d784007-9222-4c4e-9927-477e51e17327 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:09:16 user nova-compute[74996]: WARNING nova.compute.manager [req-24b8bcd2-5027-43ef-b83b-d594ea851ab4 req-56fa1cb3-36ae-4a18-8ea2-1d36e02ad6fa service nova] [instance: 9a6472bf-1254-4255-b887-5ea38a2bd96e] Received unexpected event network-vif-plugged-1d784007-9222-4c4e-9927-477e51e17327 for instance with vm_state deleted and task_state None.
Nov 02 02:09:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:09:41 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:09:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:09:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:09:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:09:41 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 02:09:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:09:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:09:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:09:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:09:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:09:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:09:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:09:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:09:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:09:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:09:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:09:42 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:09:42 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:09:42 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:09:42 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8732MB free_disk=24.92696762084961GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 02:09:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:09:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:09:42 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 04bbae43-881f-455a-bcd2-c1be2e82f0dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:09:42 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance f4dbbf62-95bd-47e7-bbf1-16e143746a45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:09:42 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:09:42 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 02:09:42 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 02:09:42 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:09:42 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:09:42 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 02:09:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.249s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:09:43 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:09:44 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:09:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:09:45 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:09:46 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:09:48 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:09:48 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 02:09:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-f4dbbf62-95bd-47e7-bbf1-16e143746a45" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:09:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-f4dbbf62-95bd-47e7-bbf1-16e143746a45" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:09:48 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 02:09:48 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Updating instance_info_cache with network_info: [{"id": "4728343d-18b1-4199-a165-e0e8aa414f2b", "address": "fa:16:3e:3f:81:e4", "network": {"id": "76ec976d-a10a-4c58-8b3c-7db507c2bcd5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1016707767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c4de34aca164d5abbff0ff11b44762b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4728343d-18", "ovs_interfaceid": "4728343d-18b1-4199-a165-e0e8aa414f2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:09:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-f4dbbf62-95bd-47e7-bbf1-16e143746a45" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:09:48 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 02:09:48 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:09:48 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 02:09:49 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:09:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:09:51 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:09:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:09:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:10:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:10:08 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:10:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:10:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:10:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:10:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:10:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:10:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:10:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:10:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:10:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:10:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:10:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:10:39 user nova-compute[74996]: DEBUG nova.objects.instance [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'flavor' on Instance uuid 04bbae43-881f-455a-bcd2-c1be2e82f0dc {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:10:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "refresh_cache-04bbae43-881f-455a-bcd2-c1be2e82f0dc" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:10:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquired lock "refresh_cache-04bbae43-881f-455a-bcd2-c1be2e82f0dc" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:10:39 user nova-compute[74996]: DEBUG nova.network.neutron [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 02:10:39 user nova-compute[74996]: DEBUG nova.objects.instance [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'info_cache' on Instance uuid 04bbae43-881f-455a-bcd2-c1be2e82f0dc {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:10:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:10:39 user nova-compute[74996]: DEBUG nova.objects.base [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Object Instance<04bbae43-881f-455a-bcd2-c1be2e82f0dc> lazy-loaded attributes: flavor,info_cache {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.network.neutron [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Updating instance_info_cache with network_info: [{"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Releasing lock "refresh_cache-04bbae43-881f-455a-bcd2-c1be2e82f0dc" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:10:40 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Instance destroyed successfully.
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.objects.instance [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'resources' on Instance uuid 04bbae43-881f-455a-bcd2-c1be2e82f0dc {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.objects.base [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Object Instance<04bbae43-881f-455a-bcd2-c1be2e82f0dc> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-737287584',display_name='tempest-AttachVolumeTestJSON-server-737287584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-737287584',id=44,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeIW/CNmoj21FtRCsqg1lXO54HxCaIvv1uBUUE6B0bU+AGTCthBvSHQimH9CWWXBX3zHlj6txcR4awRuWt6j/DhBo4E/0517ba1Qrhay/0zFwqi/ch9Lcgb2pyyzhBOxA==',key_name='tempest-keypair-535762259',keypairs=<?>,launch_index=0,launched_at=2023-11-02T02:02:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fee0ae54cb9642e68d847235ebe13875',ramdisk_id='',reservation_id='r-44fx7s8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1064832613',owner_user_name='tempest-AttachVolumeTestJSON-1064832613-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T02:08:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd49c6f202cc46b496df91de55c53c65',uuid=04bbae43-881f-455a-bcd2-c1be2e82f0dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Converting VIF {"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:2c:81,bridge_name='br-int',has_traffic_filtering=True,id=46cdee0a-7249-457f-b3d1-e69a6ed62504,network=Network(699807b0-2588-4e44-967e-e11023d25985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cdee0a-72') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG os_vif [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:2c:81,bridge_name='br-int',has_traffic_filtering=True,id=46cdee0a-7249-457f-b3d1-e69a6ed62504,network=Network(699807b0-2588-4e44-967e-e11023d25985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cdee0a-72') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46cdee0a-72, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a5d2c9e-4839-4a93-aa23-63119659bcc0) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:10:40 user nova-compute[74996]: INFO os_vif [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:2c:81,bridge_name='br-int',has_traffic_filtering=True,id=46cdee0a-7249-457f-b3d1-e69a6ed62504,network=Network(699807b0-2588-4e44-967e-e11023d25985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cdee0a-72')
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Start _get_guest_xml network_info=[{"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.objects.instance [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'numa_topology' on Instance uuid 04bbae43-881f-455a-bcd2-c1be2e82f0dc {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.objects.base [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Object Instance<04bbae43-881f-455a-bcd2-c1be2e82f0dc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 02:10:40 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:10:40 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.objects.instance [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'vcpu_model' on Instance uuid 04bbae43-881f-455a-bcd2-c1be2e82f0dc {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.objects.base [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Object Instance<04bbae43-881f-455a-bcd2-c1be2e82f0dc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-737287584',display_name='tempest-AttachVolumeTestJSON-server-737287584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-737287584',id=44,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeIW/CNmoj21FtRCsqg1lXO54HxCaIvv1uBUUE6B0bU+AGTCthBvSHQimH9CWWXBX3zHlj6txcR4awRuWt6j/DhBo4E/0517ba1Qrhay/0zFwqi/ch9Lcgb2pyyzhBOxA==',key_name='tempest-keypair-535762259',keypairs=<?>,launch_index=0,launched_at=2023-11-02T02:02:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fee0ae54cb9642e68d847235ebe13875',ramdisk_id='',reservation_id='r-44fx7s8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1064832613',owner_user_name='tempest-AttachVolumeTestJSON-1064832613-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T02:08:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd49c6f202cc46b496df91de55c53c65',uuid=04bbae43-881f-455a-bcd2-c1be2e82f0dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Converting VIF {"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:2c:81,bridge_name='br-int',has_traffic_filtering=True,id=46cdee0a-7249-457f-b3d1-e69a6ed62504,network=Network(699807b0-2588-4e44-967e-e11023d25985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cdee0a-72') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.objects.instance [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'pci_devices' on Instance uuid 04bbae43-881f-455a-bcd2-c1be2e82f0dc {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.objects.base [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Object Instance<04bbae43-881f-455a-bcd2-c1be2e82f0dc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] End _get_guest_xml xml=<domain type="kvm">
Nov 02 02:10:40 user nova-compute[74996]:   <uuid>04bbae43-881f-455a-bcd2-c1be2e82f0dc</uuid>
Nov 02 02:10:40 user nova-compute[74996]:   <name>instance-0000002c</name>
Nov 02 02:10:40 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 02:10:40 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 02:10:40 user nova-compute[74996]:   <metadata>
Nov 02 02:10:40 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 02:10:40 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 02:10:40 user nova-compute[74996]:       <nova:name>tempest-AttachVolumeTestJSON-server-737287584</nova:name>
Nov 02 02:10:40 user nova-compute[74996]:       <nova:creationTime>2023-11-02 02:10:40</nova:creationTime>
Nov 02 02:10:40 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 02:10:40 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 02:10:40 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 02:10:40 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 02:10:40 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 02:10:40 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 02:10:40 user nova-compute[74996]:       </nova:flavor>
Nov 02 02:10:40 user nova-compute[74996]:       <nova:owner>
Nov 02 02:10:40 user nova-compute[74996]:         <nova:user uuid="dd49c6f202cc46b496df91de55c53c65">tempest-AttachVolumeTestJSON-1064832613-project-member</nova:user>
Nov 02 02:10:40 user nova-compute[74996]:         <nova:project uuid="fee0ae54cb9642e68d847235ebe13875">tempest-AttachVolumeTestJSON-1064832613</nova:project>
Nov 02 02:10:40 user nova-compute[74996]:       </nova:owner>
Nov 02 02:10:40 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 02:10:40 user nova-compute[74996]:       <nova:ports>
Nov 02 02:10:40 user nova-compute[74996]:         <nova:port uuid="46cdee0a-7249-457f-b3d1-e69a6ed62504">
Nov 02 02:10:40 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 02 02:10:40 user nova-compute[74996]:         </nova:port>
Nov 02 02:10:40 user nova-compute[74996]:       </nova:ports>
Nov 02 02:10:40 user nova-compute[74996]:     </nova:instance>
Nov 02 02:10:40 user nova-compute[74996]:   </metadata>
Nov 02 02:10:40 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 02:10:40 user nova-compute[74996]:     <system>
Nov 02 02:10:40 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 02:10:40 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 02:10:40 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 02:10:40 user nova-compute[74996]:       <entry name="serial">04bbae43-881f-455a-bcd2-c1be2e82f0dc</entry>
Nov 02 02:10:40 user nova-compute[74996]:       <entry name="uuid">04bbae43-881f-455a-bcd2-c1be2e82f0dc</entry>
Nov 02 02:10:40 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 02:10:40 user nova-compute[74996]:     </system>
Nov 02 02:10:40 user nova-compute[74996]:   </sysinfo>
Nov 02 02:10:40 user nova-compute[74996]:   <os>
Nov 02 02:10:40 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 02:10:40 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 02:10:40 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 02:10:40 user nova-compute[74996]:   </os>
Nov 02 02:10:40 user nova-compute[74996]:   <features>
Nov 02 02:10:40 user nova-compute[74996]:     <acpi/>
Nov 02 02:10:40 user nova-compute[74996]:     <apic/>
Nov 02 02:10:40 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 02:10:40 user nova-compute[74996]:   </features>
Nov 02 02:10:40 user nova-compute[74996]:   <clock offset="utc">
Nov 02 02:10:40 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 02:10:40 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 02:10:40 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 02:10:40 user nova-compute[74996]:   </clock>
Nov 02 02:10:40 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 02:10:40 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 02:10:40 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 02:10:40 user nova-compute[74996]:   </cpu>
Nov 02 02:10:40 user nova-compute[74996]:   <devices>
Nov 02 02:10:40 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 02:10:40 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 02:10:40 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk"/>
Nov 02 02:10:40 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 02:10:40 user nova-compute[74996]:     </disk>
Nov 02 02:10:40 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 02:10:40 user nova-compute[74996]:       <mac address="fa:16:3e:73:2c:81"/>
Nov 02 02:10:40 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 02:10:40 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 02:10:40 user nova-compute[74996]:       <target dev="tap46cdee0a-72"/>
Nov 02 02:10:40 user nova-compute[74996]:     </interface>
Nov 02 02:10:40 user nova-compute[74996]:     <serial type="pty">
Nov 02 02:10:40 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/console.log" append="off"/>
Nov 02 02:10:40 user nova-compute[74996]:     </serial>
Nov 02 02:10:40 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 02:10:40 user nova-compute[74996]:     <video>
Nov 02 02:10:40 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 02:10:40 user nova-compute[74996]:     </video>
Nov 02 02:10:40 user nova-compute[74996]:     <rng model="virtio">
Nov 02 02:10:40 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 02:10:40 user nova-compute[74996]:     </rng>
Nov 02 02:10:40 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 02:10:40 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 02:10:40 user nova-compute[74996]:       <stats period="10"/>
Nov 02 02:10:40 user nova-compute[74996]:     </memballoon>
Nov 02 02:10:40 user nova-compute[74996]:   </devices>
Nov 02 02:10:40 user nova-compute[74996]: </domain>
Nov 02 02:10:40 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.objects.instance [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'trusted_certs' on Instance uuid 04bbae43-881f-455a-bcd2-c1be2e82f0dc {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG nova.objects.base [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Object Instance<04bbae43-881f-455a-bcd2-c1be2e82f0dc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 02:10:40 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:10:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.171s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:10:41 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 02:10:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:10:41 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:10:41 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Cannot resize image /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 02:10:41 user nova-compute[74996]: DEBUG nova.objects.instance [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'migration_context' on Instance uuid 04bbae43-881f-455a-bcd2-c1be2e82f0dc {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:10:41 user nova-compute[74996]: DEBUG nova.objects.base [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Object Instance<04bbae43-881f-455a-bcd2-c1be2e82f0dc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74996) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 02 02:10:41 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-737287584',display_name='tempest-AttachVolumeTestJSON-server-737287584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-737287584',id=44,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeIW/CNmoj21FtRCsqg1lXO54HxCaIvv1uBUUE6B0bU+AGTCthBvSHQimH9CWWXBX3zHlj6txcR4awRuWt6j/DhBo4E/0517ba1Qrhay/0zFwqi/ch9Lcgb2pyyzhBOxA==',key_name='tempest-keypair-535762259',keypairs=<?>,launch_index=0,launched_at=2023-11-02T02:02:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='fee0ae54cb9642e68d847235ebe13875',ramdisk_id='',reservation_id='r-44fx7s8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1064832613',owner_user_name='tempest-AttachVolumeTestJSON-1064832613-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T02:08:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd49c6f202cc46b496df91de55c53c65',uuid=04bbae43-881f-455a-bcd2-c1be2e82f0dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 02:10:41 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Converting VIF {"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:10:41 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:2c:81,bridge_name='br-int',has_traffic_filtering=True,id=46cdee0a-7249-457f-b3d1-e69a6ed62504,network=Network(699807b0-2588-4e44-967e-e11023d25985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cdee0a-72') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:10:41 user nova-compute[74996]: DEBUG os_vif [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:2c:81,bridge_name='br-int',has_traffic_filtering=True,id=46cdee0a-7249-457f-b3d1-e69a6ed62504,network=Network(699807b0-2588-4e44-967e-e11023d25985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cdee0a-72') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 02:10:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:10:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:10:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 02:10:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:10:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '632c27b2-a6a7-54bf-8066-3a6d296025b1', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:10:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:10:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:10:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:10:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46cdee0a-72, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:10:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap46cdee0a-72, col_values=(('qos', UUID('5791dac1-95bc-4fb7-83d4-0b0f354f7e19')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:10:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap46cdee0a-72, col_values=(('external_ids', {'iface-id': '46cdee0a-7249-457f-b3d1-e69a6ed62504', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:2c:81', 'vm-uuid': '04bbae43-881f-455a-bcd2-c1be2e82f0dc'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:10:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:10:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:10:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:10:41 user nova-compute[74996]: INFO os_vif [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:2c:81,bridge_name='br-int',has_traffic_filtering=True,id=46cdee0a-7249-457f-b3d1-e69a6ed62504,network=Network(699807b0-2588-4e44-967e-e11023d25985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cdee0a-72')
Nov 02 02:10:42 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:10:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:10:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:10:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:10:42 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 02:10:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:10:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:10:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:10:42 user nova-compute[74996]: DEBUG nova.compute.manager [req-6b7e9402-3078-4114-aa09-2db90e38e1cc req-0ac3b9a2-95f0-483c-b868-dd8d485008ab service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Received event network-vif-plugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:10:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6b7e9402-3078-4114-aa09-2db90e38e1cc req-0ac3b9a2-95f0-483c-b868-dd8d485008ab service nova] Acquiring lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:10:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6b7e9402-3078-4114-aa09-2db90e38e1cc req-0ac3b9a2-95f0-483c-b868-dd8d485008ab service nova] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:10:42 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6b7e9402-3078-4114-aa09-2db90e38e1cc req-0ac3b9a2-95f0-483c-b868-dd8d485008ab service nova] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:10:42 user nova-compute[74996]: DEBUG nova.compute.manager [req-6b7e9402-3078-4114-aa09-2db90e38e1cc req-0ac3b9a2-95f0-483c-b868-dd8d485008ab service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] No waiting events found dispatching network-vif-plugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:10:42 user nova-compute[74996]: WARNING nova.compute.manager [req-6b7e9402-3078-4114-aa09-2db90e38e1cc req-0ac3b9a2-95f0-483c-b868-dd8d485008ab service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Received unexpected event network-vif-plugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 for instance with vm_state stopped and task_state powering-on.
Nov 02 02:10:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:10:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:10:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:10:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:10:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:10:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:10:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:10:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:10:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:10:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:10:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:10:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:10:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:10:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:10:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:10:44 user nova-compute[74996]: DEBUG nova.compute.manager [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 02:10:44 user nova-compute[74996]: DEBUG nova.compute.manager [req-6be24257-c6a1-4088-99b4-fdadf6c0908a req-e476fbb1-48f5-4617-b730-c7511baf1efe service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Received event network-vif-plugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:10:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6be24257-c6a1-4088-99b4-fdadf6c0908a req-e476fbb1-48f5-4617-b730-c7511baf1efe service nova] Acquiring lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:10:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6be24257-c6a1-4088-99b4-fdadf6c0908a req-e476fbb1-48f5-4617-b730-c7511baf1efe service nova] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:10:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6be24257-c6a1-4088-99b4-fdadf6c0908a req-e476fbb1-48f5-4617-b730-c7511baf1efe service nova] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:10:44 user nova-compute[74996]: DEBUG nova.compute.manager [req-6be24257-c6a1-4088-99b4-fdadf6c0908a req-e476fbb1-48f5-4617-b730-c7511baf1efe service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] No waiting events found dispatching network-vif-plugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:10:44 user nova-compute[74996]: WARNING nova.compute.manager [req-6be24257-c6a1-4088-99b4-fdadf6c0908a req-e476fbb1-48f5-4617-b730-c7511baf1efe service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Received unexpected event network-vif-plugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 for instance with vm_state stopped and task_state powering-on.
Nov 02 02:10:44 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Instance rebooted successfully.
Nov 02 02:10:44 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:10:44 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:10:44 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8716MB free_disk=24.926239013671875GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 02:10:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:10:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:10:44 user nova-compute[74996]: DEBUG nova.compute.manager [None req-622a0a82-afb1-4291-b5b4-1c813de74f47 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 02:10:45 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 04bbae43-881f-455a-bcd2-c1be2e82f0dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:10:45 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance f4dbbf62-95bd-47e7-bbf1-16e143746a45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:10:45 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:10:45 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 02:10:45 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 02:10:45 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:10:45 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:10:45 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 02:10:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.410s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:10:46 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:10:47 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:10:47 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:10:47 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:10:47 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:10:48 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:10:48 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 02:10:48 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Didn't find any instances for network info cache update. {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 02:10:48 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:10:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:10:49 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:10:49 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 02:10:51 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:10:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-556bc35a-06a9-49b5-b874-75bf7c6b7f22 req-88fd2485-38d4-4ca4-9632-ee6a189da655 service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Received event network-changed-181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:10:51 user nova-compute[74996]: DEBUG nova.compute.manager [req-556bc35a-06a9-49b5-b874-75bf7c6b7f22 req-88fd2485-38d4-4ca4-9632-ee6a189da655 service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Refreshing instance network info cache due to event network-changed-181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 02:10:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-556bc35a-06a9-49b5-b874-75bf7c6b7f22 req-88fd2485-38d4-4ca4-9632-ee6a189da655 service nova] Acquiring lock "refresh_cache-3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:10:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-556bc35a-06a9-49b5-b874-75bf7c6b7f22 req-88fd2485-38d4-4ca4-9632-ee6a189da655 service nova] Acquired lock "refresh_cache-3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:10:51 user nova-compute[74996]: DEBUG nova.network.neutron [req-556bc35a-06a9-49b5-b874-75bf7c6b7f22 req-88fd2485-38d4-4ca4-9632-ee6a189da655 service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Refreshing network info cache for port 181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 02:10:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:10:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:10:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:10:51 user nova-compute[74996]: DEBUG nova.objects.instance [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lazy-loading 'flavor' on Instance uuid 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:10:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:10:51 user nova-compute[74996]: DEBUG nova.network.neutron [req-556bc35a-06a9-49b5-b874-75bf7c6b7f22 req-88fd2485-38d4-4ca4-9632-ee6a189da655 service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Updated VIF entry in instance network info cache for port 181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 02:10:51 user nova-compute[74996]: DEBUG nova.network.neutron [req-556bc35a-06a9-49b5-b874-75bf7c6b7f22 req-88fd2485-38d4-4ca4-9632-ee6a189da655 service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Updating instance_info_cache with network_info: [{"id": "181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1", "address": "fa:16:3e:9b:6d:bc", "network": {"id": "3578933b-907b-439c-92d0-4311826a0163", "bridge": "br-int", "label": "tempest-TestStampPattern-1622075405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7cdc1a0ba64a25821d5c99b20de231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181e7d4d-be", "ovs_interfaceid": "181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:10:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-556bc35a-06a9-49b5-b874-75bf7c6b7f22 req-88fd2485-38d4-4ca4-9632-ee6a189da655 service nova] Releasing lock "refresh_cache-3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:10:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:10:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:10:52 user nova-compute[74996]: INFO nova.compute.manager [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Attaching volume 90872a0a-7568-4824-ac2c-abc324ae5d9f to /dev/vdb
Nov 02 02:10:52 user nova-compute[74996]: DEBUG os_brick.utils [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:10:52 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:10:52 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:10:52 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff668bfd-fd61-4b40-b2c5-87c8fd305f60]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:10:52 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:10:52 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:10:52 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c224e49-537d-4d5d-b82c-62382fbfc471]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:10:52 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:10:52 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:10:52 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0556d76-099b-4532-b2aa-1c16c4aecb58]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:10:52 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cf28fd-f831-4490-b357-3a309efab2ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:10:52 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:10:52 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 02:10:52 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 02:10:52 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:10:52 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 02:10:52 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 02:10:52 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fe3072-8967-4cf6-ba5c-61c7d8b47803]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:10:52 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 02:10:52 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 02:10:52 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 02:10:52 user nova-compute[74996]: DEBUG os_brick.utils [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:10:52 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Updating existing volume attachment record: 0a2f9e76-a348-46b9-bf28-099c5c199a29 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 02:10:53 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:10:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:10:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:10:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:11:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:11:02 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:11:02 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74996) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 02:11:03 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:11:03 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Cleaning up deleted instances {{(pid=74996) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 02:11:03 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] There are 0 instances to clean {{(pid=74996) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 02:11:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:11:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:11:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PKrvswkn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:11:11 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:11:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:11:11 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:11:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:11:11 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5ec374-a4f0-4a30-bb44-ebf7164f38f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 02:11:11 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fb2234-cfb3-4bbd-88aa-6725ae8ed14c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f] added
Nov 02 02:11:11 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53b15b0-6640-4a7e-b587-7618f64341bf]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[582da96b-64e2-4cd7-8e07-d703b9c2ac44]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PKrvswkn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PKrvswkn" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba2e964-e9f0-4ca4-a331-b773c7de7f8c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PKrvswkn'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda25004-f66c-4e0b-ace9-cef81ff6f8ce]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d056c3-5c63-4ccb-abf0-d6db766c326f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 02:11:11 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 02:11:11 user nova-compute[74996]:  {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:11:11 user nova-compute[74996]: WARNING os_brick.initiator.connectors.iscsi [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 02:11:11 user nova-compute[74996]: 
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[06833e28-b2b3-4794-90bf-1ed75b440406]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f, portal: 172.16.0.220,3260]
Nov 02 02:11:11 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f, portal: 172.16.0.220,3260] successful.
Nov 02 02:11:11 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8fbf15-a7d1-4db0-af2e-de0387530290]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89cd078-6603-4efe-91af-1d3635383691]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f (non-flash)
Nov 02 02:11:11 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f (non-flash)
Nov 02 02:11:11 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd78d94f-d195-4093-857b-092fff9adef9]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 02:11:11 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PKrvswkn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 02:11:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:11:12 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '26234623364303231', 'path': '/dev/sdb'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:11:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234623364303231', 'path': '/dev/sdb'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 02:11:12 user nova-compute[74996]: DEBUG nova.objects.instance [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lazy-loading 'flavor' on Instance uuid 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:11:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 02:11:12 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:11:12 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 02:11:12 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:11:12 user nova-compute[74996]:   <serial>90872a0a-7568-4824-ac2c-abc324ae5d9f</serial>
Nov 02 02:11:12 user nova-compute[74996]: </disk>
Nov 02 02:11:12 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 02:11:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:11:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:11:13 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] No VIF found with MAC fa:16:3e:9b:6d:bc, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 02:11:13 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-fd0aff85-bef2-4684-9b91-7b7619e6dc04 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.124s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:11:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:11:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:11:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:11:15 user nova-compute[74996]: INFO nova.compute.manager [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Detaching volume 90872a0a-7568-4824-ac2c-abc324ae5d9f
Nov 02 02:11:15 user nova-compute[74996]: INFO nova.virt.block_device [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Attempting to driver detach volume 90872a0a-7568-4824-ac2c-abc324ae5d9f from mountpoint /dev/vdb
Nov 02 02:11:15 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Attempting to detach device vdb from instance 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 02:11:15 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 02:11:15 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:11:15 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 02:11:15 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:11:15 user nova-compute[74996]:   <serial>90872a0a-7568-4824-ac2c-abc324ae5d9f</serial>
Nov 02 02:11:15 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 02:11:15 user nova-compute[74996]: </disk>
Nov 02 02:11:15 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 02:11:15 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Successfully detached device vdb from instance 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa from the persistent domain config.
Nov 02 02:11:15 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa from the live domain config. {{(pid=74996) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 02:11:15 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 02:11:15 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:11:15 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 02:11:15 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:11:15 user nova-compute[74996]:   <serial>90872a0a-7568-4824-ac2c-abc324ae5d9f</serial>
Nov 02 02:11:15 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 02:11:15 user nova-compute[74996]: </disk>
Nov 02 02:11:15 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 02:11:15 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa {{(pid=74996) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 02:11:16 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:11:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:11:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:11:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:11:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:11:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:11:35 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa is timed out.
Nov 02 02:11:35 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Successfully detached device vdb from instance 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa from the live domain config.
Nov 02 02:11:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PKrvswkn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:11:35 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:11:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c196d0-00e0-4bec-a7ae-786afa4f288f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 02:11:35 user nova-compute[74996]: No targets found.
Nov 02 02:11:35 user nova-compute[74996]: iSNS:
Nov 02 02:11:35 user nova-compute[74996]: No targets found.
Nov 02 02:11:35 user nova-compute[74996]: STATIC:
Nov 02 02:11:35 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f
Nov 02 02:11:35 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 02:11:35 user nova-compute[74996]:                 Iface Name: default
Nov 02 02:11:35 user nova-compute[74996]: FIRMWARE:
Nov 02 02:11:35 user nova-compute[74996]: No targets found.
Nov 02 02:11:35 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 02:11:35 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 02:11:35 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e5657a-ac86-4072-b14b-377cddee6b69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[8500e9ea-c242-4ea6-b4d6-a6405303deb2]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f (non-flash)
Nov 02 02:11:35 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f (non-flash)
Nov 02 02:11:35 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e87e5d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f'): ({'sdb'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Removing single pathed devices sdb {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7d04f2-2f21-46c1-a508-be76c95f3fb3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f068d9-7083-4c90-8af6-55728ff4eb8b]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Flushing IO for device /dev/sdb {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3736c257-238b-47d3-8722-819fa72b68bc]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8762e3-a41b-4895-8025-7a22478a3f01]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c126b3-9e6f-4b7e-94df-8701cfbd9a0c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd4a973-0685-467e-8efb-a3fe6d1ce31c]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f, portal: 172.16.0.220,3260]
Nov 02 02:11:35 user nova-compute[74996]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f, portal: 172.16.0.220,3260] successful.
Nov 02 02:11:35 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90872a0a-7568-4824-ac2c-abc324ae5d9f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b7f815-fa3b-4bef-97f0-14c3a2a2beaa]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] <== disconnect_volume: return (285ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:11:35 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 02:11:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:11:36 user nova-compute[74996]: DEBUG nova.objects.instance [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lazy-loading 'flavor' on Instance uuid 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:11:36 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-49f6197e-b909-4826-a258-6e7922573d1b tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.717s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:11:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:11:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:11:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:11:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:11:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:11:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:11:43 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:11:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:11:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:11:43 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:11:43 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 02:11:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:11:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:11:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:11:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:11:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:11:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:11:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:11:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:11:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:11:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:11:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:11:44 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:11:44 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:11:44 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:11:44 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8649MB free_disk=24.916439056396484GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 02:11:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:11:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:11:44 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 04bbae43-881f-455a-bcd2-c1be2e82f0dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:11:44 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance f4dbbf62-95bd-47e7-bbf1-16e143746a45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:11:44 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:11:44 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 02:11:44 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 02:11:44 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Refreshing inventories for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 02:11:44 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Updating ProviderTree inventory for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 02:11:44 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Updating inventory in ProviderTree for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 02:11:44 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Refreshing aggregate associations for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259, aggregates: None {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 02:11:44 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Refreshing trait associations for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 02:11:45 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:11:45 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:11:45 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 02:11:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.353s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:11:46 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:11:47 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:11:47 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:11:47 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:11:48 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:11:48 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 02:11:48 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Rebuilding the list of instances to heal {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 02:11:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-04bbae43-881f-455a-bcd2-c1be2e82f0dc" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:11:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-04bbae43-881f-455a-bcd2-c1be2e82f0dc" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:11:48 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 02:11:48 user nova-compute[74996]: DEBUG nova.objects.instance [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lazy-loading 'info_cache' on Instance uuid 04bbae43-881f-455a-bcd2-c1be2e82f0dc {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:11:48 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Updating instance_info_cache with network_info: [{"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:11:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-04bbae43-881f-455a-bcd2-c1be2e82f0dc" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:11:48 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 02:11:49 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:11:51 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:11:51 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:11:51 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 02:11:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:11:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:11:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:11:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:11:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:11:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:11:55 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:11:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:08 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:12:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:16 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:12:16 user nova-compute[74996]: DEBUG nova.compute.manager [None req-77542725-10f6-45d4-aa02-72f0a555d5ef tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 02:12:16 user nova-compute[74996]: INFO nova.compute.manager [None req-77542725-10f6-45d4-aa02-72f0a555d5ef tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] instance snapshotting
Nov 02 02:12:16 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-77542725-10f6-45d4-aa02-72f0a555d5ef tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Beginning live snapshot process
Nov 02 02:12:16 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-77542725-10f6-45d4-aa02-72f0a555d5ef tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json -f qcow2 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:12:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-77542725-10f6-45d4-aa02-72f0a555d5ef tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:12:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-77542725-10f6-45d4-aa02-72f0a555d5ef tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json -f qcow2 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:12:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-77542725-10f6-45d4-aa02-72f0a555d5ef tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json -f qcow2" returned: 0 in 0.169s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:12:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-77542725-10f6-45d4-aa02-72f0a555d5ef tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:12:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-77542725-10f6-45d4-aa02-72f0a555d5ef tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.168s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:12:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-77542725-10f6-45d4-aa02-72f0a555d5ef tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp51ttmjty/87ff502226dc46bcbef3849539d29ce0.delta 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:12:17 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-77542725-10f6-45d4-aa02-72f0a555d5ef tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp51ttmjty/87ff502226dc46bcbef3849539d29ce0.delta 1073741824" returned: 0 in 0.047s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:12:17 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-77542725-10f6-45d4-aa02-72f0a555d5ef tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 02 02:12:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-77542725-10f6-45d4-aa02-72f0a555d5ef tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74996) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 02:12:18 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-77542725-10f6-45d4-aa02-72f0a555d5ef tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74996) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 02 02:12:18 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-77542725-10f6-45d4-aa02-72f0a555d5ef tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 02 02:12:18 user nova-compute[74996]: DEBUG nova.privsep.utils [None req-77542725-10f6-45d4-aa02-72f0a555d5ef tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74996) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 02:12:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-77542725-10f6-45d4-aa02-72f0a555d5ef tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp51ttmjty/87ff502226dc46bcbef3849539d29ce0.delta /opt/stack/data/nova/instances/snapshots/tmp51ttmjty/87ff502226dc46bcbef3849539d29ce0 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:12:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-77542725-10f6-45d4-aa02-72f0a555d5ef tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp51ttmjty/87ff502226dc46bcbef3849539d29ce0.delta /opt/stack/data/nova/instances/snapshots/tmp51ttmjty/87ff502226dc46bcbef3849539d29ce0" returned: 0 in 0.745s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:12:19 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-77542725-10f6-45d4-aa02-72f0a555d5ef tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Snapshot extracted, beginning image upload
Nov 02 02:12:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:12:22 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-77542725-10f6-45d4-aa02-72f0a555d5ef tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Snapshot image upload complete
Nov 02 02:12:22 user nova-compute[74996]: INFO nova.compute.manager [None req-77542725-10f6-45d4-aa02-72f0a555d5ef tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Took 5.32 seconds to snapshot the instance on the hypervisor.
Nov 02 02:12:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:12:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:12:24 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 02:12:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:12:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:12:24 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 02:12:24 user nova-compute[74996]: INFO nova.compute.claims [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Claim successful on node user
Nov 02 02:12:24 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:12:24 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:12:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.281s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:12:24 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 02:12:25 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 02:12:25 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 02:12:25 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 02:12:25 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 02:12:25 user nova-compute[74996]: DEBUG nova.policy [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '832530cd183e4944994e8032ac37c621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d7cdc1a0ba64a25821d5c99b20de231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 02:12:25 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 02:12:25 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 02:12:25 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Creating image(s)
Nov 02 02:12:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "/opt/stack/data/nova/instances/4680149a-b596-48f6-8bd0-3d44b9f06f8f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:12:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "/opt/stack/data/nova/instances/4680149a-b596-48f6-8bd0-3d44b9f06f8f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:12:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "/opt/stack/data/nova/instances/4680149a-b596-48f6-8bd0-3d44b9f06f8f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:12:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "53047951afd901766f0692b596e69359b8f114ab" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:12:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "53047951afd901766f0692b596e69359b8f114ab" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:12:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53047951afd901766f0692b596e69359b8f114ab.part --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:12:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:26 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Successfully created port: 1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 02:12:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53047951afd901766f0692b596e69359b8f114ab.part --force-share --output=json" returned: 0 in 0.251s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:12:26 user nova-compute[74996]: DEBUG nova.virt.images [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] 07f0728f-c789-47a1-b582-249278003ffa was qcow2, converting to raw {{(pid=74996) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 02 02:12:26 user nova-compute[74996]: DEBUG nova.privsep.utils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74996) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 02 02:12:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/53047951afd901766f0692b596e69359b8f114ab.part /opt/stack/data/nova/instances/_base/53047951afd901766f0692b596e69359b8f114ab.converted {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:12:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/53047951afd901766f0692b596e69359b8f114ab.part /opt/stack/data/nova/instances/_base/53047951afd901766f0692b596e69359b8f114ab.converted" returned: 0 in 0.358s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:12:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53047951afd901766f0692b596e69359b8f114ab.converted --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Successfully updated port: 1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53047951afd901766f0692b596e69359b8f114ab.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "53047951afd901766f0692b596e69359b8f114ab" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.893s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53047951afd901766f0692b596e69359b8f114ab --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "refresh_cache-4680149a-b596-48f6-8bd0-3d44b9f06f8f" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquired lock "refresh_cache-4680149a-b596-48f6-8bd0-3d44b9f06f8f" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.compute.manager [req-0c53371f-54fa-4c12-928b-bb7c8a39e23d req-c27e0030-2482-4225-ac00-0f1afd7e6be0 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Received event network-changed-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.compute.manager [req-0c53371f-54fa-4c12-928b-bb7c8a39e23d req-c27e0030-2482-4225-ac00-0f1afd7e6be0 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Refreshing instance network info cache due to event network-changed-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0c53371f-54fa-4c12-928b-bb7c8a39e23d req-c27e0030-2482-4225-ac00-0f1afd7e6be0 service nova] Acquiring lock "refresh_cache-4680149a-b596-48f6-8bd0-3d44b9f06f8f" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53047951afd901766f0692b596e69359b8f114ab --force-share --output=json" returned: 0 in 0.190s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "53047951afd901766f0692b596e69359b8f114ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "53047951afd901766f0692b596e69359b8f114ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53047951afd901766f0692b596e69359b8f114ab --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.network.neutron [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Updating instance_info_cache with network_info: [{"id": "1b77658b-f8a7-4cae-bcd6-12f849a7cdc8", "address": "fa:16:3e:01:5c:7c", "network": {"id": "3578933b-907b-439c-92d0-4311826a0163", "bridge": "br-int", "label": "tempest-TestStampPattern-1622075405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7cdc1a0ba64a25821d5c99b20de231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b77658b-f8", "ovs_interfaceid": "1b77658b-f8a7-4cae-bcd6-12f849a7cdc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53047951afd901766f0692b596e69359b8f114ab --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/53047951afd901766f0692b596e69359b8f114ab,backing_fmt=raw /opt/stack/data/nova/instances/4680149a-b596-48f6-8bd0-3d44b9f06f8f/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Releasing lock "refresh_cache-4680149a-b596-48f6-8bd0-3d44b9f06f8f" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Instance network_info: |[{"id": "1b77658b-f8a7-4cae-bcd6-12f849a7cdc8", "address": "fa:16:3e:01:5c:7c", "network": {"id": "3578933b-907b-439c-92d0-4311826a0163", "bridge": "br-int", "label": "tempest-TestStampPattern-1622075405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7cdc1a0ba64a25821d5c99b20de231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b77658b-f8", "ovs_interfaceid": "1b77658b-f8a7-4cae-bcd6-12f849a7cdc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0c53371f-54fa-4c12-928b-bb7c8a39e23d req-c27e0030-2482-4225-ac00-0f1afd7e6be0 service nova] Acquired lock "refresh_cache-4680149a-b596-48f6-8bd0-3d44b9f06f8f" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.network.neutron [req-0c53371f-54fa-4c12-928b-bb7c8a39e23d req-c27e0030-2482-4225-ac00-0f1afd7e6be0 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Refreshing network info cache for port 1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/53047951afd901766f0692b596e69359b8f114ab,backing_fmt=raw /opt/stack/data/nova/instances/4680149a-b596-48f6-8bd0-3d44b9f06f8f/disk 1073741824" returned: 0 in 0.049s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "53047951afd901766f0692b596e69359b8f114ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53047951afd901766f0692b596e69359b8f114ab --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/53047951afd901766f0692b596e69359b8f114ab --force-share --output=json" returned: 0 in 0.169s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Ensure instance console log exists: /opt/stack/data/nova/instances/4680149a-b596-48f6-8bd0-3d44b9f06f8f/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Start _get_guest_xml network_info=[{"id": "1b77658b-f8a7-4cae-bcd6-12f849a7cdc8", "address": "fa:16:3e:01:5c:7c", "network": {"id": "3578933b-907b-439c-92d0-4311826a0163", "bridge": "br-int", "label": "tempest-TestStampPattern-1622075405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7cdc1a0ba64a25821d5c99b20de231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b77658b-f8", "ovs_interfaceid": "1b77658b-f8a7-4cae-bcd6-12f849a7cdc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='7b24ec872156ca867b1e79de83c97eb2',container_format='bare',created_at=2023-11-02T02:12:16Z,direct_url=<?>,disk_format='qcow2',id=07f0728f-c789-47a1-b582-249278003ffa,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1423929665',owner='0d7cdc1a0ba64a25821d5c99b20de231',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-02T02:12:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': '07f0728f-c789-47a1-b582-249278003ffa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 02:12:27 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:12:27 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='7b24ec872156ca867b1e79de83c97eb2',container_format='bare',created_at=2023-11-02T02:12:16Z,direct_url=<?>,disk_format='qcow2',id=07f0728f-c789-47a1-b582-249278003ffa,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1423929665',owner='0d7cdc1a0ba64a25821d5c99b20de231',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-02T02:12:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:12:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-581859939',display_name='tempest-TestStampPattern-server-581859939',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-581859939',id=49,image_ref='07f0728f-c789-47a1-b582-249278003ffa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKJHuw6Qr4/PNCfq6n+9tvXVKbxGaOJVnul0YErELd6vC57iiAiOyevzzMq1POKS4qzqhx+V78eYjcL2zfkyulhd6D3nM2HSkapGvB1Xf65v7OsTXK2YbtKtdN7HwXQcw==',key_name='tempest-TestStampPattern-1523316715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d7cdc1a0ba64a25821d5c99b20de231',ramdisk_id='',reservation_id='r-kn6m1dvg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa',image_min_disk='1',image_min_ram='0',image_owner_id='0d7cdc1a0ba64a25821d5c99b20de231',image_owner_project_name='tempest-TestStampPattern-856812097',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-856812097-project-member',image_user_id='832530cd183e4944994e8032ac37c621',network_allocated='True',owner_project_name='tempest-TestStampPattern-856812097',owner_user_name='tempest-TestStampPattern-856812097-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T02:12:25Z,user_data=None,user_id='832530cd183e4944994e8032ac37c621',uuid=4680149a-b596-48f6-8bd0-3d44b9f06f8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b77658b-f8a7-4cae-bcd6-12f849a7cdc8", "address": "fa:16:3e:01:5c:7c", "network": {"id": "3578933b-907b-439c-92d0-4311826a0163", "bridge": "br-int", "label": "tempest-TestStampPattern-1622075405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7cdc1a0ba64a25821d5c99b20de231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b77658b-f8", "ovs_interfaceid": "1b77658b-f8a7-4cae-bcd6-12f849a7cdc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Converting VIF {"id": "1b77658b-f8a7-4cae-bcd6-12f849a7cdc8", "address": "fa:16:3e:01:5c:7c", "network": {"id": "3578933b-907b-439c-92d0-4311826a0163", "bridge": "br-int", "label": "tempest-TestStampPattern-1622075405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7cdc1a0ba64a25821d5c99b20de231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b77658b-f8", "ovs_interfaceid": "1b77658b-f8a7-4cae-bcd6-12f849a7cdc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=1b77658b-f8a7-4cae-bcd6-12f849a7cdc8,network=Network(3578933b-907b-439c-92d0-4311826a0163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b77658b-f8') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.objects.instance [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lazy-loading 'pci_devices' on Instance uuid 4680149a-b596-48f6-8bd0-3d44b9f06f8f {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] End _get_guest_xml xml=<domain type="kvm">
Nov 02 02:12:27 user nova-compute[74996]:   <uuid>4680149a-b596-48f6-8bd0-3d44b9f06f8f</uuid>
Nov 02 02:12:27 user nova-compute[74996]:   <name>instance-00000031</name>
Nov 02 02:12:27 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 02:12:27 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 02:12:27 user nova-compute[74996]:   <metadata>
Nov 02 02:12:27 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 02:12:27 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 02:12:27 user nova-compute[74996]:       <nova:name>tempest-TestStampPattern-server-581859939</nova:name>
Nov 02 02:12:27 user nova-compute[74996]:       <nova:creationTime>2023-11-02 02:12:27</nova:creationTime>
Nov 02 02:12:27 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 02:12:27 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 02:12:27 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 02:12:27 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 02:12:27 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 02:12:27 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 02:12:27 user nova-compute[74996]:       </nova:flavor>
Nov 02 02:12:27 user nova-compute[74996]:       <nova:owner>
Nov 02 02:12:27 user nova-compute[74996]:         <nova:user uuid="832530cd183e4944994e8032ac37c621">tempest-TestStampPattern-856812097-project-member</nova:user>
Nov 02 02:12:27 user nova-compute[74996]:         <nova:project uuid="0d7cdc1a0ba64a25821d5c99b20de231">tempest-TestStampPattern-856812097</nova:project>
Nov 02 02:12:27 user nova-compute[74996]:       </nova:owner>
Nov 02 02:12:27 user nova-compute[74996]:       <nova:root type="image" uuid="07f0728f-c789-47a1-b582-249278003ffa"/>
Nov 02 02:12:27 user nova-compute[74996]:       <nova:ports>
Nov 02 02:12:27 user nova-compute[74996]:         <nova:port uuid="1b77658b-f8a7-4cae-bcd6-12f849a7cdc8">
Nov 02 02:12:27 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 02 02:12:27 user nova-compute[74996]:         </nova:port>
Nov 02 02:12:27 user nova-compute[74996]:       </nova:ports>
Nov 02 02:12:27 user nova-compute[74996]:     </nova:instance>
Nov 02 02:12:27 user nova-compute[74996]:   </metadata>
Nov 02 02:12:27 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 02:12:27 user nova-compute[74996]:     <system>
Nov 02 02:12:27 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 02:12:27 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 02:12:27 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 02:12:27 user nova-compute[74996]:       <entry name="serial">4680149a-b596-48f6-8bd0-3d44b9f06f8f</entry>
Nov 02 02:12:27 user nova-compute[74996]:       <entry name="uuid">4680149a-b596-48f6-8bd0-3d44b9f06f8f</entry>
Nov 02 02:12:27 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 02:12:27 user nova-compute[74996]:     </system>
Nov 02 02:12:27 user nova-compute[74996]:   </sysinfo>
Nov 02 02:12:27 user nova-compute[74996]:   <os>
Nov 02 02:12:27 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 02:12:27 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 02:12:27 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 02:12:27 user nova-compute[74996]:   </os>
Nov 02 02:12:27 user nova-compute[74996]:   <features>
Nov 02 02:12:27 user nova-compute[74996]:     <acpi/>
Nov 02 02:12:27 user nova-compute[74996]:     <apic/>
Nov 02 02:12:27 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 02:12:27 user nova-compute[74996]:   </features>
Nov 02 02:12:27 user nova-compute[74996]:   <clock offset="utc">
Nov 02 02:12:27 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 02:12:27 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 02:12:27 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 02:12:27 user nova-compute[74996]:   </clock>
Nov 02 02:12:27 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 02:12:27 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 02:12:27 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 02:12:27 user nova-compute[74996]:   </cpu>
Nov 02 02:12:27 user nova-compute[74996]:   <devices>
Nov 02 02:12:27 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 02:12:27 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 02:12:27 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/4680149a-b596-48f6-8bd0-3d44b9f06f8f/disk"/>
Nov 02 02:12:27 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 02:12:27 user nova-compute[74996]:     </disk>
Nov 02 02:12:27 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 02:12:27 user nova-compute[74996]:       <mac address="fa:16:3e:01:5c:7c"/>
Nov 02 02:12:27 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 02:12:27 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 02:12:27 user nova-compute[74996]:       <target dev="tap1b77658b-f8"/>
Nov 02 02:12:27 user nova-compute[74996]:     </interface>
Nov 02 02:12:27 user nova-compute[74996]:     <serial type="pty">
Nov 02 02:12:27 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/4680149a-b596-48f6-8bd0-3d44b9f06f8f/console.log" append="off"/>
Nov 02 02:12:27 user nova-compute[74996]:     </serial>
Nov 02 02:12:27 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 02:12:27 user nova-compute[74996]:     <video>
Nov 02 02:12:27 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 02:12:27 user nova-compute[74996]:     </video>
Nov 02 02:12:27 user nova-compute[74996]:     <rng model="virtio">
Nov 02 02:12:27 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 02:12:27 user nova-compute[74996]:     </rng>
Nov 02 02:12:27 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 02:12:27 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 02:12:27 user nova-compute[74996]:       <stats period="10"/>
Nov 02 02:12:27 user nova-compute[74996]:     </memballoon>
Nov 02 02:12:27 user nova-compute[74996]:   </devices>
Nov 02 02:12:27 user nova-compute[74996]: </domain>
Nov 02 02:12:27 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:12:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-581859939',display_name='tempest-TestStampPattern-server-581859939',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-581859939',id=49,image_ref='07f0728f-c789-47a1-b582-249278003ffa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKJHuw6Qr4/PNCfq6n+9tvXVKbxGaOJVnul0YErELd6vC57iiAiOyevzzMq1POKS4qzqhx+V78eYjcL2zfkyulhd6D3nM2HSkapGvB1Xf65v7OsTXK2YbtKtdN7HwXQcw==',key_name='tempest-TestStampPattern-1523316715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d7cdc1a0ba64a25821d5c99b20de231',ramdisk_id='',reservation_id='r-kn6m1dvg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa',image_min_disk='1',image_min_ram='0',image_owner_id='0d7cdc1a0ba64a25821d5c99b20de231',image_owner_project_name='tempest-TestStampPattern-856812097',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-856812097-project-member',image_user_id='832530cd183e4944994e8032ac37c621',network_allocated='True',owner_project_name='tempest-TestStampPattern-856812097',owner_user_name='tempest-TestStampPattern-856812097-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T02:12:25Z,user_data=None,user_id='832530cd183e4944994e8032ac37c621',uuid=4680149a-b596-48f6-8bd0-3d44b9f06f8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b77658b-f8a7-4cae-bcd6-12f849a7cdc8", "address": "fa:16:3e:01:5c:7c", "network": {"id": "3578933b-907b-439c-92d0-4311826a0163", "bridge": "br-int", "label": "tempest-TestStampPattern-1622075405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7cdc1a0ba64a25821d5c99b20de231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b77658b-f8", "ovs_interfaceid": "1b77658b-f8a7-4cae-bcd6-12f849a7cdc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Converting VIF {"id": "1b77658b-f8a7-4cae-bcd6-12f849a7cdc8", "address": "fa:16:3e:01:5c:7c", "network": {"id": "3578933b-907b-439c-92d0-4311826a0163", "bridge": "br-int", "label": "tempest-TestStampPattern-1622075405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7cdc1a0ba64a25821d5c99b20de231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b77658b-f8", "ovs_interfaceid": "1b77658b-f8a7-4cae-bcd6-12f849a7cdc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=1b77658b-f8a7-4cae-bcd6-12f849a7cdc8,network=Network(3578933b-907b-439c-92d0-4311826a0163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b77658b-f8') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG os_vif [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=1b77658b-f8a7-4cae-bcd6-12f849a7cdc8,network=Network(3578933b-907b-439c-92d0-4311826a0163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b77658b-f8') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc349600-f574-5976-aa6c-1063fbb8b308', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b77658b-f8, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b77658b-f8, col_values=(('qos', UUID('475c26d3-a6bc-4452-83cf-0d095a990dd6')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b77658b-f8, col_values=(('external_ids', {'iface-id': '1b77658b-f8a7-4cae-bcd6-12f849a7cdc8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:5c:7c', 'vm-uuid': '4680149a-b596-48f6-8bd0-3d44b9f06f8f'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:27 user nova-compute[74996]: INFO os_vif [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=1b77658b-f8a7-4cae-bcd6-12f849a7cdc8,network=Network(3578933b-907b-439c-92d0-4311826a0163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b77658b-f8')
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:12:27 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] No VIF found with MAC fa:16:3e:01:5c:7c, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 02:12:28 user nova-compute[74996]: DEBUG nova.network.neutron [req-0c53371f-54fa-4c12-928b-bb7c8a39e23d req-c27e0030-2482-4225-ac00-0f1afd7e6be0 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Updated VIF entry in instance network info cache for port 1b77658b-f8a7-4cae-bcd6-12f849a7cdc8. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 02:12:28 user nova-compute[74996]: DEBUG nova.network.neutron [req-0c53371f-54fa-4c12-928b-bb7c8a39e23d req-c27e0030-2482-4225-ac00-0f1afd7e6be0 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Updating instance_info_cache with network_info: [{"id": "1b77658b-f8a7-4cae-bcd6-12f849a7cdc8", "address": "fa:16:3e:01:5c:7c", "network": {"id": "3578933b-907b-439c-92d0-4311826a0163", "bridge": "br-int", "label": "tempest-TestStampPattern-1622075405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7cdc1a0ba64a25821d5c99b20de231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b77658b-f8", "ovs_interfaceid": "1b77658b-f8a7-4cae-bcd6-12f849a7cdc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:12:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-0c53371f-54fa-4c12-928b-bb7c8a39e23d req-c27e0030-2482-4225-ac00-0f1afd7e6be0 service nova] Releasing lock "refresh_cache-4680149a-b596-48f6-8bd0-3d44b9f06f8f" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:12:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:29 user nova-compute[74996]: DEBUG nova.compute.manager [req-576339ab-9782-4806-b685-79042a786fd5 req-a9480a4b-64eb-4482-a090-d82f297130e0 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Received event network-vif-plugged-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:12:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-576339ab-9782-4806-b685-79042a786fd5 req-a9480a4b-64eb-4482-a090-d82f297130e0 service nova] Acquiring lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:12:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-576339ab-9782-4806-b685-79042a786fd5 req-a9480a4b-64eb-4482-a090-d82f297130e0 service nova] Lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:12:29 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-576339ab-9782-4806-b685-79042a786fd5 req-a9480a4b-64eb-4482-a090-d82f297130e0 service nova] Lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:12:29 user nova-compute[74996]: DEBUG nova.compute.manager [req-576339ab-9782-4806-b685-79042a786fd5 req-a9480a4b-64eb-4482-a090-d82f297130e0 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] No waiting events found dispatching network-vif-plugged-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:12:29 user nova-compute[74996]: WARNING nova.compute.manager [req-576339ab-9782-4806-b685-79042a786fd5 req-a9480a4b-64eb-4482-a090-d82f297130e0 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Received unexpected event network-vif-plugged-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 for instance with vm_state building and task_state spawning.
Nov 02 02:12:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0e4bdf8e-ae14-4452-888c-e5a4b7964d12 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:12:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0e4bdf8e-ae14-4452-888c-e5a4b7964d12 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:12:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0e4bdf8e-ae14-4452-888c-e5a4b7964d12 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:12:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0e4bdf8e-ae14-4452-888c-e5a4b7964d12 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:12:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0e4bdf8e-ae14-4452-888c-e5a4b7964d12 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:12:30 user nova-compute[74996]: INFO nova.compute.manager [None req-0e4bdf8e-ae14-4452-888c-e5a4b7964d12 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Terminating instance
Nov 02 02:12:30 user nova-compute[74996]: DEBUG nova.compute.manager [None req-0e4bdf8e-ae14-4452-888c-e5a4b7964d12 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 02:12:31 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Instance spawned successfully.
Nov 02 02:12:31 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:12:31 user nova-compute[74996]: INFO nova.compute.manager [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Took 6.18 seconds to spawn the instance on the hypervisor.
Nov 02 02:12:31 user nova-compute[74996]: DEBUG nova.compute.manager [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG nova.compute.manager [req-ea413ca4-2cae-4c33-b07b-968334495bbf req-901a8853-eaad-4ddf-b017-be83e8ee319b service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Received event network-vif-plugged-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ea413ca4-2cae-4c33-b07b-968334495bbf req-901a8853-eaad-4ddf-b017-be83e8ee319b service nova] Acquiring lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ea413ca4-2cae-4c33-b07b-968334495bbf req-901a8853-eaad-4ddf-b017-be83e8ee319b service nova] Lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ea413ca4-2cae-4c33-b07b-968334495bbf req-901a8853-eaad-4ddf-b017-be83e8ee319b service nova] Lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG nova.compute.manager [req-ea413ca4-2cae-4c33-b07b-968334495bbf req-901a8853-eaad-4ddf-b017-be83e8ee319b service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] No waiting events found dispatching network-vif-plugged-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:12:31 user nova-compute[74996]: WARNING nova.compute.manager [req-ea413ca4-2cae-4c33-b07b-968334495bbf req-901a8853-eaad-4ddf-b017-be83e8ee319b service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Received unexpected event network-vif-plugged-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 for instance with vm_state building and task_state spawning.
Nov 02 02:12:31 user nova-compute[74996]: DEBUG nova.compute.manager [req-ea413ca4-2cae-4c33-b07b-968334495bbf req-901a8853-eaad-4ddf-b017-be83e8ee319b service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Received event network-vif-unplugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ea413ca4-2cae-4c33-b07b-968334495bbf req-901a8853-eaad-4ddf-b017-be83e8ee319b service nova] Acquiring lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ea413ca4-2cae-4c33-b07b-968334495bbf req-901a8853-eaad-4ddf-b017-be83e8ee319b service nova] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ea413ca4-2cae-4c33-b07b-968334495bbf req-901a8853-eaad-4ddf-b017-be83e8ee319b service nova] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG nova.compute.manager [req-ea413ca4-2cae-4c33-b07b-968334495bbf req-901a8853-eaad-4ddf-b017-be83e8ee319b service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] No waiting events found dispatching network-vif-unplugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG nova.compute.manager [req-ea413ca4-2cae-4c33-b07b-968334495bbf req-901a8853-eaad-4ddf-b017-be83e8ee319b service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Received event network-vif-unplugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG nova.compute.manager [req-ea413ca4-2cae-4c33-b07b-968334495bbf req-901a8853-eaad-4ddf-b017-be83e8ee319b service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Received event network-vif-plugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ea413ca4-2cae-4c33-b07b-968334495bbf req-901a8853-eaad-4ddf-b017-be83e8ee319b service nova] Acquiring lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ea413ca4-2cae-4c33-b07b-968334495bbf req-901a8853-eaad-4ddf-b017-be83e8ee319b service nova] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-ea413ca4-2cae-4c33-b07b-968334495bbf req-901a8853-eaad-4ddf-b017-be83e8ee319b service nova] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG nova.compute.manager [req-ea413ca4-2cae-4c33-b07b-968334495bbf req-901a8853-eaad-4ddf-b017-be83e8ee319b service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] No waiting events found dispatching network-vif-plugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:12:31 user nova-compute[74996]: WARNING nova.compute.manager [req-ea413ca4-2cae-4c33-b07b-968334495bbf req-901a8853-eaad-4ddf-b017-be83e8ee319b service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Received unexpected event network-vif-plugged-46cdee0a-7249-457f-b3d1-e69a6ed62504 for instance with vm_state active and task_state deleting.
Nov 02 02:12:31 user nova-compute[74996]: INFO nova.compute.manager [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Took 6.87 seconds to build instance.
Nov 02 02:12:31 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-ac5caea3-ed96-40d1-829b-12661aeef0dd tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.965s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:12:31 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Instance destroyed successfully.
Nov 02 02:12:31 user nova-compute[74996]: DEBUG nova.objects.instance [None req-0e4bdf8e-ae14-4452-888c-e5a4b7964d12 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'resources' on Instance uuid 04bbae43-881f-455a-bcd2-c1be2e82f0dc {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-0e4bdf8e-ae14-4452-888c-e5a4b7964d12 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-737287584',display_name='tempest-AttachVolumeTestJSON-server-737287584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-737287584',id=44,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeIW/CNmoj21FtRCsqg1lXO54HxCaIvv1uBUUE6B0bU+AGTCthBvSHQimH9CWWXBX3zHlj6txcR4awRuWt6j/DhBo4E/0517ba1Qrhay/0zFwqi/ch9Lcgb2pyyzhBOxA==',key_name='tempest-keypair-535762259',keypairs=<?>,launch_index=0,launched_at=2023-11-02T02:02:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fee0ae54cb9642e68d847235ebe13875',ramdisk_id='',reservation_id='r-44fx7s8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1064832613',owner_user_name='tempest-AttachVolumeTestJSON-1064832613-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T02:10:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd49c6f202cc46b496df91de55c53c65',uuid=04bbae43-881f-455a-bcd2-c1be2e82f0dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-0e4bdf8e-ae14-4452-888c-e5a4b7964d12 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Converting VIF {"id": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "address": "fa:16:3e:73:2c:81", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46cdee0a-72", "ovs_interfaceid": "46cdee0a-7249-457f-b3d1-e69a6ed62504", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-0e4bdf8e-ae14-4452-888c-e5a4b7964d12 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:2c:81,bridge_name='br-int',has_traffic_filtering=True,id=46cdee0a-7249-457f-b3d1-e69a6ed62504,network=Network(699807b0-2588-4e44-967e-e11023d25985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cdee0a-72') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG os_vif [None req-0e4bdf8e-ae14-4452-888c-e5a4b7964d12 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:2c:81,bridge_name='br-int',has_traffic_filtering=True,id=46cdee0a-7249-457f-b3d1-e69a6ed62504,network=Network(699807b0-2588-4e44-967e-e11023d25985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cdee0a-72') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46cdee0a-72, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5791dac1-95bc-4fb7-83d4-0b0f354f7e19) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:31 user nova-compute[74996]: INFO os_vif [None req-0e4bdf8e-ae14-4452-888c-e5a4b7964d12 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:2c:81,bridge_name='br-int',has_traffic_filtering=True,id=46cdee0a-7249-457f-b3d1-e69a6ed62504,network=Network(699807b0-2588-4e44-967e-e11023d25985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46cdee0a-72')
Nov 02 02:12:31 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-0e4bdf8e-ae14-4452-888c-e5a4b7964d12 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Deleting instance files /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc_del
Nov 02 02:12:31 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-0e4bdf8e-ae14-4452-888c-e5a4b7964d12 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Deletion of /opt/stack/data/nova/instances/04bbae43-881f-455a-bcd2-c1be2e82f0dc_del complete
Nov 02 02:12:32 user nova-compute[74996]: INFO nova.compute.manager [None req-0e4bdf8e-ae14-4452-888c-e5a4b7964d12 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 02 02:12:32 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-0e4bdf8e-ae14-4452-888c-e5a4b7964d12 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 02:12:32 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 02:12:32 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 02:12:32 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:12:33 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Took 0.88 seconds to deallocate network for instance.
Nov 02 02:12:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-6f8f3e03-9e2a-42a5-9fd1-8ee8bb43286f req-f146161a-4f0c-4f95-beae-08c1bd01a360 service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Received event network-vif-deleted-46cdee0a-7249-457f-b3d1-e69a6ed62504 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:12:33 user nova-compute[74996]: INFO nova.compute.manager [req-6f8f3e03-9e2a-42a5-9fd1-8ee8bb43286f req-f146161a-4f0c-4f95-beae-08c1bd01a360 service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Neutron deleted interface 46cdee0a-7249-457f-b3d1-e69a6ed62504; detaching it from the instance and deleting it from the info cache
Nov 02 02:12:33 user nova-compute[74996]: DEBUG nova.network.neutron [req-6f8f3e03-9e2a-42a5-9fd1-8ee8bb43286f req-f146161a-4f0c-4f95-beae-08c1bd01a360 service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:12:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-6f8f3e03-9e2a-42a5-9fd1-8ee8bb43286f req-f146161a-4f0c-4f95-beae-08c1bd01a360 service nova] [instance: 04bbae43-881f-455a-bcd2-c1be2e82f0dc] Detach interface failed, port_id=46cdee0a-7249-457f-b3d1-e69a6ed62504, reason: Instance 04bbae43-881f-455a-bcd2-c1be2e82f0dc could not be found. {{(pid=74996) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 02:12:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0e4bdf8e-ae14-4452-888c-e5a4b7964d12 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:12:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0e4bdf8e-ae14-4452-888c-e5a4b7964d12 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:12:33 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-0e4bdf8e-ae14-4452-888c-e5a4b7964d12 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:12:33 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-0e4bdf8e-ae14-4452-888c-e5a4b7964d12 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:12:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0e4bdf8e-ae14-4452-888c-e5a4b7964d12 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:12:33 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-0e4bdf8e-ae14-4452-888c-e5a4b7964d12 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Deleted allocations for instance 04bbae43-881f-455a-bcd2-c1be2e82f0dc
Nov 02 02:12:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-0e4bdf8e-ae14-4452-888c-e5a4b7964d12 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "04bbae43-881f-455a-bcd2-c1be2e82f0dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.386s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:12:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:45 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:12:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:12:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:12:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:12:45 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 02:12:45 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:12:45 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:12:45 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:12:45 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:12:45 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4680149a-b596-48f6-8bd0-3d44b9f06f8f/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:12:45 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4680149a-b596-48f6-8bd0-3d44b9f06f8f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:12:45 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4680149a-b596-48f6-8bd0-3d44b9f06f8f/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:12:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4680149a-b596-48f6-8bd0-3d44b9f06f8f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:12:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:12:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:12:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:12:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:12:46 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:46 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:12:46 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:12:46 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8650MB free_disk=24.798656463623047GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 02:12:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:12:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:12:46 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance f4dbbf62-95bd-47e7-bbf1-16e143746a45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:12:46 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:12:46 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 4680149a-b596-48f6-8bd0-3d44b9f06f8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:12:46 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 02:12:46 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 02:12:47 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:12:47 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:12:47 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 02:12:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:12:48 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:12:48 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:12:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:49 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:12:50 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:12:50 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 02:12:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-f4dbbf62-95bd-47e7-bbf1-16e143746a45" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:12:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-f4dbbf62-95bd-47e7-bbf1-16e143746a45" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:12:50 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 02:12:50 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Updating instance_info_cache with network_info: [{"id": "4728343d-18b1-4199-a165-e0e8aa414f2b", "address": "fa:16:3e:3f:81:e4", "network": {"id": "76ec976d-a10a-4c58-8b3c-7db507c2bcd5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1016707767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c4de34aca164d5abbff0ff11b44762b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4728343d-18", "ovs_interfaceid": "4728343d-18b1-4199-a165-e0e8aa414f2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:12:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-f4dbbf62-95bd-47e7-bbf1-16e143746a45" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:12:50 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 02:12:51 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:12:51 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:12:51 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:12:51 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 02:12:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:56 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:12:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:12:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:13:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:13:16 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:13:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:13:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:13:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:13:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:13:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:13:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:13:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:13:24 user nova-compute[74996]: DEBUG nova.compute.manager [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 02:13:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:13:24 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:13:24 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 02:13:24 user nova-compute[74996]: INFO nova.compute.claims [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Claim successful on node user
Nov 02 02:13:24 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:13:25 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:13:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.289s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:13:25 user nova-compute[74996]: DEBUG nova.compute.manager [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 02:13:25 user nova-compute[74996]: DEBUG nova.compute.manager [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 02:13:25 user nova-compute[74996]: DEBUG nova.network.neutron [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 02:13:25 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 02:13:25 user nova-compute[74996]: DEBUG nova.compute.manager [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 02:13:25 user nova-compute[74996]: DEBUG nova.policy [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dd49c6f202cc46b496df91de55c53c65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee0ae54cb9642e68d847235ebe13875', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 02:13:25 user nova-compute[74996]: DEBUG nova.compute.manager [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 02:13:25 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 02:13:25 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Creating image(s)
Nov 02 02:13:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:13:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "/opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:13:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "/opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:13:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:13:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:13:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:13:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:13:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:13:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:13:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:13:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0/disk 1073741824" returned: 0 in 0.050s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:13:25 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:13:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:13:25 user nova-compute[74996]: DEBUG nova.network.neutron [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Successfully created port: e0dab6b7-2e30-4c0e-95c7-8d195066e5dd {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 02:13:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.175s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:13:25 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 02:13:25 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Cannot resize image /opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Ensure instance console log exists: /opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.network.neutron [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Successfully updated port: e0dab6b7-2e30-4c0e-95c7-8d195066e5dd {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "refresh_cache-fd4c3759-195f-43f9-ba9b-3f2c033453f0" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquired lock "refresh_cache-fd4c3759-195f-43f9-ba9b-3f2c033453f0" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.network.neutron [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.compute.manager [req-6412af40-ccc2-4233-83e7-3116c10cd5d3 req-0ce94b96-b37b-45d8-805b-289b87e3cc16 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Received event network-changed-e0dab6b7-2e30-4c0e-95c7-8d195066e5dd {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.compute.manager [req-6412af40-ccc2-4233-83e7-3116c10cd5d3 req-0ce94b96-b37b-45d8-805b-289b87e3cc16 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Refreshing instance network info cache due to event network-changed-e0dab6b7-2e30-4c0e-95c7-8d195066e5dd. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6412af40-ccc2-4233-83e7-3116c10cd5d3 req-0ce94b96-b37b-45d8-805b-289b87e3cc16 service nova] Acquiring lock "refresh_cache-fd4c3759-195f-43f9-ba9b-3f2c033453f0" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.network.neutron [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.network.neutron [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Updating instance_info_cache with network_info: [{"id": "e0dab6b7-2e30-4c0e-95c7-8d195066e5dd", "address": "fa:16:3e:7f:85:7c", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0dab6b7-2e", "ovs_interfaceid": "e0dab6b7-2e30-4c0e-95c7-8d195066e5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Releasing lock "refresh_cache-fd4c3759-195f-43f9-ba9b-3f2c033453f0" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.compute.manager [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Instance network_info: |[{"id": "e0dab6b7-2e30-4c0e-95c7-8d195066e5dd", "address": "fa:16:3e:7f:85:7c", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0dab6b7-2e", "ovs_interfaceid": "e0dab6b7-2e30-4c0e-95c7-8d195066e5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6412af40-ccc2-4233-83e7-3116c10cd5d3 req-0ce94b96-b37b-45d8-805b-289b87e3cc16 service nova] Acquired lock "refresh_cache-fd4c3759-195f-43f9-ba9b-3f2c033453f0" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.network.neutron [req-6412af40-ccc2-4233-83e7-3116c10cd5d3 req-0ce94b96-b37b-45d8-805b-289b87e3cc16 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Refreshing network info cache for port e0dab6b7-2e30-4c0e-95c7-8d195066e5dd {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Start _get_guest_xml network_info=[{"id": "e0dab6b7-2e30-4c0e-95c7-8d195066e5dd", "address": "fa:16:3e:7f:85:7c", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0dab6b7-2e", "ovs_interfaceid": "e0dab6b7-2e30-4c0e-95c7-8d195066e5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 02:13:26 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:13:26 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:13:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1459802335',display_name='tempest-AttachVolumeTestJSON-server-1459802335',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1459802335',id=50,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5zwu8ba/QO8AymlbeQVVnp7NVkdGarDoqTi+mZX2u/xg7ZHka08hmtGgFQV9DruWxMbCsTXYIufD9QQg3jDsi48OFiNg40o9EUK3BfXKTWL5/1t9DdtPWqsZ7x/g7JFA==',key_name='tempest-keypair-1079969230',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fee0ae54cb9642e68d847235ebe13875',ramdisk_id='',reservation_id='r-270bo31y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1064832613',owner_user_name='tempest-AttachVolumeTestJSON-1064832613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T02:13:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd49c6f202cc46b496df91de55c53c65',uuid=fd4c3759-195f-43f9-ba9b-3f2c033453f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0dab6b7-2e30-4c0e-95c7-8d195066e5dd", "address": "fa:16:3e:7f:85:7c", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0dab6b7-2e", "ovs_interfaceid": "e0dab6b7-2e30-4c0e-95c7-8d195066e5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Converting VIF {"id": "e0dab6b7-2e30-4c0e-95c7-8d195066e5dd", "address": "fa:16:3e:7f:85:7c", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0dab6b7-2e", "ovs_interfaceid": "e0dab6b7-2e30-4c0e-95c7-8d195066e5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:85:7c,bridge_name='br-int',has_traffic_filtering=True,id=e0dab6b7-2e30-4c0e-95c7-8d195066e5dd,network=Network(699807b0-2588-4e44-967e-e11023d25985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0dab6b7-2e') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.objects.instance [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'pci_devices' on Instance uuid fd4c3759-195f-43f9-ba9b-3f2c033453f0 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] End _get_guest_xml xml=<domain type="kvm">
Nov 02 02:13:26 user nova-compute[74996]:   <uuid>fd4c3759-195f-43f9-ba9b-3f2c033453f0</uuid>
Nov 02 02:13:26 user nova-compute[74996]:   <name>instance-00000032</name>
Nov 02 02:13:26 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 02:13:26 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 02:13:26 user nova-compute[74996]:   <metadata>
Nov 02 02:13:26 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 02:13:26 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 02:13:26 user nova-compute[74996]:       <nova:name>tempest-AttachVolumeTestJSON-server-1459802335</nova:name>
Nov 02 02:13:26 user nova-compute[74996]:       <nova:creationTime>2023-11-02 02:13:26</nova:creationTime>
Nov 02 02:13:26 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 02:13:26 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 02:13:26 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 02:13:26 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 02:13:26 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 02:13:26 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 02:13:26 user nova-compute[74996]:       </nova:flavor>
Nov 02 02:13:26 user nova-compute[74996]:       <nova:owner>
Nov 02 02:13:26 user nova-compute[74996]:         <nova:user uuid="dd49c6f202cc46b496df91de55c53c65">tempest-AttachVolumeTestJSON-1064832613-project-member</nova:user>
Nov 02 02:13:26 user nova-compute[74996]:         <nova:project uuid="fee0ae54cb9642e68d847235ebe13875">tempest-AttachVolumeTestJSON-1064832613</nova:project>
Nov 02 02:13:26 user nova-compute[74996]:       </nova:owner>
Nov 02 02:13:26 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 02:13:26 user nova-compute[74996]:       <nova:ports>
Nov 02 02:13:26 user nova-compute[74996]:         <nova:port uuid="e0dab6b7-2e30-4c0e-95c7-8d195066e5dd">
Nov 02 02:13:26 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 02 02:13:26 user nova-compute[74996]:         </nova:port>
Nov 02 02:13:26 user nova-compute[74996]:       </nova:ports>
Nov 02 02:13:26 user nova-compute[74996]:     </nova:instance>
Nov 02 02:13:26 user nova-compute[74996]:   </metadata>
Nov 02 02:13:26 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 02:13:26 user nova-compute[74996]:     <system>
Nov 02 02:13:26 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 02:13:26 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 02:13:26 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 02:13:26 user nova-compute[74996]:       <entry name="serial">fd4c3759-195f-43f9-ba9b-3f2c033453f0</entry>
Nov 02 02:13:26 user nova-compute[74996]:       <entry name="uuid">fd4c3759-195f-43f9-ba9b-3f2c033453f0</entry>
Nov 02 02:13:26 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 02:13:26 user nova-compute[74996]:     </system>
Nov 02 02:13:26 user nova-compute[74996]:   </sysinfo>
Nov 02 02:13:26 user nova-compute[74996]:   <os>
Nov 02 02:13:26 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 02:13:26 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 02:13:26 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 02:13:26 user nova-compute[74996]:   </os>
Nov 02 02:13:26 user nova-compute[74996]:   <features>
Nov 02 02:13:26 user nova-compute[74996]:     <acpi/>
Nov 02 02:13:26 user nova-compute[74996]:     <apic/>
Nov 02 02:13:26 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 02:13:26 user nova-compute[74996]:   </features>
Nov 02 02:13:26 user nova-compute[74996]:   <clock offset="utc">
Nov 02 02:13:26 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 02:13:26 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 02:13:26 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 02:13:26 user nova-compute[74996]:   </clock>
Nov 02 02:13:26 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 02:13:26 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 02:13:26 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 02:13:26 user nova-compute[74996]:   </cpu>
Nov 02 02:13:26 user nova-compute[74996]:   <devices>
Nov 02 02:13:26 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 02:13:26 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 02:13:26 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0/disk"/>
Nov 02 02:13:26 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 02:13:26 user nova-compute[74996]:     </disk>
Nov 02 02:13:26 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 02:13:26 user nova-compute[74996]:       <mac address="fa:16:3e:7f:85:7c"/>
Nov 02 02:13:26 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 02:13:26 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 02:13:26 user nova-compute[74996]:       <target dev="tape0dab6b7-2e"/>
Nov 02 02:13:26 user nova-compute[74996]:     </interface>
Nov 02 02:13:26 user nova-compute[74996]:     <serial type="pty">
Nov 02 02:13:26 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0/console.log" append="off"/>
Nov 02 02:13:26 user nova-compute[74996]:     </serial>
Nov 02 02:13:26 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 02:13:26 user nova-compute[74996]:     <video>
Nov 02 02:13:26 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 02:13:26 user nova-compute[74996]:     </video>
Nov 02 02:13:26 user nova-compute[74996]:     <rng model="virtio">
Nov 02 02:13:26 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 02:13:26 user nova-compute[74996]:     </rng>
Nov 02 02:13:26 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 02:13:26 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 02:13:26 user nova-compute[74996]:       <stats period="10"/>
Nov 02 02:13:26 user nova-compute[74996]:     </memballoon>
Nov 02 02:13:26 user nova-compute[74996]:   </devices>
Nov 02 02:13:26 user nova-compute[74996]: </domain>
Nov 02 02:13:26 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:13:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1459802335',display_name='tempest-AttachVolumeTestJSON-server-1459802335',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1459802335',id=50,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5zwu8ba/QO8AymlbeQVVnp7NVkdGarDoqTi+mZX2u/xg7ZHka08hmtGgFQV9DruWxMbCsTXYIufD9QQg3jDsi48OFiNg40o9EUK3BfXKTWL5/1t9DdtPWqsZ7x/g7JFA==',key_name='tempest-keypair-1079969230',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fee0ae54cb9642e68d847235ebe13875',ramdisk_id='',reservation_id='r-270bo31y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1064832613',owner_user_name='tempest-AttachVolumeTestJSON-1064832613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T02:13:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd49c6f202cc46b496df91de55c53c65',uuid=fd4c3759-195f-43f9-ba9b-3f2c033453f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0dab6b7-2e30-4c0e-95c7-8d195066e5dd", "address": "fa:16:3e:7f:85:7c", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0dab6b7-2e", "ovs_interfaceid": "e0dab6b7-2e30-4c0e-95c7-8d195066e5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Converting VIF {"id": "e0dab6b7-2e30-4c0e-95c7-8d195066e5dd", "address": "fa:16:3e:7f:85:7c", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0dab6b7-2e", "ovs_interfaceid": "e0dab6b7-2e30-4c0e-95c7-8d195066e5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:85:7c,bridge_name='br-int',has_traffic_filtering=True,id=e0dab6b7-2e30-4c0e-95c7-8d195066e5dd,network=Network(699807b0-2588-4e44-967e-e11023d25985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0dab6b7-2e') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG os_vif [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:85:7c,bridge_name='br-int',has_traffic_filtering=True,id=e0dab6b7-2e30-4c0e-95c7-8d195066e5dd,network=Network(699807b0-2588-4e44-967e-e11023d25985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0dab6b7-2e') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a3b37f8-60b4-57da-8cb3-f8715a33aac3', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0dab6b7-2e, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape0dab6b7-2e, col_values=(('qos', UUID('ff8c7d58-a29c-4e83-96fc-9abcebda1c6c')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape0dab6b7-2e, col_values=(('external_ids', {'iface-id': 'e0dab6b7-2e30-4c0e-95c7-8d195066e5dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:85:7c', 'vm-uuid': 'fd4c3759-195f-43f9-ba9b-3f2c033453f0'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:26 user nova-compute[74996]: INFO os_vif [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:85:7c,bridge_name='br-int',has_traffic_filtering=True,id=e0dab6b7-2e30-4c0e-95c7-8d195066e5dd,network=Network(699807b0-2588-4e44-967e-e11023d25985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0dab6b7-2e')
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:13:26 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] No VIF found with MAC fa:16:3e:7f:85:7c, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 02:13:27 user nova-compute[74996]: DEBUG nova.network.neutron [req-6412af40-ccc2-4233-83e7-3116c10cd5d3 req-0ce94b96-b37b-45d8-805b-289b87e3cc16 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Updated VIF entry in instance network info cache for port e0dab6b7-2e30-4c0e-95c7-8d195066e5dd. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 02:13:27 user nova-compute[74996]: DEBUG nova.network.neutron [req-6412af40-ccc2-4233-83e7-3116c10cd5d3 req-0ce94b96-b37b-45d8-805b-289b87e3cc16 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Updating instance_info_cache with network_info: [{"id": "e0dab6b7-2e30-4c0e-95c7-8d195066e5dd", "address": "fa:16:3e:7f:85:7c", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0dab6b7-2e", "ovs_interfaceid": "e0dab6b7-2e30-4c0e-95c7-8d195066e5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:13:27 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-6412af40-ccc2-4233-83e7-3116c10cd5d3 req-0ce94b96-b37b-45d8-805b-289b87e3cc16 service nova] Releasing lock "refresh_cache-fd4c3759-195f-43f9-ba9b-3f2c033453f0" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:13:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:28 user nova-compute[74996]: DEBUG nova.compute.manager [req-41a52357-14eb-4bb7-a3a7-727eec964dd2 req-5d25f047-2aa3-40d9-91a8-e6a9fd69d658 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Received event network-vif-plugged-e0dab6b7-2e30-4c0e-95c7-8d195066e5dd {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:13:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-41a52357-14eb-4bb7-a3a7-727eec964dd2 req-5d25f047-2aa3-40d9-91a8-e6a9fd69d658 service nova] Acquiring lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:13:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-41a52357-14eb-4bb7-a3a7-727eec964dd2 req-5d25f047-2aa3-40d9-91a8-e6a9fd69d658 service nova] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:13:28 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-41a52357-14eb-4bb7-a3a7-727eec964dd2 req-5d25f047-2aa3-40d9-91a8-e6a9fd69d658 service nova] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:13:28 user nova-compute[74996]: DEBUG nova.compute.manager [req-41a52357-14eb-4bb7-a3a7-727eec964dd2 req-5d25f047-2aa3-40d9-91a8-e6a9fd69d658 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] No waiting events found dispatching network-vif-plugged-e0dab6b7-2e30-4c0e-95c7-8d195066e5dd {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:13:28 user nova-compute[74996]: WARNING nova.compute.manager [req-41a52357-14eb-4bb7-a3a7-727eec964dd2 req-5d25f047-2aa3-40d9-91a8-e6a9fd69d658 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Received unexpected event network-vif-plugged-e0dab6b7-2e30-4c0e-95c7-8d195066e5dd for instance with vm_state building and task_state spawning.
Nov 02 02:13:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:30 user nova-compute[74996]: DEBUG nova.compute.manager [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 02:13:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 02:13:30 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Instance spawned successfully.
Nov 02 02:13:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 02:13:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:13:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:13:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:13:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:13:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:13:30 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:13:30 user nova-compute[74996]: DEBUG nova.compute.manager [req-5ebf6eb2-da1b-4f7c-beea-6354e2b99d9c req-cd479b2a-e15d-4de5-8eb6-87ac36ed1bc1 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Received event network-vif-plugged-e0dab6b7-2e30-4c0e-95c7-8d195066e5dd {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:13:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5ebf6eb2-da1b-4f7c-beea-6354e2b99d9c req-cd479b2a-e15d-4de5-8eb6-87ac36ed1bc1 service nova] Acquiring lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:13:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5ebf6eb2-da1b-4f7c-beea-6354e2b99d9c req-cd479b2a-e15d-4de5-8eb6-87ac36ed1bc1 service nova] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:13:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-5ebf6eb2-da1b-4f7c-beea-6354e2b99d9c req-cd479b2a-e15d-4de5-8eb6-87ac36ed1bc1 service nova] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:13:30 user nova-compute[74996]: DEBUG nova.compute.manager [req-5ebf6eb2-da1b-4f7c-beea-6354e2b99d9c req-cd479b2a-e15d-4de5-8eb6-87ac36ed1bc1 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] No waiting events found dispatching network-vif-plugged-e0dab6b7-2e30-4c0e-95c7-8d195066e5dd {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:13:30 user nova-compute[74996]: WARNING nova.compute.manager [req-5ebf6eb2-da1b-4f7c-beea-6354e2b99d9c req-cd479b2a-e15d-4de5-8eb6-87ac36ed1bc1 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Received unexpected event network-vif-plugged-e0dab6b7-2e30-4c0e-95c7-8d195066e5dd for instance with vm_state building and task_state spawning.
Nov 02 02:13:30 user nova-compute[74996]: INFO nova.compute.manager [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 02 02:13:30 user nova-compute[74996]: DEBUG nova.compute.manager [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 02:13:30 user nova-compute[74996]: INFO nova.compute.manager [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Took 6.01 seconds to build instance.
Nov 02 02:13:30 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-529a02ed-1570-44df-aa9c-815d3bb43833 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.109s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:13:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:13:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:13:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:13:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:13:41 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:46 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:13:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:13:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:13:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:13:46 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 02:13:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:13:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:13:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:13:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:13:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4680149a-b596-48f6-8bd0-3d44b9f06f8f/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:13:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4680149a-b596-48f6-8bd0-3d44b9f06f8f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:13:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4680149a-b596-48f6-8bd0-3d44b9f06f8f/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:13:46 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4680149a-b596-48f6-8bd0-3d44b9f06f8f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:13:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:13:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:13:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:13:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:13:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:13:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:13:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:13:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:13:48 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:13:48 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:13:48 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8450MB free_disk=24.769947052001953GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 02:13:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:13:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:13:48 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance f4dbbf62-95bd-47e7-bbf1-16e143746a45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:13:48 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:13:48 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 4680149a-b596-48f6-8bd0-3d44b9f06f8f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:13:48 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance fd4c3759-195f-43f9-ba9b-3f2c033453f0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:13:48 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 02:13:48 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 02:13:48 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:13:48 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:13:48 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 02:13:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.319s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:13:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:49 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:13:49 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:13:50 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:13:51 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:13:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:52 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:13:52 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 02:13:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:13:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:13:52 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 02:13:52 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Updating instance_info_cache with network_info: [{"id": "181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1", "address": "fa:16:3e:9b:6d:bc", "network": {"id": "3578933b-907b-439c-92d0-4311826a0163", "bridge": "br-int", "label": "tempest-TestStampPattern-1622075405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7cdc1a0ba64a25821d5c99b20de231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181e7d4d-be", "ovs_interfaceid": "181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:13:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:13:52 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 02:13:53 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:13:53 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:13:53 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 02:13:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:56 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:13:58 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:13:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:14:01 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:14:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:14:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:14:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:14:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:14:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:14:06 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:14:09 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:14:11 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:14:16 user nova-compute[74996]: DEBUG nova.compute.manager [req-8753eb5f-d577-42f8-8d52-fd73b1a6d5f9 req-abdb62c3-c3a0-4e1f-b8b2-02f8193a382e service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Received event network-changed-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:14:16 user nova-compute[74996]: DEBUG nova.compute.manager [req-8753eb5f-d577-42f8-8d52-fd73b1a6d5f9 req-abdb62c3-c3a0-4e1f-b8b2-02f8193a382e service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Refreshing instance network info cache due to event network-changed-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 02:14:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8753eb5f-d577-42f8-8d52-fd73b1a6d5f9 req-abdb62c3-c3a0-4e1f-b8b2-02f8193a382e service nova] Acquiring lock "refresh_cache-4680149a-b596-48f6-8bd0-3d44b9f06f8f" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:14:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8753eb5f-d577-42f8-8d52-fd73b1a6d5f9 req-abdb62c3-c3a0-4e1f-b8b2-02f8193a382e service nova] Acquired lock "refresh_cache-4680149a-b596-48f6-8bd0-3d44b9f06f8f" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:14:16 user nova-compute[74996]: DEBUG nova.network.neutron [req-8753eb5f-d577-42f8-8d52-fd73b1a6d5f9 req-abdb62c3-c3a0-4e1f-b8b2-02f8193a382e service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Refreshing network info cache for port 1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 02:14:16 user nova-compute[74996]: DEBUG nova.network.neutron [req-8753eb5f-d577-42f8-8d52-fd73b1a6d5f9 req-abdb62c3-c3a0-4e1f-b8b2-02f8193a382e service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Updated VIF entry in instance network info cache for port 1b77658b-f8a7-4cae-bcd6-12f849a7cdc8. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 02:14:16 user nova-compute[74996]: DEBUG nova.network.neutron [req-8753eb5f-d577-42f8-8d52-fd73b1a6d5f9 req-abdb62c3-c3a0-4e1f-b8b2-02f8193a382e service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Updating instance_info_cache with network_info: [{"id": "1b77658b-f8a7-4cae-bcd6-12f849a7cdc8", "address": "fa:16:3e:01:5c:7c", "network": {"id": "3578933b-907b-439c-92d0-4311826a0163", "bridge": "br-int", "label": "tempest-TestStampPattern-1622075405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7cdc1a0ba64a25821d5c99b20de231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b77658b-f8", "ovs_interfaceid": "1b77658b-f8a7-4cae-bcd6-12f849a7cdc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:14:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8753eb5f-d577-42f8-8d52-fd73b1a6d5f9 req-abdb62c3-c3a0-4e1f-b8b2-02f8193a382e service nova] Releasing lock "refresh_cache-4680149a-b596-48f6-8bd0-3d44b9f06f8f" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:14:16 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:14:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:14:17 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:14:17 user nova-compute[74996]: DEBUG nova.objects.instance [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lazy-loading 'flavor' on Instance uuid 4680149a-b596-48f6-8bd0-3d44b9f06f8f {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:14:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.126s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:14:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:14:18 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:14:18 user nova-compute[74996]: INFO nova.compute.manager [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Attaching volume c5509755-bb91-45df-9984-25113f5db1ec to /dev/vdb
Nov 02 02:14:18 user nova-compute[74996]: DEBUG os_brick.utils [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:14:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:14:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:14:18 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6489c8bd-5971-4b28-9cf7-7e8d2a5f46a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:14:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:14:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:14:18 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de4b02f-14e5-4321-b930-517508e0de74]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:14:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:14:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:14:18 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1e1b65-8819-4bdd-9ec4-5adb254cf07e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:14:18 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[552970d0-4cca-44a2-9300-dc62dba33e67]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:14:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:14:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 02:14:18 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 02:14:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:14:18 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 02:14:18 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 02:14:18 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d91cc8-eb8e-4cfa-b94f-440745f2492e]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:14:18 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 02:14:18 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 02:14:18 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 02:14:18 user nova-compute[74996]: DEBUG os_brick.utils [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:14:18 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Updating existing volume attachment record: f891f43f-659d-4086-97d5-c9cade15ebec {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 02:14:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:14:21 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:14:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:14:26 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:14:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:14:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:14:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:14:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:14:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:14:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:14:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:14:36 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'INxvdesY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:14:37 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:14:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:14:37 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:14:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:14:37 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[229da2ae-2b48-4b95-b2b0-782d69d4f67e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 02:14:37 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[984446b2-dcb7-483d-b563-fe7c57366982]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec] added
Nov 02 02:14:37 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e051ea-5864-44e9-977c-6ea4a032d848]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[95eaafab-4950-482b-878b-54ca0dc338e9]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v INxvdesY {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v INxvdesY" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff14153-adb7-45bc-8e4a-fc582c046f9b]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'INxvdesY'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[257ca5b5-998a-4541-9f8b-b0245997d487]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb78036-8050-48b2-8fcf-4f520454b2ca]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 02:14:37 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 02:14:37 user nova-compute[74996]:  {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:14:37 user nova-compute[74996]: WARNING os_brick.initiator.connectors.iscsi [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 02:14:37 user nova-compute[74996]: 
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6adb05-395c-4eb8-8f0c-222448d92d1b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec, portal: 172.16.0.220,3260]
Nov 02 02:14:37 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec, portal: 172.16.0.220,3260] successful.
Nov 02 02:14:37 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[34079a73-a674-4607-99b6-272406fc0cc7]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45000cc-bd96-4ff7-b44c-bd592ad70b9f]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec (non-flash)
Nov 02 02:14:37 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec (non-flash)
Nov 02 02:14:37 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59bc1dc-d214-4d52-b0c2-590b34c2473a]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 02:14:37 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'INxvdesY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 02:14:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:14:38 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23464633230356239', 'path': '/dev/sdb'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:14:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464633230356239', 'path': '/dev/sdb'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 02:14:38 user nova-compute[74996]: DEBUG nova.objects.instance [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lazy-loading 'flavor' on Instance uuid 4680149a-b596-48f6-8bd0-3d44b9f06f8f {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:14:38 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 02:14:38 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:14:38 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 02:14:38 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:14:38 user nova-compute[74996]:   <serial>c5509755-bb91-45df-9984-25113f5db1ec</serial>
Nov 02 02:14:38 user nova-compute[74996]: </disk>
Nov 02 02:14:38 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-2fe6e002-3968-4a2e-aa1a-d0c60173dd17 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Acquiring lock "f4dbbf62-95bd-47e7-bbf1-16e143746a45" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-2fe6e002-3968-4a2e-aa1a-d0c60173dd17 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "f4dbbf62-95bd-47e7-bbf1-16e143746a45" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-2fe6e002-3968-4a2e-aa1a-d0c60173dd17 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Acquiring lock "f4dbbf62-95bd-47e7-bbf1-16e143746a45-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-2fe6e002-3968-4a2e-aa1a-d0c60173dd17 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "f4dbbf62-95bd-47e7-bbf1-16e143746a45-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-2fe6e002-3968-4a2e-aa1a-d0c60173dd17 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "f4dbbf62-95bd-47e7-bbf1-16e143746a45-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:14:39 user nova-compute[74996]: INFO nova.compute.manager [None req-2fe6e002-3968-4a2e-aa1a-d0c60173dd17 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Terminating instance
Nov 02 02:14:39 user nova-compute[74996]: DEBUG nova.compute.manager [None req-2fe6e002-3968-4a2e-aa1a-d0c60173dd17 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] No VIF found with MAC fa:16:3e:01:5c:7c, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG nova.compute.manager [req-a6ff8a85-f70b-4415-bac8-4704563df6e0 req-eb5a7beb-b69f-4bb1-906a-083860d6e879 service nova] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Received event network-vif-unplugged-4728343d-18b1-4199-a165-e0e8aa414f2b {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a6ff8a85-f70b-4415-bac8-4704563df6e0 req-eb5a7beb-b69f-4bb1-906a-083860d6e879 service nova] Acquiring lock "f4dbbf62-95bd-47e7-bbf1-16e143746a45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a6ff8a85-f70b-4415-bac8-4704563df6e0 req-eb5a7beb-b69f-4bb1-906a-083860d6e879 service nova] Lock "f4dbbf62-95bd-47e7-bbf1-16e143746a45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-a6ff8a85-f70b-4415-bac8-4704563df6e0 req-eb5a7beb-b69f-4bb1-906a-083860d6e879 service nova] Lock "f4dbbf62-95bd-47e7-bbf1-16e143746a45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG nova.compute.manager [req-a6ff8a85-f70b-4415-bac8-4704563df6e0 req-eb5a7beb-b69f-4bb1-906a-083860d6e879 service nova] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] No waiting events found dispatching network-vif-unplugged-4728343d-18b1-4199-a165-e0e8aa414f2b {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG nova.compute.manager [req-a6ff8a85-f70b-4415-bac8-4704563df6e0 req-eb5a7beb-b69f-4bb1-906a-083860d6e879 service nova] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Received event network-vif-unplugged-4728343d-18b1-4199-a165-e0e8aa414f2b for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-35474f6d-1ab0-4ea0-b06c-32e63b6a49b3 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.233s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:14:39 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Instance destroyed successfully.
Nov 02 02:14:39 user nova-compute[74996]: DEBUG nova.objects.instance [None req-2fe6e002-3968-4a2e-aa1a-d0c60173dd17 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lazy-loading 'resources' on Instance uuid f4dbbf62-95bd-47e7-bbf1-16e143746a45 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-2fe6e002-3968-4a2e-aa1a-d0c60173dd17 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:05:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-963081613',display_name='tempest-ServersNegativeTestJSON-server-963081613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-963081613',id=46,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T02:05:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c4de34aca164d5abbff0ff11b44762b',ramdisk_id='',reservation_id='r-frctbyrs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-235429949',owner_user_name='tempest-ServersNegativeTestJSON-235429949-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T02:05:39Z,user_data=None,user_id='d189b000f4cd4c9cb835abd85b9180f1',uuid=f4dbbf62-95bd-47e7-bbf1-16e143746a45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4728343d-18b1-4199-a165-e0e8aa414f2b", "address": "fa:16:3e:3f:81:e4", "network": {"id": "76ec976d-a10a-4c58-8b3c-7db507c2bcd5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1016707767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c4de34aca164d5abbff0ff11b44762b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4728343d-18", "ovs_interfaceid": "4728343d-18b1-4199-a165-e0e8aa414f2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-2fe6e002-3968-4a2e-aa1a-d0c60173dd17 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Converting VIF {"id": "4728343d-18b1-4199-a165-e0e8aa414f2b", "address": "fa:16:3e:3f:81:e4", "network": {"id": "76ec976d-a10a-4c58-8b3c-7db507c2bcd5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1016707767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c4de34aca164d5abbff0ff11b44762b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4728343d-18", "ovs_interfaceid": "4728343d-18b1-4199-a165-e0e8aa414f2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-2fe6e002-3968-4a2e-aa1a-d0c60173dd17 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:81:e4,bridge_name='br-int',has_traffic_filtering=True,id=4728343d-18b1-4199-a165-e0e8aa414f2b,network=Network(76ec976d-a10a-4c58-8b3c-7db507c2bcd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4728343d-18') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG os_vif [None req-2fe6e002-3968-4a2e-aa1a-d0c60173dd17 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:81:e4,bridge_name='br-int',has_traffic_filtering=True,id=4728343d-18b1-4199-a165-e0e8aa414f2b,network=Network(76ec976d-a10a-4c58-8b3c-7db507c2bcd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4728343d-18') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4728343d-18, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f71950d-760d-4e6e-bc2e-0b0b53d37d89) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:14:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:14:39 user nova-compute[74996]: INFO os_vif [None req-2fe6e002-3968-4a2e-aa1a-d0c60173dd17 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:81:e4,bridge_name='br-int',has_traffic_filtering=True,id=4728343d-18b1-4199-a165-e0e8aa414f2b,network=Network(76ec976d-a10a-4c58-8b3c-7db507c2bcd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4728343d-18')
Nov 02 02:14:39 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-2fe6e002-3968-4a2e-aa1a-d0c60173dd17 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Deleting instance files /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45_del
Nov 02 02:14:39 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-2fe6e002-3968-4a2e-aa1a-d0c60173dd17 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Deletion of /opt/stack/data/nova/instances/f4dbbf62-95bd-47e7-bbf1-16e143746a45_del complete
Nov 02 02:14:40 user nova-compute[74996]: INFO nova.compute.manager [None req-2fe6e002-3968-4a2e-aa1a-d0c60173dd17 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 02 02:14:40 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-2fe6e002-3968-4a2e-aa1a-d0c60173dd17 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 02:14:40 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 02:14:40 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 02:14:40 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:14:40 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Took 0.45 seconds to deallocate network for instance.
Nov 02 02:14:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-2fe6e002-3968-4a2e-aa1a-d0c60173dd17 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:14:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-2fe6e002-3968-4a2e-aa1a-d0c60173dd17 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:14:40 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-2fe6e002-3968-4a2e-aa1a-d0c60173dd17 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:14:40 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-2fe6e002-3968-4a2e-aa1a-d0c60173dd17 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:14:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-2fe6e002-3968-4a2e-aa1a-d0c60173dd17 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:14:40 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-2fe6e002-3968-4a2e-aa1a-d0c60173dd17 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Deleted allocations for instance f4dbbf62-95bd-47e7-bbf1-16e143746a45
Nov 02 02:14:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:14:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:14:40 user nova-compute[74996]: INFO nova.compute.manager [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Detaching volume c5509755-bb91-45df-9984-25113f5db1ec
Nov 02 02:14:40 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-2fe6e002-3968-4a2e-aa1a-d0c60173dd17 tempest-ServersNegativeTestJSON-235429949 tempest-ServersNegativeTestJSON-235429949-project-member] Lock "f4dbbf62-95bd-47e7-bbf1-16e143746a45" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.694s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:14:40 user nova-compute[74996]: INFO nova.virt.block_device [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Attempting to driver detach volume c5509755-bb91-45df-9984-25113f5db1ec from mountpoint /dev/vdb
Nov 02 02:14:40 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Attempting to detach device vdb from instance 4680149a-b596-48f6-8bd0-3d44b9f06f8f from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 02:14:40 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 02:14:40 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:14:40 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 02:14:40 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:14:40 user nova-compute[74996]:   <serial>c5509755-bb91-45df-9984-25113f5db1ec</serial>
Nov 02 02:14:40 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 02:14:40 user nova-compute[74996]: </disk>
Nov 02 02:14:40 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 02:14:40 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Successfully detached device vdb from instance 4680149a-b596-48f6-8bd0-3d44b9f06f8f from the persistent domain config.
Nov 02 02:14:40 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4680149a-b596-48f6-8bd0-3d44b9f06f8f from the live domain config. {{(pid=74996) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 02:14:40 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 02:14:40 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:14:40 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 02:14:40 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:14:40 user nova-compute[74996]:   <serial>c5509755-bb91-45df-9984-25113f5db1ec</serial>
Nov 02 02:14:40 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 02:14:40 user nova-compute[74996]: </disk>
Nov 02 02:14:40 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 02:14:41 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4680149a-b596-48f6-8bd0-3d44b9f06f8f {{(pid=74996) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 02:14:41 user nova-compute[74996]: DEBUG nova.compute.manager [req-b6c72a25-857c-426e-b23b-368098ba246c req-ac744408-f033-430f-b77e-404f9b392aa6 service nova] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Received event network-vif-plugged-4728343d-18b1-4199-a165-e0e8aa414f2b {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:14:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b6c72a25-857c-426e-b23b-368098ba246c req-ac744408-f033-430f-b77e-404f9b392aa6 service nova] Acquiring lock "f4dbbf62-95bd-47e7-bbf1-16e143746a45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:14:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b6c72a25-857c-426e-b23b-368098ba246c req-ac744408-f033-430f-b77e-404f9b392aa6 service nova] Lock "f4dbbf62-95bd-47e7-bbf1-16e143746a45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:14:41 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-b6c72a25-857c-426e-b23b-368098ba246c req-ac744408-f033-430f-b77e-404f9b392aa6 service nova] Lock "f4dbbf62-95bd-47e7-bbf1-16e143746a45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:14:41 user nova-compute[74996]: DEBUG nova.compute.manager [req-b6c72a25-857c-426e-b23b-368098ba246c req-ac744408-f033-430f-b77e-404f9b392aa6 service nova] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] No waiting events found dispatching network-vif-plugged-4728343d-18b1-4199-a165-e0e8aa414f2b {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:14:41 user nova-compute[74996]: WARNING nova.compute.manager [req-b6c72a25-857c-426e-b23b-368098ba246c req-ac744408-f033-430f-b77e-404f9b392aa6 service nova] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Received unexpected event network-vif-plugged-4728343d-18b1-4199-a165-e0e8aa414f2b for instance with vm_state deleted and task_state None.
Nov 02 02:14:41 user nova-compute[74996]: DEBUG nova.compute.manager [req-b6c72a25-857c-426e-b23b-368098ba246c req-ac744408-f033-430f-b77e-404f9b392aa6 service nova] [instance: f4dbbf62-95bd-47e7-bbf1-16e143746a45] Received event network-vif-deleted-4728343d-18b1-4199-a165-e0e8aa414f2b {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:14:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:14:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:14:46 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:14:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:14:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:14:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:14:46 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 02:14:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:14:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:14:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:14:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:14:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4680149a-b596-48f6-8bd0-3d44b9f06f8f/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:14:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4680149a-b596-48f6-8bd0-3d44b9f06f8f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:14:46 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4680149a-b596-48f6-8bd0-3d44b9f06f8f/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:14:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4680149a-b596-48f6-8bd0-3d44b9f06f8f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:14:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:14:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:14:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:14:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:14:47 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:14:47 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:14:47 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8608MB free_disk=24.794692993164062GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 02:14:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:14:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:14:47 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:14:47 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 4680149a-b596-48f6-8bd0-3d44b9f06f8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:14:47 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance fd4c3759-195f-43f9-ba9b-3f2c033453f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:14:47 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 02:14:47 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 02:14:47 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:14:47 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:14:47 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 02:14:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:14:48 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:14:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:14:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:14:51 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:14:52 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:14:52 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 02:14:52 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Rebuilding the list of instances to heal {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 02:14:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:14:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:14:52 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 02:14:52 user nova-compute[74996]: DEBUG nova.objects.instance [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lazy-loading 'info_cache' on Instance uuid 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:14:52 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Updating instance_info_cache with network_info: [{"id": "181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1", "address": "fa:16:3e:9b:6d:bc", "network": {"id": "3578933b-907b-439c-92d0-4311826a0163", "bridge": "br-int", "label": "tempest-TestStampPattern-1622075405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7cdc1a0ba64a25821d5c99b20de231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181e7d4d-be", "ovs_interfaceid": "181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:14:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:14:52 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 02:14:52 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:14:52 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:14:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:14:55 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:14:55 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:14:55 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 02:14:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:14:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:14:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:14:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:14:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:14:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:15:00 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:15:01 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4680149a-b596-48f6-8bd0-3d44b9f06f8f is timed out.
Nov 02 02:15:01 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Successfully detached device vdb from instance 4680149a-b596-48f6-8bd0-3d44b9f06f8f from the live domain config.
Nov 02 02:15:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'INxvdesY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:15:01 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:15:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ff5f05-c8d3-4d95-bc0d-3baee1247ca4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 02:15:01 user nova-compute[74996]: No targets found.
Nov 02 02:15:01 user nova-compute[74996]: iSNS:
Nov 02 02:15:01 user nova-compute[74996]: No targets found.
Nov 02 02:15:01 user nova-compute[74996]: STATIC:
Nov 02 02:15:01 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec
Nov 02 02:15:01 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 02:15:01 user nova-compute[74996]:                 Iface Name: default
Nov 02 02:15:01 user nova-compute[74996]: FIRMWARE:
Nov 02 02:15:01 user nova-compute[74996]: No targets found.
Nov 02 02:15:01 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 02:15:01 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 02:15:01 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[35614475-a195-47e8-b64b-6f3399d04a7e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc2ed6b-07d6-4641-bff7-09cd58a9d174]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec (non-flash)
Nov 02 02:15:01 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec (non-flash)
Nov 02 02:15:01 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e852ec20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec'): ({'sdb'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Removing single pathed devices sdb {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd50397-bf7a-4b5c-a513-7f6f0f6a10bb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[675bd5bb-3da5-45c7-b22b-39d217610b7c]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Flushing IO for device /dev/sdb {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c1b848-84ba-438c-96e2-59b62d5a25a0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[495b4e8a-4e9b-490b-b4f2-404e933e935f]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dab9444-5c01-4dff-90be-7b5eb3545ca0]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a206b2-2fe7-4497-ad81-0d82815faddf]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec, portal: 172.16.0.220,3260]
Nov 02 02:15:01 user nova-compute[74996]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec, portal: 172.16.0.220,3260] successful.
Nov 02 02:15:01 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5509755-bb91-45df-9984-25113f5db1ec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91bd258-6564-4ffa-9739-70337bcbf89f]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] <== disconnect_volume: return (275ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:15:01 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 02:15:02 user nova-compute[74996]: DEBUG nova.objects.instance [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lazy-loading 'flavor' on Instance uuid 4680149a-b596-48f6-8bd0-3d44b9f06f8f {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:15:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-db3f6fcf-ef71-436b-a724-76a8b12192e1 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.763s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:15:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:15:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:15:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:15:15 user nova-compute[74996]: DEBUG nova.compute.manager [req-25a7e750-c10e-4560-a8e0-fc644c5ada7d req-14f87abe-bc13-471e-83b4-151cdb2c8f38 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Received event network-changed-e0dab6b7-2e30-4c0e-95c7-8d195066e5dd {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:15:15 user nova-compute[74996]: DEBUG nova.compute.manager [req-25a7e750-c10e-4560-a8e0-fc644c5ada7d req-14f87abe-bc13-471e-83b4-151cdb2c8f38 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Refreshing instance network info cache due to event network-changed-e0dab6b7-2e30-4c0e-95c7-8d195066e5dd. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 02:15:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-25a7e750-c10e-4560-a8e0-fc644c5ada7d req-14f87abe-bc13-471e-83b4-151cdb2c8f38 service nova] Acquiring lock "refresh_cache-fd4c3759-195f-43f9-ba9b-3f2c033453f0" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:15:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-25a7e750-c10e-4560-a8e0-fc644c5ada7d req-14f87abe-bc13-471e-83b4-151cdb2c8f38 service nova] Acquired lock "refresh_cache-fd4c3759-195f-43f9-ba9b-3f2c033453f0" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:15:15 user nova-compute[74996]: DEBUG nova.network.neutron [req-25a7e750-c10e-4560-a8e0-fc644c5ada7d req-14f87abe-bc13-471e-83b4-151cdb2c8f38 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Refreshing network info cache for port e0dab6b7-2e30-4c0e-95c7-8d195066e5dd {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 02:15:15 user nova-compute[74996]: DEBUG nova.network.neutron [req-25a7e750-c10e-4560-a8e0-fc644c5ada7d req-14f87abe-bc13-471e-83b4-151cdb2c8f38 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Updated VIF entry in instance network info cache for port e0dab6b7-2e30-4c0e-95c7-8d195066e5dd. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 02:15:15 user nova-compute[74996]: DEBUG nova.network.neutron [req-25a7e750-c10e-4560-a8e0-fc644c5ada7d req-14f87abe-bc13-471e-83b4-151cdb2c8f38 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Updating instance_info_cache with network_info: [{"id": "e0dab6b7-2e30-4c0e-95c7-8d195066e5dd", "address": "fa:16:3e:7f:85:7c", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0dab6b7-2e", "ovs_interfaceid": "e0dab6b7-2e30-4c0e-95c7-8d195066e5dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:15:15 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-25a7e750-c10e-4560-a8e0-fc644c5ada7d req-14f87abe-bc13-471e-83b4-151cdb2c8f38 service nova] Releasing lock "refresh_cache-fd4c3759-195f-43f9-ba9b-3f2c033453f0" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:15:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:15:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:15:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:15:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:15:21 user nova-compute[74996]: DEBUG nova.objects.instance [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'flavor' on Instance uuid fd4c3759-195f-43f9-ba9b-3f2c033453f0 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:15:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:15:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:15:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:15:21 user nova-compute[74996]: INFO nova.compute.manager [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Attaching volume 0d9d2f67-dd49-4205-9b89-eaae32f27c7a to /dev/vdb
Nov 02 02:15:21 user nova-compute[74996]: DEBUG os_brick.utils [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:15:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e89e78-fe0f-4408-8433-80a1594473b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ecd76f-3970-48f7-8e26-97533b9a7911]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bba341-5863-4b8a-870c-973e60799cab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5255a10-fe1b-4661-a40f-79e486b58a8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 02:15:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 02:15:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:21 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 02:15:21 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 02:15:21 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a45c57-8b23-41d4-b482-270ffbd88d4a]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 02:15:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 02:15:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 02:15:21 user nova-compute[74996]: DEBUG os_brick.utils [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:15:21 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Updating existing volume attachment record: a755fb70-b3d7-4b0e-9ce7-20a4bbbf51e6 {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 02:15:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:15:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:15:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:15:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:15:31 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:15:32 user nova-compute[74996]: DEBUG nova.compute.manager [req-7e42eb27-06cc-4239-a931-37ccc760429d req-bd0b7c0e-6678-424c-853c-427f664437e3 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Received event network-changed-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:15:32 user nova-compute[74996]: DEBUG nova.compute.manager [req-7e42eb27-06cc-4239-a931-37ccc760429d req-bd0b7c0e-6678-424c-853c-427f664437e3 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Refreshing instance network info cache due to event network-changed-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 02:15:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7e42eb27-06cc-4239-a931-37ccc760429d req-bd0b7c0e-6678-424c-853c-427f664437e3 service nova] Acquiring lock "refresh_cache-4680149a-b596-48f6-8bd0-3d44b9f06f8f" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:15:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7e42eb27-06cc-4239-a931-37ccc760429d req-bd0b7c0e-6678-424c-853c-427f664437e3 service nova] Acquired lock "refresh_cache-4680149a-b596-48f6-8bd0-3d44b9f06f8f" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:15:32 user nova-compute[74996]: DEBUG nova.network.neutron [req-7e42eb27-06cc-4239-a931-37ccc760429d req-bd0b7c0e-6678-424c-853c-427f664437e3 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Refreshing network info cache for port 1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 02:15:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c0bed474-0b2d-4587-90d8-7843fe2c8176 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:15:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c0bed474-0b2d-4587-90d8-7843fe2c8176 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:15:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c0bed474-0b2d-4587-90d8-7843fe2c8176 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:15:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c0bed474-0b2d-4587-90d8-7843fe2c8176 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:15:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c0bed474-0b2d-4587-90d8-7843fe2c8176 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:15:32 user nova-compute[74996]: INFO nova.compute.manager [None req-c0bed474-0b2d-4587-90d8-7843fe2c8176 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Terminating instance
Nov 02 02:15:32 user nova-compute[74996]: DEBUG nova.compute.manager [None req-c0bed474-0b2d-4587-90d8-7843fe2c8176 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 02:15:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:15:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:15:32 user nova-compute[74996]: DEBUG nova.network.neutron [req-7e42eb27-06cc-4239-a931-37ccc760429d req-bd0b7c0e-6678-424c-853c-427f664437e3 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Updated VIF entry in instance network info cache for port 1b77658b-f8a7-4cae-bcd6-12f849a7cdc8. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 02:15:32 user nova-compute[74996]: DEBUG nova.network.neutron [req-7e42eb27-06cc-4239-a931-37ccc760429d req-bd0b7c0e-6678-424c-853c-427f664437e3 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Updating instance_info_cache with network_info: [{"id": "1b77658b-f8a7-4cae-bcd6-12f849a7cdc8", "address": "fa:16:3e:01:5c:7c", "network": {"id": "3578933b-907b-439c-92d0-4311826a0163", "bridge": "br-int", "label": "tempest-TestStampPattern-1622075405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7cdc1a0ba64a25821d5c99b20de231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b77658b-f8", "ovs_interfaceid": "1b77658b-f8a7-4cae-bcd6-12f849a7cdc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:15:32 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-7e42eb27-06cc-4239-a931-37ccc760429d req-bd0b7c0e-6678-424c-853c-427f664437e3 service nova] Releasing lock "refresh_cache-4680149a-b596-48f6-8bd0-3d44b9f06f8f" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:15:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:15:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:15:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:15:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:15:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:15:33 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Instance destroyed successfully.
Nov 02 02:15:33 user nova-compute[74996]: DEBUG nova.objects.instance [None req-c0bed474-0b2d-4587-90d8-7843fe2c8176 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lazy-loading 'resources' on Instance uuid 4680149a-b596-48f6-8bd0-3d44b9f06f8f {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:15:33 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-c0bed474-0b2d-4587-90d8-7843fe2c8176 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:12:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-581859939',display_name='tempest-TestStampPattern-server-581859939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-581859939',id=49,image_ref='07f0728f-c789-47a1-b582-249278003ffa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKJHuw6Qr4/PNCfq6n+9tvXVKbxGaOJVnul0YErELd6vC57iiAiOyevzzMq1POKS4qzqhx+V78eYjcL2zfkyulhd6D3nM2HSkapGvB1Xf65v7OsTXK2YbtKtdN7HwXQcw==',key_name='tempest-TestStampPattern-1523316715',keypairs=<?>,launch_index=0,launched_at=2023-11-02T02:12:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d7cdc1a0ba64a25821d5c99b20de231',ramdisk_id='',reservation_id='r-kn6m1dvg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa',image_min_disk='1',image_min_ram='0',image_owner_id='0d7cdc1a0ba64a25821d5c99b20de231',image_owner_project_name='tempest-TestStampPattern-856812097',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-856812097-project-member',image_user_id='832530cd183e4944994e8032ac37c621',owner_project_name='tempest-TestStampPattern-856812097',owner_user_name='tempest-TestStampPattern-856812097-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T02:12:32Z,user_data=None,user_id='832530cd183e4944994e8032ac37c621',uuid=4680149a-b596-48f6-8bd0-3d44b9f06f8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b77658b-f8a7-4cae-bcd6-12f849a7cdc8", "address": "fa:16:3e:01:5c:7c", "network": {"id": "3578933b-907b-439c-92d0-4311826a0163", "bridge": "br-int", "label": "tempest-TestStampPattern-1622075405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7cdc1a0ba64a25821d5c99b20de231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b77658b-f8", "ovs_interfaceid": "1b77658b-f8a7-4cae-bcd6-12f849a7cdc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 02:15:33 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-c0bed474-0b2d-4587-90d8-7843fe2c8176 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Converting VIF {"id": "1b77658b-f8a7-4cae-bcd6-12f849a7cdc8", "address": "fa:16:3e:01:5c:7c", "network": {"id": "3578933b-907b-439c-92d0-4311826a0163", "bridge": "br-int", "label": "tempest-TestStampPattern-1622075405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7cdc1a0ba64a25821d5c99b20de231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b77658b-f8", "ovs_interfaceid": "1b77658b-f8a7-4cae-bcd6-12f849a7cdc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:15:33 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-c0bed474-0b2d-4587-90d8-7843fe2c8176 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=1b77658b-f8a7-4cae-bcd6-12f849a7cdc8,network=Network(3578933b-907b-439c-92d0-4311826a0163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b77658b-f8') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:15:33 user nova-compute[74996]: DEBUG os_vif [None req-c0bed474-0b2d-4587-90d8-7843fe2c8176 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=1b77658b-f8a7-4cae-bcd6-12f849a7cdc8,network=Network(3578933b-907b-439c-92d0-4311826a0163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b77658b-f8') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 02:15:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:15:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:15:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b77658b-f8, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:15:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:15:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:15:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=475c26d3-a6bc-4452-83cf-0d095a990dd6) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:15:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:15:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:15:33 user nova-compute[74996]: INFO os_vif [None req-c0bed474-0b2d-4587-90d8-7843fe2c8176 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:5c:7c,bridge_name='br-int',has_traffic_filtering=True,id=1b77658b-f8a7-4cae-bcd6-12f849a7cdc8,network=Network(3578933b-907b-439c-92d0-4311826a0163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b77658b-f8')
Nov 02 02:15:33 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-c0bed474-0b2d-4587-90d8-7843fe2c8176 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Deleting instance files /opt/stack/data/nova/instances/4680149a-b596-48f6-8bd0-3d44b9f06f8f_del
Nov 02 02:15:33 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-c0bed474-0b2d-4587-90d8-7843fe2c8176 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Deletion of /opt/stack/data/nova/instances/4680149a-b596-48f6-8bd0-3d44b9f06f8f_del complete
Nov 02 02:15:33 user nova-compute[74996]: INFO nova.compute.manager [None req-c0bed474-0b2d-4587-90d8-7843fe2c8176 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 02 02:15:33 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-c0bed474-0b2d-4587-90d8-7843fe2c8176 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 02:15:33 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 02:15:33 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 02:15:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:15:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:15:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:15:33 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:15:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-fc409026-f5d4-404b-a84b-0818c37d3472 req-194f722d-d9f9-4ba2-b677-6e683a228e12 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Received event network-vif-deleted-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:15:33 user nova-compute[74996]: INFO nova.compute.manager [req-fc409026-f5d4-404b-a84b-0818c37d3472 req-194f722d-d9f9-4ba2-b677-6e683a228e12 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Neutron deleted interface 1b77658b-f8a7-4cae-bcd6-12f849a7cdc8; detaching it from the instance and deleting it from the info cache
Nov 02 02:15:33 user nova-compute[74996]: DEBUG nova.network.neutron [req-fc409026-f5d4-404b-a84b-0818c37d3472 req-194f722d-d9f9-4ba2-b677-6e683a228e12 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:15:33 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Took 0.54 seconds to deallocate network for instance.
Nov 02 02:15:33 user nova-compute[74996]: DEBUG nova.compute.manager [req-fc409026-f5d4-404b-a84b-0818c37d3472 req-194f722d-d9f9-4ba2-b677-6e683a228e12 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Detach interface failed, port_id=1b77658b-f8a7-4cae-bcd6-12f849a7cdc8, reason: Instance 4680149a-b596-48f6-8bd0-3d44b9f06f8f could not be found. {{(pid=74996) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 02:15:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c0bed474-0b2d-4587-90d8-7843fe2c8176 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:15:33 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c0bed474-0b2d-4587-90d8-7843fe2c8176 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:15:34 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-c0bed474-0b2d-4587-90d8-7843fe2c8176 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:15:34 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-c0bed474-0b2d-4587-90d8-7843fe2c8176 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:15:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c0bed474-0b2d-4587-90d8-7843fe2c8176 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:15:34 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-c0bed474-0b2d-4587-90d8-7843fe2c8176 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Deleted allocations for instance 4680149a-b596-48f6-8bd0-3d44b9f06f8f
Nov 02 02:15:34 user nova-compute[74996]: DEBUG nova.compute.manager [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Received event network-vif-unplugged-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:15:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] Acquiring lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:15:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] Lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:15:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] Lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:15:34 user nova-compute[74996]: DEBUG nova.compute.manager [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] No waiting events found dispatching network-vif-unplugged-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:15:34 user nova-compute[74996]: WARNING nova.compute.manager [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Received unexpected event network-vif-unplugged-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 for instance with vm_state deleted and task_state None.
Nov 02 02:15:34 user nova-compute[74996]: DEBUG nova.compute.manager [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Received event network-vif-plugged-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:15:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] Acquiring lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:15:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] Lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:15:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] Lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:15:34 user nova-compute[74996]: DEBUG nova.compute.manager [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] No waiting events found dispatching network-vif-plugged-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:15:34 user nova-compute[74996]: WARNING nova.compute.manager [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Received unexpected event network-vif-plugged-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 for instance with vm_state deleted and task_state None.
Nov 02 02:15:34 user nova-compute[74996]: DEBUG nova.compute.manager [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Received event network-vif-plugged-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:15:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] Acquiring lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:15:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] Lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:15:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] Lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:15:34 user nova-compute[74996]: DEBUG nova.compute.manager [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] No waiting events found dispatching network-vif-plugged-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:15:34 user nova-compute[74996]: WARNING nova.compute.manager [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Received unexpected event network-vif-plugged-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 for instance with vm_state deleted and task_state None.
Nov 02 02:15:34 user nova-compute[74996]: DEBUG nova.compute.manager [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Received event network-vif-plugged-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:15:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] Acquiring lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:15:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] Lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:15:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] Lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:15:34 user nova-compute[74996]: DEBUG nova.compute.manager [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] No waiting events found dispatching network-vif-plugged-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:15:34 user nova-compute[74996]: WARNING nova.compute.manager [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Received unexpected event network-vif-plugged-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 for instance with vm_state deleted and task_state None.
Nov 02 02:15:34 user nova-compute[74996]: DEBUG nova.compute.manager [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Received event network-vif-unplugged-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:15:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] Acquiring lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:15:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] Lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:15:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] Lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:15:34 user nova-compute[74996]: DEBUG nova.compute.manager [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] No waiting events found dispatching network-vif-unplugged-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:15:34 user nova-compute[74996]: WARNING nova.compute.manager [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Received unexpected event network-vif-unplugged-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 for instance with vm_state deleted and task_state None.
Nov 02 02:15:34 user nova-compute[74996]: DEBUG nova.compute.manager [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Received event network-vif-plugged-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:15:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] Acquiring lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:15:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] Lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:15:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] Lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:15:34 user nova-compute[74996]: DEBUG nova.compute.manager [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] No waiting events found dispatching network-vif-plugged-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:15:34 user nova-compute[74996]: WARNING nova.compute.manager [req-cef3ed3e-509c-4ec6-ab0e-4a048f31c4ee req-052c3086-1d0c-4ef6-a491-54b3069d0fd1 service nova] [instance: 4680149a-b596-48f6-8bd0-3d44b9f06f8f] Received unexpected event network-vif-plugged-1b77658b-f8a7-4cae-bcd6-12f849a7cdc8 for instance with vm_state deleted and task_state None.
Nov 02 02:15:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:15:34 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-c0bed474-0b2d-4587-90d8-7843fe2c8176 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "4680149a-b596-48f6-8bd0-3d44b9f06f8f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.059s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:15:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:15:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:15:47 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:15:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:15:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:15:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:15:47 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 02:15:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:47 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:15:48 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:48 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:15:48 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:15:48 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8723MB free_disk=24.794086456298828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 02:15:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:15:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:15:48 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:15:48 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance fd4c3759-195f-43f9-ba9b-3f2c033453f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:15:48 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 02:15:48 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 02:15:48 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:15:48 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:15:48 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 02:15:48 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.348s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:15:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:15:49 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnOStwGZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:15:51 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:15:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:15:51 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:15:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:15:51 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a00e82-ee7d-4205-a5ec-85dffe4c3340]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 02:15:51 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01ae053-840e-42fb-883c-c0dbb5f557dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a] added
Nov 02 02:15:51 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f32d388-7990-47b9-9f86-bfeae3169334]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[273fa551-98c2-4573-a5eb-ddc9cfe48048]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jnOStwGZ {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jnOStwGZ" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f56e3d-a5d8-4204-b112-cc9f22e9f374]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jnOStwGZ'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[28641d16-1277-4de4-b584-5e78b82e464a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[37df1959-0427-49f1-8c2d-d740aee38f67]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 02 02:15:51 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 02 02:15:51 user nova-compute[74996]:  {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:15:51 user nova-compute[74996]: WARNING os_brick.initiator.connectors.iscsi [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 02 02:15:51 user nova-compute[74996]: 
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c8fd81-b429-4a66-89f9-3a9cd9941965]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a, portal: 172.16.0.220,3260]
Nov 02 02:15:51 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a, portal: 172.16.0.220,3260] successful.
Nov 02 02:15:51 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c7d579-1436-4287-b5d6-f97ac4c7be24]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04cfeee-0c04-4494-a997-1c7b161df90b]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a (non-flash)
Nov 02 02:15:51 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a (non-flash)
Nov 02 02:15:51 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.225s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ceb70f2-4c48-490f-898e-f1a8a9b5e00c]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:51 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 02:15:52 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 02:15:52 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnOStwGZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 02:15:52 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.256s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:15:52 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] <== connect_volume: return (1257ms) {'type': 'block', 'scsi_wwn': '26137646535383837', 'path': '/dev/sdb'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:15:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137646535383837', 'path': '/dev/sdb'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 02:15:52 user nova-compute[74996]: DEBUG nova.objects.instance [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'flavor' on Instance uuid fd4c3759-195f-43f9-ba9b-3f2c033453f0 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:15:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 02:15:52 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:15:52 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 02:15:52 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:15:52 user nova-compute[74996]:   <serial>0d9d2f67-dd49-4205-9b89-eaae32f27c7a</serial>
Nov 02 02:15:52 user nova-compute[74996]: </disk>
Nov 02 02:15:52 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 02:15:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:15:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:15:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] No VIF found with MAC fa:16:3e:7f:85:7c, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 02:15:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-5ea37487-c785-4a15-86aa-308d603edb6f tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.337s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:15:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:15:53 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:15:53 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 02:15:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-fd4c3759-195f-43f9-ba9b-3f2c033453f0" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:15:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-fd4c3759-195f-43f9-ba9b-3f2c033453f0" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:15:53 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 02:15:54 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Updating instance_info_cache with network_info: [{"id": "e0dab6b7-2e30-4c0e-95c7-8d195066e5dd", "address": "fa:16:3e:7f:85:7c", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0dab6b7-2e", "ovs_interfaceid": "e0dab6b7-2e30-4c0e-95c7-8d195066e5dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:15:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-fd4c3759-195f-43f9-ba9b-3f2c033453f0" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:15:54 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 02:15:54 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:15:54 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:15:54 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:15:55 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:15:56 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:15:56 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 02:15:56 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:15:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:15:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:15:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:15:59 user nova-compute[74996]: DEBUG nova.objects.instance [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'flavor' on Instance uuid fd4c3759-195f-43f9-ba9b-3f2c033453f0 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:15:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:15:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:15:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:15:59 user nova-compute[74996]: INFO nova.compute.manager [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Attaching volume 1acfb13a-0211-48ad-b8f9-db022f83e463 to /dev/vdc
Nov 02 02:15:59 user nova-compute[74996]: DEBUG os_brick.utils [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:15:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0b4a28-1963-4513-a8e4-12e3dea5f79b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26b1c92b44d9\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3644e809-14b3-4fbb-bd4c-b692099b70ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:15:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[571607a0-6afc-4a3b-ac63-d110646ac158]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:59 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6e4a74-488c-47b6-9f4d-4aff01eaf14c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:15:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Running cmd (subprocess): nvme version {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:15:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] 'nvme version' failed. Not Retrying. {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 02:15:59 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] nvme not present on system {{(pid=74996) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 02 02:15:59 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:00 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 02 02:16:00 user nova-compute[74996]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 02 02:16:00 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6c4215-dbab-4208-a7ad-fd6012a30e00]: (4, '') {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:16:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74996) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 02 02:16:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 02 02:16:00 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.lightos [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] LIGHTOS: no hostnqn found. {{(pid=74996) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 02 02:16:00 user nova-compute[74996]: DEBUG os_brick.utils [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26b1c92b44d9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:16:00 user nova-compute[74996]: DEBUG nova.virt.block_device [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Updating existing volume attachment record: 03591e90-af0b-4117-9424-7301a45597ea {{(pid=74996) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 02 02:16:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:02 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:16:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:08 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:16:08 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Cleaning up deleted instances {{(pid=74996) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 02:16:08 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] There are 0 instances to clean {{(pid=74996) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 02:16:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Acquiring lock "bb51ec3b-0715-4c23-81d4-bd711c770f8f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:16:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "bb51ec3b-0715-4c23-81d4-bd711c770f8f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:16:10 user nova-compute[74996]: DEBUG nova.compute.manager [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 02:16:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:16:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:16:10 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 02:16:10 user nova-compute[74996]: INFO nova.compute.claims [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Claim successful on node user
Nov 02 02:16:10 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:16:10 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:16:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.248s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:16:10 user nova-compute[74996]: DEBUG nova.compute.manager [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 02:16:10 user nova-compute[74996]: DEBUG nova.compute.manager [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 02:16:10 user nova-compute[74996]: DEBUG nova.network.neutron [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 02:16:10 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 02:16:10 user nova-compute[74996]: DEBUG nova.compute.manager [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 02:16:10 user nova-compute[74996]: DEBUG nova.policy [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e7254e7d8a145669904dca6622f34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29da62432afe44fe8e109db1d464f8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 02:16:10 user nova-compute[74996]: DEBUG nova.compute.manager [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 02:16:10 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 02:16:10 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Creating image(s)
Nov 02 02:16:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb51ec3b-0715-4c23-81d4-bd711c770f8f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:16:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "/opt/stack/data/nova/instances/bb51ec3b-0715-4c23-81d4-bd711c770f8f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:16:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "/opt/stack/data/nova/instances/bb51ec3b-0715-4c23-81d4-bd711c770f8f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:16:10 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.191s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:16:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:16:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.168s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/bb51ec3b-0715-4c23-81d4-bd711c770f8f/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/bb51ec3b-0715-4c23-81d4-bd711c770f8f/disk 1073741824" returned: 0 in 0.048s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:16:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:11 user nova-compute[74996]: DEBUG nova.network.neutron [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Successfully created port: e70a1c2d-d33e-4e19-b0f4-0c18e3744156 {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 02:16:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.191s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:11 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb51ec3b-0715-4c23-81d4-bd711c770f8f/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 02:16:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb51ec3b-0715-4c23-81d4-bd711c770f8f/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:11 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb51ec3b-0715-4c23-81d4-bd711c770f8f/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:11 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Cannot resize image /opt/stack/data/nova/instances/bb51ec3b-0715-4c23-81d4-bd711c770f8f/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 02:16:11 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 02:16:11 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Ensure instance console log exists: /opt/stack/data/nova/instances/bb51ec3b-0715-4c23-81d4-bd711c770f8f/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 02:16:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:16:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:16:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.network.neutron [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Successfully updated port: e70a1c2d-d33e-4e19-b0f4-0c18e3744156 {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Acquiring lock "refresh_cache-bb51ec3b-0715-4c23-81d4-bd711c770f8f" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Acquired lock "refresh_cache-bb51ec3b-0715-4c23-81d4-bd711c770f8f" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.network.neutron [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.compute.manager [req-8e31b20e-f9f9-42e9-9da9-927c92020152 req-e54762b5-9218-4a78-bc64-bd6ef2e712bc service nova] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Received event network-changed-e70a1c2d-d33e-4e19-b0f4-0c18e3744156 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.compute.manager [req-8e31b20e-f9f9-42e9-9da9-927c92020152 req-e54762b5-9218-4a78-bc64-bd6ef2e712bc service nova] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Refreshing instance network info cache due to event network-changed-e70a1c2d-d33e-4e19-b0f4-0c18e3744156. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8e31b20e-f9f9-42e9-9da9-927c92020152 req-e54762b5-9218-4a78-bc64-bd6ef2e712bc service nova] Acquiring lock "refresh_cache-bb51ec3b-0715-4c23-81d4-bd711c770f8f" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.network.neutron [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74996) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.network.neutron [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Updating instance_info_cache with network_info: [{"id": "e70a1c2d-d33e-4e19-b0f4-0c18e3744156", "address": "fa:16:3e:f8:6b:4f", "network": {"id": "17d61192-0043-4d14-9430-e9428c420996", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1566782008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29da62432afe44fe8e109db1d464f8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70a1c2d-d3", "ovs_interfaceid": "e70a1c2d-d33e-4e19-b0f4-0c18e3744156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Releasing lock "refresh_cache-bb51ec3b-0715-4c23-81d4-bd711c770f8f" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.compute.manager [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Instance network_info: |[{"id": "e70a1c2d-d33e-4e19-b0f4-0c18e3744156", "address": "fa:16:3e:f8:6b:4f", "network": {"id": "17d61192-0043-4d14-9430-e9428c420996", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1566782008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29da62432afe44fe8e109db1d464f8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70a1c2d-d3", "ovs_interfaceid": "e70a1c2d-d33e-4e19-b0f4-0c18e3744156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8e31b20e-f9f9-42e9-9da9-927c92020152 req-e54762b5-9218-4a78-bc64-bd6ef2e712bc service nova] Acquired lock "refresh_cache-bb51ec3b-0715-4c23-81d4-bd711c770f8f" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.network.neutron [req-8e31b20e-f9f9-42e9-9da9-927c92020152 req-e54762b5-9218-4a78-bc64-bd6ef2e712bc service nova] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Refreshing network info cache for port e70a1c2d-d33e-4e19-b0f4-0c18e3744156 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Start _get_guest_xml network_info=[{"id": "e70a1c2d-d33e-4e19-b0f4-0c18e3744156", "address": "fa:16:3e:f8:6b:4f", "network": {"id": "17d61192-0043-4d14-9430-e9428c420996", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1566782008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29da62432afe44fe8e109db1d464f8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70a1c2d-d3", "ovs_interfaceid": "e70a1c2d-d33e-4e19-b0f4-0c18e3744156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 02:16:12 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:16:12 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:16:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-605656383',display_name='tempest-VolumesActionsTest-instance-605656383',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-605656383',id=51,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29da62432afe44fe8e109db1d464f8fd',ramdisk_id='',reservation_id='r-llqy5s9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-489656329',owner_user_name='tempest-VolumesActionsTest-489656329-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T02:16:11Z,user_data=None,user_id='5e7254e7d8a145669904dca6622f34d1',uuid=bb51ec3b-0715-4c23-81d4-bd711c770f8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e70a1c2d-d33e-4e19-b0f4-0c18e3744156", "address": "fa:16:3e:f8:6b:4f", "network": {"id": "17d61192-0043-4d14-9430-e9428c420996", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1566782008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29da62432afe44fe8e109db1d464f8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70a1c2d-d3", "ovs_interfaceid": "e70a1c2d-d33e-4e19-b0f4-0c18e3744156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Converting VIF {"id": "e70a1c2d-d33e-4e19-b0f4-0c18e3744156", "address": "fa:16:3e:f8:6b:4f", "network": {"id": "17d61192-0043-4d14-9430-e9428c420996", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1566782008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29da62432afe44fe8e109db1d464f8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70a1c2d-d3", "ovs_interfaceid": "e70a1c2d-d33e-4e19-b0f4-0c18e3744156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:6b:4f,bridge_name='br-int',has_traffic_filtering=True,id=e70a1c2d-d33e-4e19-b0f4-0c18e3744156,network=Network(17d61192-0043-4d14-9430-e9428c420996),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape70a1c2d-d3') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.objects.instance [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lazy-loading 'pci_devices' on Instance uuid bb51ec3b-0715-4c23-81d4-bd711c770f8f {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] End _get_guest_xml xml=<domain type="kvm">
Nov 02 02:16:12 user nova-compute[74996]:   <uuid>bb51ec3b-0715-4c23-81d4-bd711c770f8f</uuid>
Nov 02 02:16:12 user nova-compute[74996]:   <name>instance-00000033</name>
Nov 02 02:16:12 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 02:16:12 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 02:16:12 user nova-compute[74996]:   <metadata>
Nov 02 02:16:12 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 02:16:12 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 02:16:12 user nova-compute[74996]:       <nova:name>tempest-VolumesActionsTest-instance-605656383</nova:name>
Nov 02 02:16:12 user nova-compute[74996]:       <nova:creationTime>2023-11-02 02:16:12</nova:creationTime>
Nov 02 02:16:12 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 02:16:12 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 02:16:12 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 02:16:12 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 02:16:12 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 02:16:12 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 02:16:12 user nova-compute[74996]:       </nova:flavor>
Nov 02 02:16:12 user nova-compute[74996]:       <nova:owner>
Nov 02 02:16:12 user nova-compute[74996]:         <nova:user uuid="5e7254e7d8a145669904dca6622f34d1">tempest-VolumesActionsTest-489656329-project-member</nova:user>
Nov 02 02:16:12 user nova-compute[74996]:         <nova:project uuid="29da62432afe44fe8e109db1d464f8fd">tempest-VolumesActionsTest-489656329</nova:project>
Nov 02 02:16:12 user nova-compute[74996]:       </nova:owner>
Nov 02 02:16:12 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 02:16:12 user nova-compute[74996]:       <nova:ports>
Nov 02 02:16:12 user nova-compute[74996]:         <nova:port uuid="e70a1c2d-d33e-4e19-b0f4-0c18e3744156">
Nov 02 02:16:12 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 02 02:16:12 user nova-compute[74996]:         </nova:port>
Nov 02 02:16:12 user nova-compute[74996]:       </nova:ports>
Nov 02 02:16:12 user nova-compute[74996]:     </nova:instance>
Nov 02 02:16:12 user nova-compute[74996]:   </metadata>
Nov 02 02:16:12 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 02:16:12 user nova-compute[74996]:     <system>
Nov 02 02:16:12 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 02:16:12 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 02:16:12 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 02:16:12 user nova-compute[74996]:       <entry name="serial">bb51ec3b-0715-4c23-81d4-bd711c770f8f</entry>
Nov 02 02:16:12 user nova-compute[74996]:       <entry name="uuid">bb51ec3b-0715-4c23-81d4-bd711c770f8f</entry>
Nov 02 02:16:12 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 02:16:12 user nova-compute[74996]:     </system>
Nov 02 02:16:12 user nova-compute[74996]:   </sysinfo>
Nov 02 02:16:12 user nova-compute[74996]:   <os>
Nov 02 02:16:12 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 02:16:12 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 02:16:12 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 02:16:12 user nova-compute[74996]:   </os>
Nov 02 02:16:12 user nova-compute[74996]:   <features>
Nov 02 02:16:12 user nova-compute[74996]:     <acpi/>
Nov 02 02:16:12 user nova-compute[74996]:     <apic/>
Nov 02 02:16:12 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 02:16:12 user nova-compute[74996]:   </features>
Nov 02 02:16:12 user nova-compute[74996]:   <clock offset="utc">
Nov 02 02:16:12 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 02:16:12 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 02:16:12 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 02:16:12 user nova-compute[74996]:   </clock>
Nov 02 02:16:12 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 02:16:12 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 02:16:12 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 02:16:12 user nova-compute[74996]:   </cpu>
Nov 02 02:16:12 user nova-compute[74996]:   <devices>
Nov 02 02:16:12 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 02:16:12 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 02:16:12 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/bb51ec3b-0715-4c23-81d4-bd711c770f8f/disk"/>
Nov 02 02:16:12 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 02:16:12 user nova-compute[74996]:     </disk>
Nov 02 02:16:12 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 02:16:12 user nova-compute[74996]:       <mac address="fa:16:3e:f8:6b:4f"/>
Nov 02 02:16:12 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 02:16:12 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 02:16:12 user nova-compute[74996]:       <target dev="tape70a1c2d-d3"/>
Nov 02 02:16:12 user nova-compute[74996]:     </interface>
Nov 02 02:16:12 user nova-compute[74996]:     <serial type="pty">
Nov 02 02:16:12 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/bb51ec3b-0715-4c23-81d4-bd711c770f8f/console.log" append="off"/>
Nov 02 02:16:12 user nova-compute[74996]:     </serial>
Nov 02 02:16:12 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 02:16:12 user nova-compute[74996]:     <video>
Nov 02 02:16:12 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 02:16:12 user nova-compute[74996]:     </video>
Nov 02 02:16:12 user nova-compute[74996]:     <rng model="virtio">
Nov 02 02:16:12 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 02:16:12 user nova-compute[74996]:     </rng>
Nov 02 02:16:12 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 02:16:12 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 02:16:12 user nova-compute[74996]:       <stats period="10"/>
Nov 02 02:16:12 user nova-compute[74996]:     </memballoon>
Nov 02 02:16:12 user nova-compute[74996]:   </devices>
Nov 02 02:16:12 user nova-compute[74996]: </domain>
Nov 02 02:16:12 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:16:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-605656383',display_name='tempest-VolumesActionsTest-instance-605656383',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-605656383',id=51,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29da62432afe44fe8e109db1d464f8fd',ramdisk_id='',reservation_id='r-llqy5s9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-489656329',owner_user_name='tempest-VolumesActionsTest-489656329-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T02:16:11Z,user_data=None,user_id='5e7254e7d8a145669904dca6622f34d1',uuid=bb51ec3b-0715-4c23-81d4-bd711c770f8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e70a1c2d-d33e-4e19-b0f4-0c18e3744156", "address": "fa:16:3e:f8:6b:4f", "network": {"id": "17d61192-0043-4d14-9430-e9428c420996", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1566782008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29da62432afe44fe8e109db1d464f8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70a1c2d-d3", "ovs_interfaceid": "e70a1c2d-d33e-4e19-b0f4-0c18e3744156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Converting VIF {"id": "e70a1c2d-d33e-4e19-b0f4-0c18e3744156", "address": "fa:16:3e:f8:6b:4f", "network": {"id": "17d61192-0043-4d14-9430-e9428c420996", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1566782008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29da62432afe44fe8e109db1d464f8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70a1c2d-d3", "ovs_interfaceid": "e70a1c2d-d33e-4e19-b0f4-0c18e3744156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:6b:4f,bridge_name='br-int',has_traffic_filtering=True,id=e70a1c2d-d33e-4e19-b0f4-0c18e3744156,network=Network(17d61192-0043-4d14-9430-e9428c420996),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape70a1c2d-d3') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG os_vif [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:6b:4f,bridge_name='br-int',has_traffic_filtering=True,id=e70a1c2d-d33e-4e19-b0f4-0c18e3744156,network=Network(17d61192-0043-4d14-9430-e9428c420996),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape70a1c2d-d3') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c9126a24-d840-50db-a6fc-ef697097297f', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape70a1c2d-d3, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape70a1c2d-d3, col_values=(('qos', UUID('e6f6094f-a29d-42f2-bb19-2d550b4e2676')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape70a1c2d-d3, col_values=(('external_ids', {'iface-id': 'e70a1c2d-d33e-4e19-b0f4-0c18e3744156', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:6b:4f', 'vm-uuid': 'bb51ec3b-0715-4c23-81d4-bd711c770f8f'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:12 user nova-compute[74996]: INFO os_vif [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:6b:4f,bridge_name='br-int',has_traffic_filtering=True,id=e70a1c2d-d33e-4e19-b0f4-0c18e3744156,network=Network(17d61192-0043-4d14-9430-e9428c420996),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape70a1c2d-d3')
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] No VIF found with MAC fa:16:3e:f8:6b:4f, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.network.neutron [req-8e31b20e-f9f9-42e9-9da9-927c92020152 req-e54762b5-9218-4a78-bc64-bd6ef2e712bc service nova] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Updated VIF entry in instance network info cache for port e70a1c2d-d33e-4e19-b0f4-0c18e3744156. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG nova.network.neutron [req-8e31b20e-f9f9-42e9-9da9-927c92020152 req-e54762b5-9218-4a78-bc64-bd6ef2e712bc service nova] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Updating instance_info_cache with network_info: [{"id": "e70a1c2d-d33e-4e19-b0f4-0c18e3744156", "address": "fa:16:3e:f8:6b:4f", "network": {"id": "17d61192-0043-4d14-9430-e9428c420996", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1566782008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29da62432afe44fe8e109db1d464f8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70a1c2d-d3", "ovs_interfaceid": "e70a1c2d-d33e-4e19-b0f4-0c18e3744156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:16:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8e31b20e-f9f9-42e9-9da9-927c92020152 req-e54762b5-9218-4a78-bc64-bd6ef2e712bc service nova] Releasing lock "refresh_cache-bb51ec3b-0715-4c23-81d4-bd711c770f8f" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:16:13 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:16:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:14 user nova-compute[74996]: DEBUG nova.compute.manager [req-8bfbe0eb-a759-4c8a-aea1-52f54f6399e2 req-3cf7bd61-ebd6-42b5-9ad7-58b19b80087a service nova] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Received event network-vif-plugged-e70a1c2d-d33e-4e19-b0f4-0c18e3744156 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:16:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8bfbe0eb-a759-4c8a-aea1-52f54f6399e2 req-3cf7bd61-ebd6-42b5-9ad7-58b19b80087a service nova] Acquiring lock "bb51ec3b-0715-4c23-81d4-bd711c770f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:16:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8bfbe0eb-a759-4c8a-aea1-52f54f6399e2 req-3cf7bd61-ebd6-42b5-9ad7-58b19b80087a service nova] Lock "bb51ec3b-0715-4c23-81d4-bd711c770f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:16:14 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-8bfbe0eb-a759-4c8a-aea1-52f54f6399e2 req-3cf7bd61-ebd6-42b5-9ad7-58b19b80087a service nova] Lock "bb51ec3b-0715-4c23-81d4-bd711c770f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:16:14 user nova-compute[74996]: DEBUG nova.compute.manager [req-8bfbe0eb-a759-4c8a-aea1-52f54f6399e2 req-3cf7bd61-ebd6-42b5-9ad7-58b19b80087a service nova] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] No waiting events found dispatching network-vif-plugged-e70a1c2d-d33e-4e19-b0f4-0c18e3744156 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:16:14 user nova-compute[74996]: WARNING nova.compute.manager [req-8bfbe0eb-a759-4c8a-aea1-52f54f6399e2 req-3cf7bd61-ebd6-42b5-9ad7-58b19b80087a service nova] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Received unexpected event network-vif-plugged-e70a1c2d-d33e-4e19-b0f4-0c18e3744156 for instance with vm_state building and task_state spawning.
Nov 02 02:16:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:16 user nova-compute[74996]: DEBUG nova.compute.manager [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 02:16:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 02:16:16 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Instance spawned successfully.
Nov 02 02:16:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 02:16:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:16:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:16:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:16:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:16:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:16:16 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:16:16 user nova-compute[74996]: DEBUG nova.compute.manager [req-540d4be2-6d98-4bc9-bb60-04a09a49dab5 req-364fece7-c6fe-4ce9-a1da-46eea517e8ca service nova] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Received event network-vif-plugged-e70a1c2d-d33e-4e19-b0f4-0c18e3744156 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:16:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-540d4be2-6d98-4bc9-bb60-04a09a49dab5 req-364fece7-c6fe-4ce9-a1da-46eea517e8ca service nova] Acquiring lock "bb51ec3b-0715-4c23-81d4-bd711c770f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:16:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-540d4be2-6d98-4bc9-bb60-04a09a49dab5 req-364fece7-c6fe-4ce9-a1da-46eea517e8ca service nova] Lock "bb51ec3b-0715-4c23-81d4-bd711c770f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:16:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-540d4be2-6d98-4bc9-bb60-04a09a49dab5 req-364fece7-c6fe-4ce9-a1da-46eea517e8ca service nova] Lock "bb51ec3b-0715-4c23-81d4-bd711c770f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:16:16 user nova-compute[74996]: DEBUG nova.compute.manager [req-540d4be2-6d98-4bc9-bb60-04a09a49dab5 req-364fece7-c6fe-4ce9-a1da-46eea517e8ca service nova] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] No waiting events found dispatching network-vif-plugged-e70a1c2d-d33e-4e19-b0f4-0c18e3744156 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:16:16 user nova-compute[74996]: WARNING nova.compute.manager [req-540d4be2-6d98-4bc9-bb60-04a09a49dab5 req-364fece7-c6fe-4ce9-a1da-46eea517e8ca service nova] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Received unexpected event network-vif-plugged-e70a1c2d-d33e-4e19-b0f4-0c18e3744156 for instance with vm_state building and task_state spawning.
Nov 02 02:16:16 user nova-compute[74996]: INFO nova.compute.manager [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 02 02:16:16 user nova-compute[74996]: DEBUG nova.compute.manager [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 02:16:16 user nova-compute[74996]: INFO nova.compute.manager [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Took 5.87 seconds to build instance.
Nov 02 02:16:16 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6c0f30a5-c0e2-4c57-9304-7eeef8c0c2e0 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "bb51ec3b-0715-4c23-81d4-bd711c770f8f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.975s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:16:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:19 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Calling os-brick to attach iSCSI Volume {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 02 02:16:19 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'skOorFvR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:16:19 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:16:19 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:16:19 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:16:19 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:16:19 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:16:19 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:16:19 user nova-compute[74996]: INFO os_brick.initiator.connectors.iscsi [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 02 02:16:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 -p 172.16.0.220:3260 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:19 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ec487e-d876-47da-8d93-80a847369c99]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:16:19 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 02 02:16:19 user nova-compute[74996]:  {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:16:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 -p 172.16.0.220:3260 --interface default --op new {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:19 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adad5b6-ead7-47fe-8250-f81a87175075]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463] added\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:16:19 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463] added
Nov 02 02:16:19 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:16:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:19 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1eba52-8de1-4adf-b111-fca443e26d01]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:16:19 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:16:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:19 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:19 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1560d4f-5b51-43ed-bd04-2b0560a7859c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:16:19 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v skOorFvR {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v skOorFvR" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d05bdf0-2a20-4755-92ac-00bc7110c6ab]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'skOorFvR'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed133e9-2816-44ac-b140-50a239746b59]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6285b511-6155-4605-8487-a49b917642c7]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a (non-flash)
Nov 02 02:16:20 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a (non-flash)
Nov 02 02:16:20 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 -p 172.16.0.220:3260 --login {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d821f8a-3866-4ad5-a0f5-64d2fd5240a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463, portal: 172.16.0.220,3260]
Nov 02 02:16:20 user nova-compute[74996]: Login to [iface: default, target: iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463, portal: 172.16.0.220,3260] successful.
Nov 02 02:16:20 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f94707-194a-4c8f-9142-23ee1f3a219e]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[114913ee-b7dd-4d61-ac0e-736b944b2151]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a (non-flash)
Nov 02 02:16:20 user nova-compute[74996]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 (non-flash)
Nov 02 02:16:20 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a (non-flash)
Nov 02 02:16:20 user nova-compute[74996]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 (non-flash)
Nov 02 02:16:20 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Connected to 172.16.0.220:3260 {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=74996) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74996) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e344a5-3b03-4f0a-9f35-e49883d2f5dd]: (4, ('- - 0', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:16:20 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: None {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 02:16:21 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74996) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 02 02:16:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'skOorFvR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74996) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 02 02:16:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:16:21 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23538313764316232', 'path': '/dev/sdc'} {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:16:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538313764316232', 'path': '/dev/sdc'} {{(pid=74996) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 02 02:16:21 user nova-compute[74996]: DEBUG nova.objects.instance [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'flavor' on Instance uuid fd4c3759-195f-43f9-ba9b-3f2c033453f0 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:16:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] attach device xml: <disk type="block" device="disk">
Nov 02 02:16:21 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:16:21 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 02:16:21 user nova-compute[74996]:   <target dev="vdc" bus="virtio"/>
Nov 02 02:16:21 user nova-compute[74996]:   <serial>1acfb13a-0211-48ad-b8f9-db022f83e463</serial>
Nov 02 02:16:21 user nova-compute[74996]: </disk>
Nov 02 02:16:21 user nova-compute[74996]:  {{(pid=74996) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 02 02:16:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:16:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:16:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:16:21 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] No VIF found with MAC fa:16:3e:7f:85:7c, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 02:16:21 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-3ec32144-63ed-476a-a70a-c6d44adbf3bb tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.985s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:16:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:16:22 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:16:22 user nova-compute[74996]: INFO nova.compute.manager [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Detaching volume 0d9d2f67-dd49-4205-9b89-eaae32f27c7a
Nov 02 02:16:23 user nova-compute[74996]: INFO nova.virt.block_device [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Attempting to driver detach volume 0d9d2f67-dd49-4205-9b89-eaae32f27c7a from mountpoint /dev/vdb
Nov 02 02:16:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Attempting to detach device vdb from instance fd4c3759-195f-43f9-ba9b-3f2c033453f0 from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 02:16:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 02:16:23 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:16:23 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 02:16:23 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:16:23 user nova-compute[74996]:   <serial>0d9d2f67-dd49-4205-9b89-eaae32f27c7a</serial>
Nov 02 02:16:23 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 02:16:23 user nova-compute[74996]: </disk>
Nov 02 02:16:23 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 02:16:23 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Successfully detached device vdb from instance fd4c3759-195f-43f9-ba9b-3f2c033453f0 from the persistent domain config.
Nov 02 02:16:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fd4c3759-195f-43f9-ba9b-3f2c033453f0 from the live domain config. {{(pid=74996) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 02:16:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 02:16:23 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:16:23 user nova-compute[74996]:   <source dev="/dev/sdb"/>
Nov 02 02:16:23 user nova-compute[74996]:   <target dev="vdb" bus="virtio"/>
Nov 02 02:16:23 user nova-compute[74996]:   <serial>0d9d2f67-dd49-4205-9b89-eaae32f27c7a</serial>
Nov 02 02:16:23 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 02 02:16:23 user nova-compute[74996]: </disk>
Nov 02 02:16:23 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 02:16:23 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:16:23 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 02:16:23 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid fd4c3759-195f-43f9-ba9b-3f2c033453f0 {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 02:16:23 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Triggering sync for uuid bb51ec3b-0715-4c23-81d4-bd711c770f8f {{(pid=74996) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Nov 02 02:16:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:16:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:16:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:16:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "bb51ec3b-0715-4c23-81d4-bd711c770f8f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:16:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "bb51ec3b-0715-4c23-81d4-bd711c770f8f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:16:23 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fd4c3759-195f-43f9-ba9b-3f2c033453f0 {{(pid=74996) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 02:16:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:16:23 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "bb51ec3b-0715-4c23-81d4-bd711c770f8f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:16:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:43 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fd4c3759-195f-43f9-ba9b-3f2c033453f0 is timed out.
Nov 02 02:16:43 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Successfully detached device vdb from instance fd4c3759-195f-43f9-ba9b-3f2c033453f0 from the live domain config.
Nov 02 02:16:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnOStwGZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:16:43 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:16:43 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcfbfa5-b0b5-4db4-ac5b-5e5cf35464c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 02:16:43 user nova-compute[74996]: No targets found.
Nov 02 02:16:43 user nova-compute[74996]: iSNS:
Nov 02 02:16:43 user nova-compute[74996]: No targets found.
Nov 02 02:16:43 user nova-compute[74996]: STATIC:
Nov 02 02:16:43 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463
Nov 02 02:16:43 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 02:16:43 user nova-compute[74996]:                 Iface Name: default
Nov 02 02:16:43 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a
Nov 02 02:16:43 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 02:16:43 user nova-compute[74996]:                 Iface Name: default
Nov 02 02:16:43 user nova-compute[74996]: FIRMWARE:
Nov 02 02:16:43 user nova-compute[74996]: No targets found.
Nov 02 02:16:43 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 02:16:43 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 02:16:43 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b19077-f8fa-41cf-9fca-340b763b34d5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8ba755-5212-40a1-9655-64f52c2d27c6]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a (non-flash)
Nov 02 02:16:43 user nova-compute[74996]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 (non-flash)
Nov 02 02:16:43 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a (non-flash)
Nov 02 02:16:43 user nova-compute[74996]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 (non-flash)
Nov 02 02:16:43 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e878e7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a'): ({'sdb'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Removing single pathed devices sdb {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0760a2-e182-446e-a79a-c5c464b17372]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f633c4-f478-4e68-a4e8-689f552d2899]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Flushing IO for device /dev/sdb {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d7cc83-8ac0-407a-bcf1-ba495509b5ef]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[b260e341-e270-455d-b948-5b409d5c6dff]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] SCSI volumes sdb have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe51c44-30f5-47e9-b6dd-e38a7d553674]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[63120e92-7062-4791-9e7f-1379c114cdf6]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a, portal: 172.16.0.220,3260]
Nov 02 02:16:43 user nova-compute[74996]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a, portal: 172.16.0.220,3260] successful.
Nov 02 02:16:43 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d9d2f67-dd49-4205-9b89-eaae32f27c7a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f01c1bb-7041-40cc-9e4c-9594d048bdd7]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] <== disconnect_volume: return (312ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:16:43 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 02:16:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:44 user nova-compute[74996]: DEBUG nova.compute.manager [req-bb84a614-8710-4d1e-a16f-4f10e65a1b53 req-5d90fadc-5b07-4c6b-9bfe-52025f8472bc service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Received event network-changed-181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:16:44 user nova-compute[74996]: DEBUG nova.compute.manager [req-bb84a614-8710-4d1e-a16f-4f10e65a1b53 req-5d90fadc-5b07-4c6b-9bfe-52025f8472bc service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Refreshing instance network info cache due to event network-changed-181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 02:16:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-bb84a614-8710-4d1e-a16f-4f10e65a1b53 req-5d90fadc-5b07-4c6b-9bfe-52025f8472bc service nova] Acquiring lock "refresh_cache-3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:16:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-bb84a614-8710-4d1e-a16f-4f10e65a1b53 req-5d90fadc-5b07-4c6b-9bfe-52025f8472bc service nova] Acquired lock "refresh_cache-3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:16:44 user nova-compute[74996]: DEBUG nova.network.neutron [req-bb84a614-8710-4d1e-a16f-4f10e65a1b53 req-5d90fadc-5b07-4c6b-9bfe-52025f8472bc service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Refreshing network info cache for port 181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1 {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 02:16:44 user nova-compute[74996]: DEBUG nova.objects.instance [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'flavor' on Instance uuid fd4c3759-195f-43f9-ba9b-3f2c033453f0 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:16:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-342b3b3a-6a4e-4a64-8614-4d0246729a7b tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.913s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:16:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 21.263s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:16:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:16:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1d2e9924-68ba-45ee-877f-f4bac7de8c83 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:16:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1d2e9924-68ba-45ee-877f-f4bac7de8c83 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:16:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1d2e9924-68ba-45ee-877f-f4bac7de8c83 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:16:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1d2e9924-68ba-45ee-877f-f4bac7de8c83 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:16:44 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1d2e9924-68ba-45ee-877f-f4bac7de8c83 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:16:44 user nova-compute[74996]: INFO nova.compute.manager [None req-1d2e9924-68ba-45ee-877f-f4bac7de8c83 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Terminating instance
Nov 02 02:16:44 user nova-compute[74996]: DEBUG nova.compute.manager [None req-1d2e9924-68ba-45ee-877f-f4bac7de8c83 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 02:16:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:45 user nova-compute[74996]: DEBUG nova.network.neutron [req-bb84a614-8710-4d1e-a16f-4f10e65a1b53 req-5d90fadc-5b07-4c6b-9bfe-52025f8472bc service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Updated VIF entry in instance network info cache for port 181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 02:16:45 user nova-compute[74996]: DEBUG nova.network.neutron [req-bb84a614-8710-4d1e-a16f-4f10e65a1b53 req-5d90fadc-5b07-4c6b-9bfe-52025f8472bc service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Updating instance_info_cache with network_info: [{"id": "181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1", "address": "fa:16:3e:9b:6d:bc", "network": {"id": "3578933b-907b-439c-92d0-4311826a0163", "bridge": "br-int", "label": "tempest-TestStampPattern-1622075405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7cdc1a0ba64a25821d5c99b20de231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181e7d4d-be", "ovs_interfaceid": "181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:16:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-bb84a614-8710-4d1e-a16f-4f10e65a1b53 req-5d90fadc-5b07-4c6b-9bfe-52025f8472bc service nova] Releasing lock "refresh_cache-3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:16:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-2d4a0fa5-f437-48b0-b64e-9ada4c83cfe7 req-edb9fd64-20d4-434f-adfb-b84948d9984e service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Received event network-vif-unplugged-181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:16:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2d4a0fa5-f437-48b0-b64e-9ada4c83cfe7 req-edb9fd64-20d4-434f-adfb-b84948d9984e service nova] Acquiring lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:16:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2d4a0fa5-f437-48b0-b64e-9ada4c83cfe7 req-edb9fd64-20d4-434f-adfb-b84948d9984e service nova] Lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:16:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-2d4a0fa5-f437-48b0-b64e-9ada4c83cfe7 req-edb9fd64-20d4-434f-adfb-b84948d9984e service nova] Lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:16:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-2d4a0fa5-f437-48b0-b64e-9ada4c83cfe7 req-edb9fd64-20d4-434f-adfb-b84948d9984e service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] No waiting events found dispatching network-vif-unplugged-181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:16:45 user nova-compute[74996]: DEBUG nova.compute.manager [req-2d4a0fa5-f437-48b0-b64e-9ada4c83cfe7 req-edb9fd64-20d4-434f-adfb-b84948d9984e service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Received event network-vif-unplugged-181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 02:16:45 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Instance destroyed successfully.
Nov 02 02:16:45 user nova-compute[74996]: DEBUG nova.objects.instance [None req-1d2e9924-68ba-45ee-877f-f4bac7de8c83 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lazy-loading 'resources' on Instance uuid 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:16:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-1d2e9924-68ba-45ee-877f-f4bac7de8c83 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:08:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1171162396',display_name='tempest-TestStampPattern-server-1171162396',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1171162396',id=48,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKJHuw6Qr4/PNCfq6n+9tvXVKbxGaOJVnul0YErELd6vC57iiAiOyevzzMq1POKS4qzqhx+V78eYjcL2zfkyulhd6D3nM2HSkapGvB1Xf65v7OsTXK2YbtKtdN7HwXQcw==',key_name='tempest-TestStampPattern-1523316715',keypairs=<?>,launch_index=0,launched_at=2023-11-02T02:09:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d7cdc1a0ba64a25821d5c99b20de231',ramdisk_id='',reservation_id='r-ol0uqehs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-856812097',owner_user_name='tempest-TestStampPattern-856812097-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T02:12:22Z,user_data=None,user_id='832530cd183e4944994e8032ac37c621',uuid=3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1", "address": "fa:16:3e:9b:6d:bc", "network": {"id": "3578933b-907b-439c-92d0-4311826a0163", "bridge": "br-int", "label": "tempest-TestStampPattern-1622075405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7cdc1a0ba64a25821d5c99b20de231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181e7d4d-be", "ovs_interfaceid": "181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 02:16:45 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-1d2e9924-68ba-45ee-877f-f4bac7de8c83 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Converting VIF {"id": "181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1", "address": "fa:16:3e:9b:6d:bc", "network": {"id": "3578933b-907b-439c-92d0-4311826a0163", "bridge": "br-int", "label": "tempest-TestStampPattern-1622075405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d7cdc1a0ba64a25821d5c99b20de231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181e7d4d-be", "ovs_interfaceid": "181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:16:45 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-1d2e9924-68ba-45ee-877f-f4bac7de8c83 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:6d:bc,bridge_name='br-int',has_traffic_filtering=True,id=181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1,network=Network(3578933b-907b-439c-92d0-4311826a0163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181e7d4d-be') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:16:45 user nova-compute[74996]: DEBUG os_vif [None req-1d2e9924-68ba-45ee-877f-f4bac7de8c83 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:6d:bc,bridge_name='br-int',has_traffic_filtering=True,id=181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1,network=Network(3578933b-907b-439c-92d0-4311826a0163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181e7d4d-be') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 02:16:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap181e7d4d-be, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:16:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:16:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10e19a19-e003-4f68-87a0-691c9a94a318) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:16:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:45 user nova-compute[74996]: INFO os_vif [None req-1d2e9924-68ba-45ee-877f-f4bac7de8c83 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:6d:bc,bridge_name='br-int',has_traffic_filtering=True,id=181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1,network=Network(3578933b-907b-439c-92d0-4311826a0163),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181e7d4d-be')
Nov 02 02:16:45 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-1d2e9924-68ba-45ee-877f-f4bac7de8c83 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Deleting instance files /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa_del
Nov 02 02:16:45 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-1d2e9924-68ba-45ee-877f-f4bac7de8c83 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Deletion of /opt/stack/data/nova/instances/3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa_del complete
Nov 02 02:16:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:16:45 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:16:45 user nova-compute[74996]: INFO nova.compute.manager [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Detaching volume 1acfb13a-0211-48ad-b8f9-db022f83e463
Nov 02 02:16:45 user nova-compute[74996]: INFO nova.compute.manager [None req-1d2e9924-68ba-45ee-877f-f4bac7de8c83 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 02 02:16:45 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-1d2e9924-68ba-45ee-877f-f4bac7de8c83 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 02:16:45 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 02:16:45 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 02:16:45 user nova-compute[74996]: INFO nova.virt.block_device [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Attempting to driver detach volume 1acfb13a-0211-48ad-b8f9-db022f83e463 from mountpoint /dev/vdc
Nov 02 02:16:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Attempting to detach device vdc from instance fd4c3759-195f-43f9-ba9b-3f2c033453f0 from the persistent domain config. {{(pid=74996) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 02 02:16:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 02:16:45 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:16:45 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 02:16:45 user nova-compute[74996]:   <target dev="vdc" bus="virtio"/>
Nov 02 02:16:45 user nova-compute[74996]:   <serial>1acfb13a-0211-48ad-b8f9-db022f83e463</serial>
Nov 02 02:16:45 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 02 02:16:45 user nova-compute[74996]: </disk>
Nov 02 02:16:45 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 02:16:45 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Successfully detached device vdc from instance fd4c3759-195f-43f9-ba9b-3f2c033453f0 from the persistent domain config.
Nov 02 02:16:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance fd4c3759-195f-43f9-ba9b-3f2c033453f0 from the live domain config. {{(pid=74996) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 02 02:16:45 user nova-compute[74996]: DEBUG nova.virt.libvirt.guest [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] detach device xml: <disk type="block" device="disk">
Nov 02 02:16:45 user nova-compute[74996]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 02 02:16:45 user nova-compute[74996]:   <source dev="/dev/sdc"/>
Nov 02 02:16:45 user nova-compute[74996]:   <target dev="vdc" bus="virtio"/>
Nov 02 02:16:45 user nova-compute[74996]:   <serial>1acfb13a-0211-48ad-b8f9-db022f83e463</serial>
Nov 02 02:16:45 user nova-compute[74996]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 02 02:16:45 user nova-compute[74996]: </disk>
Nov 02 02:16:45 user nova-compute[74996]:  {{(pid=74996) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 02 02:16:46 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:16:46 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Took 0.48 seconds to deallocate network for instance.
Nov 02 02:16:46 user nova-compute[74996]: DEBUG nova.compute.manager [req-74abf0b7-5f74-4efd-8069-f3cca9f99ce4 req-1b562e09-03cf-43a4-87fd-f01673e99b78 service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Received event network-vif-deleted-181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:16:46 user nova-compute[74996]: INFO nova.compute.manager [req-74abf0b7-5f74-4efd-8069-f3cca9f99ce4 req-1b562e09-03cf-43a4-87fd-f01673e99b78 service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Neutron deleted interface 181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1; detaching it from the instance and deleting it from the info cache
Nov 02 02:16:46 user nova-compute[74996]: DEBUG nova.network.neutron [req-74abf0b7-5f74-4efd-8069-f3cca9f99ce4 req-1b562e09-03cf-43a4-87fd-f01673e99b78 service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:16:46 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance fd4c3759-195f-43f9-ba9b-3f2c033453f0 {{(pid=74996) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 02 02:16:46 user nova-compute[74996]: DEBUG nova.compute.manager [req-74abf0b7-5f74-4efd-8069-f3cca9f99ce4 req-1b562e09-03cf-43a4-87fd-f01673e99b78 service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Detach interface failed, port_id=181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1, reason: Instance 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa could not be found. {{(pid=74996) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 02:16:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1d2e9924-68ba-45ee-877f-f4bac7de8c83 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:16:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1d2e9924-68ba-45ee-877f-f4bac7de8c83 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:16:46 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-1d2e9924-68ba-45ee-877f-f4bac7de8c83 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Refreshing inventories for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 02:16:46 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-1d2e9924-68ba-45ee-877f-f4bac7de8c83 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Updating ProviderTree inventory for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 02:16:46 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-1d2e9924-68ba-45ee-877f-f4bac7de8c83 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Updating inventory in ProviderTree for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 02:16:46 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-1d2e9924-68ba-45ee-877f-f4bac7de8c83 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Refreshing aggregate associations for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259, aggregates: None {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 02:16:46 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-1d2e9924-68ba-45ee-877f-f4bac7de8c83 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Refreshing trait associations for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 02:16:46 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-1d2e9924-68ba-45ee-877f-f4bac7de8c83 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:16:46 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-1d2e9924-68ba-45ee-877f-f4bac7de8c83 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:16:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1d2e9924-68ba-45ee-877f-f4bac7de8c83 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.260s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:16:46 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-1d2e9924-68ba-45ee-877f-f4bac7de8c83 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Deleted allocations for instance 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa
Nov 02 02:16:46 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-1d2e9924-68ba-45ee-877f-f4bac7de8c83 tempest-TestStampPattern-856812097 tempest-TestStampPattern-856812097-project-member] Lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.783s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:16:47 user nova-compute[74996]: DEBUG nova.compute.manager [req-4f1c6c94-6286-4680-af11-5f708cd7d0a8 req-9d791053-c5ef-4880-aedd-cc8d0f74eb87 service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Received event network-vif-plugged-181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:16:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4f1c6c94-6286-4680-af11-5f708cd7d0a8 req-9d791053-c5ef-4880-aedd-cc8d0f74eb87 service nova] Acquiring lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:16:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4f1c6c94-6286-4680-af11-5f708cd7d0a8 req-9d791053-c5ef-4880-aedd-cc8d0f74eb87 service nova] Lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:16:47 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-4f1c6c94-6286-4680-af11-5f708cd7d0a8 req-9d791053-c5ef-4880-aedd-cc8d0f74eb87 service nova] Lock "3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:16:47 user nova-compute[74996]: DEBUG nova.compute.manager [req-4f1c6c94-6286-4680-af11-5f708cd7d0a8 req-9d791053-c5ef-4880-aedd-cc8d0f74eb87 service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] No waiting events found dispatching network-vif-plugged-181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:16:47 user nova-compute[74996]: WARNING nova.compute.manager [req-4f1c6c94-6286-4680-af11-5f708cd7d0a8 req-9d791053-c5ef-4880-aedd-cc8d0f74eb87 service nova] [instance: 3faf9c06-ff96-4d6a-aa17-2b6eb19f3ffa] Received unexpected event network-vif-plugged-181e7d4d-bee8-4ea4-9fe6-61fe1fe881e1 for instance with vm_state deleted and task_state None.
Nov 02 02:16:49 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:16:49 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:16:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:16:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:16:49 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:16:49 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 02:16:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb51ec3b-0715-4c23-81d4-bd711c770f8f/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb51ec3b-0715-4c23-81d4-bd711c770f8f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:49 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb51ec3b-0715-4c23-81d4-bd711c770f8f/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:16:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb51ec3b-0715-4c23-81d4-bd711c770f8f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:16:50 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:16:50 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:16:50 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8714MB free_disk=24.880386352539062GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 02:16:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:16:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:16:50 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance fd4c3759-195f-43f9-ba9b-3f2c033453f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:16:50 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance bb51ec3b-0715-4c23-81d4-bd711c770f8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:16:50 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 02:16:50 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 02:16:50 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:16:50 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:16:50 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 02:16:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:16:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:54 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:16:54 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 02:16:54 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Rebuilding the list of instances to heal {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 02:16:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-fd4c3759-195f-43f9-ba9b-3f2c033453f0" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:16:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-fd4c3759-195f-43f9-ba9b-3f2c033453f0" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:16:54 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 02:16:54 user nova-compute[74996]: DEBUG nova.objects.instance [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lazy-loading 'info_cache' on Instance uuid fd4c3759-195f-43f9-ba9b-3f2c033453f0 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:16:55 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Updating instance_info_cache with network_info: [{"id": "e0dab6b7-2e30-4c0e-95c7-8d195066e5dd", "address": "fa:16:3e:7f:85:7c", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0dab6b7-2e", "ovs_interfaceid": "e0dab6b7-2e30-4c0e-95c7-8d195066e5dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:16:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-fd4c3759-195f-43f9-ba9b-3f2c033453f0" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:16:55 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 02:16:55 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:16:55 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:16:55 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:16:55 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:55 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:16:55 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:16:55 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:16:55 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:16:56 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:16:57 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:16:57 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:16:57 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 02:17:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:03 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:17:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:17:06 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance fd4c3759-195f-43f9-ba9b-3f2c033453f0 is timed out.
Nov 02 02:17:06 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Successfully detached device vdc from instance fd4c3759-195f-43f9-ba9b-3f2c033453f0 from the live domain config.
Nov 02 02:17:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] calling os-brick to detach iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f830c661510>, {'target_iqn': 'iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'skOorFvR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 02 02:17:06 user nova-compute[74996]: WARNING os_brick.initiator.connectors.base [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 02 02:17:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d60cbf-904c-41aa-8f74-fd98dce57f4f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 02 02:17:06 user nova-compute[74996]: No targets found.
Nov 02 02:17:06 user nova-compute[74996]: iSNS:
Nov 02 02:17:06 user nova-compute[74996]: No targets found.
Nov 02 02:17:06 user nova-compute[74996]: STATIC:
Nov 02 02:17:06 user nova-compute[74996]: Target: iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463
Nov 02 02:17:06 user nova-compute[74996]:         Portal: 172.16.0.220:3260,-1
Nov 02 02:17:06 user nova-compute[74996]:                 Iface Name: default
Nov 02 02:17:06 user nova-compute[74996]: FIRMWARE:
Nov 02 02:17:06 user nova-compute[74996]: No targets found.
Nov 02 02:17:06 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 02 02:17:06 user nova-compute[74996]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 02 02:17:06 user nova-compute[74996]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74996) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463', 0)] {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5bbfad-fa56-4872-b3ea-931b8e59c967]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e06756-ce4e-4a3e-b6b8-e5205897b6de]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 (non-flash)\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 (non-flash)
Nov 02 02:17:06 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 (non-flash)
Nov 02 02:17:06 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e84a1ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463'): ({'sdc'}, set())}) {{(pid=74996) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Removing single pathed devices sdc {{(pid=74996) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff165447-ff61-4175-a8a3-5b78c3e57f2b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc26921e-a3c7-45bb-a89b-6341ffa07c7e]: (4, ('ok\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Flushing IO for device /dev/sdc {{(pid=74996) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a48e480-1099-4fcf-a11f-a23a087edae4]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74996) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d301e1-0930-4203-9dc7-b865e8d8f98c]: (4, ('1', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG os_brick.initiator.linuxscsi [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] SCSI volumes sdc have been removed. {{(pid=74996) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463')] {{(pid=74996) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[4117437a-5bd7-40df-b87d-41a46e309a5a]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 -p 172.16.0.220:3260 --logout {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cedaa50-5132-40f5-9da5-d322b99c82b4]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463, portal: 172.16.0.220,3260]
Nov 02 02:17:06 user nova-compute[74996]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463, portal: 172.16.0.220,3260] successful.
Nov 02 02:17:06 user nova-compute[74996]:  stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 -p 172.16.0.220:3260 --op delete {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1acfb13a-0211-48ad-b8f9-db022f83e463 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf06fb0-5433-4824-bda0-b00cf9d9a27c]: (4, ('', '')) {{(pid=86449) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74996) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.base [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG os_brick.initiator.connectors.iscsi [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] <== disconnect_volume: return (294ms) None {{(pid=74996) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 02 02:17:06 user nova-compute[74996]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Disconnected iSCSI Volume {{(pid=74996) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 02 02:17:07 user nova-compute[74996]: DEBUG nova.objects.instance [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'flavor' on Instance uuid fd4c3759-195f-43f9-ba9b-3f2c033453f0 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:17:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-7875c515-a0dc-4d08-a059-8a3b210d57e0 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.777s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:17:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-45f777c3-899d-4d7b-9014-76603cb81704 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:17:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-45f777c3-899d-4d7b-9014-76603cb81704 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:17:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-45f777c3-899d-4d7b-9014-76603cb81704 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:17:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-45f777c3-899d-4d7b-9014-76603cb81704 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:17:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-45f777c3-899d-4d7b-9014-76603cb81704 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:17:08 user nova-compute[74996]: INFO nova.compute.manager [None req-45f777c3-899d-4d7b-9014-76603cb81704 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Terminating instance
Nov 02 02:17:08 user nova-compute[74996]: DEBUG nova.compute.manager [None req-45f777c3-899d-4d7b-9014-76603cb81704 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 02:17:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:08 user nova-compute[74996]: DEBUG nova.compute.manager [req-111b33ad-4252-418a-a4ac-38b298a440ec req-cc7dabf0-0881-4f87-8ae1-75b38ca4e55c service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Received event network-vif-unplugged-e0dab6b7-2e30-4c0e-95c7-8d195066e5dd {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:17:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-111b33ad-4252-418a-a4ac-38b298a440ec req-cc7dabf0-0881-4f87-8ae1-75b38ca4e55c service nova] Acquiring lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:17:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-111b33ad-4252-418a-a4ac-38b298a440ec req-cc7dabf0-0881-4f87-8ae1-75b38ca4e55c service nova] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:17:08 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-111b33ad-4252-418a-a4ac-38b298a440ec req-cc7dabf0-0881-4f87-8ae1-75b38ca4e55c service nova] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:17:08 user nova-compute[74996]: DEBUG nova.compute.manager [req-111b33ad-4252-418a-a4ac-38b298a440ec req-cc7dabf0-0881-4f87-8ae1-75b38ca4e55c service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] No waiting events found dispatching network-vif-unplugged-e0dab6b7-2e30-4c0e-95c7-8d195066e5dd {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:17:08 user nova-compute[74996]: DEBUG nova.compute.manager [req-111b33ad-4252-418a-a4ac-38b298a440ec req-cc7dabf0-0881-4f87-8ae1-75b38ca4e55c service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Received event network-vif-unplugged-e0dab6b7-2e30-4c0e-95c7-8d195066e5dd for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 02:17:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:09 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Instance destroyed successfully.
Nov 02 02:17:09 user nova-compute[74996]: DEBUG nova.objects.instance [None req-45f777c3-899d-4d7b-9014-76603cb81704 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lazy-loading 'resources' on Instance uuid fd4c3759-195f-43f9-ba9b-3f2c033453f0 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:17:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:09 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-45f777c3-899d-4d7b-9014-76603cb81704 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:13:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1459802335',display_name='tempest-AttachVolumeTestJSON-server-1459802335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1459802335',id=50,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5zwu8ba/QO8AymlbeQVVnp7NVkdGarDoqTi+mZX2u/xg7ZHka08hmtGgFQV9DruWxMbCsTXYIufD9QQg3jDsi48OFiNg40o9EUK3BfXKTWL5/1t9DdtPWqsZ7x/g7JFA==',key_name='tempest-keypair-1079969230',keypairs=<?>,launch_index=0,launched_at=2023-11-02T02:13:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fee0ae54cb9642e68d847235ebe13875',ramdisk_id='',reservation_id='r-270bo31y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1064832613',owner_user_name='tempest-AttachVolumeTestJSON-1064832613-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T02:13:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd49c6f202cc46b496df91de55c53c65',uuid=fd4c3759-195f-43f9-ba9b-3f2c033453f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0dab6b7-2e30-4c0e-95c7-8d195066e5dd", "address": "fa:16:3e:7f:85:7c", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0dab6b7-2e", "ovs_interfaceid": "e0dab6b7-2e30-4c0e-95c7-8d195066e5dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 02:17:09 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-45f777c3-899d-4d7b-9014-76603cb81704 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Converting VIF {"id": "e0dab6b7-2e30-4c0e-95c7-8d195066e5dd", "address": "fa:16:3e:7f:85:7c", "network": {"id": "699807b0-2588-4e44-967e-e11023d25985", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2068749152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fee0ae54cb9642e68d847235ebe13875", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0dab6b7-2e", "ovs_interfaceid": "e0dab6b7-2e30-4c0e-95c7-8d195066e5dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:17:09 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-45f777c3-899d-4d7b-9014-76603cb81704 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:85:7c,bridge_name='br-int',has_traffic_filtering=True,id=e0dab6b7-2e30-4c0e-95c7-8d195066e5dd,network=Network(699807b0-2588-4e44-967e-e11023d25985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0dab6b7-2e') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:17:09 user nova-compute[74996]: DEBUG os_vif [None req-45f777c3-899d-4d7b-9014-76603cb81704 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:85:7c,bridge_name='br-int',has_traffic_filtering=True,id=e0dab6b7-2e30-4c0e-95c7-8d195066e5dd,network=Network(699807b0-2588-4e44-967e-e11023d25985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0dab6b7-2e') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 02:17:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0dab6b7-2e, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:17:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:17:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff8c7d58-a29c-4e83-96fc-9abcebda1c6c) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:17:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:17:09 user nova-compute[74996]: INFO os_vif [None req-45f777c3-899d-4d7b-9014-76603cb81704 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:85:7c,bridge_name='br-int',has_traffic_filtering=True,id=e0dab6b7-2e30-4c0e-95c7-8d195066e5dd,network=Network(699807b0-2588-4e44-967e-e11023d25985),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0dab6b7-2e')
Nov 02 02:17:09 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-45f777c3-899d-4d7b-9014-76603cb81704 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Deleting instance files /opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0_del
Nov 02 02:17:09 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-45f777c3-899d-4d7b-9014-76603cb81704 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Deletion of /opt/stack/data/nova/instances/fd4c3759-195f-43f9-ba9b-3f2c033453f0_del complete
Nov 02 02:17:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:09 user nova-compute[74996]: INFO nova.compute.manager [None req-45f777c3-899d-4d7b-9014-76603cb81704 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 02 02:17:09 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-45f777c3-899d-4d7b-9014-76603cb81704 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 02:17:09 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 02:17:09 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 02:17:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:10 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:17:10 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Took 0.69 seconds to deallocate network for instance.
Nov 02 02:17:10 user nova-compute[74996]: DEBUG nova.compute.manager [req-d75adf01-b0de-4464-aa17-46437dd872c6 req-035f7557-9fd6-40d4-95af-992630557c76 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Received event network-vif-deleted-e0dab6b7-2e30-4c0e-95c7-8d195066e5dd {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:17:10 user nova-compute[74996]: INFO nova.compute.manager [req-d75adf01-b0de-4464-aa17-46437dd872c6 req-035f7557-9fd6-40d4-95af-992630557c76 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Neutron deleted interface e0dab6b7-2e30-4c0e-95c7-8d195066e5dd; detaching it from the instance and deleting it from the info cache
Nov 02 02:17:10 user nova-compute[74996]: DEBUG nova.network.neutron [req-d75adf01-b0de-4464-aa17-46437dd872c6 req-035f7557-9fd6-40d4-95af-992630557c76 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:17:10 user nova-compute[74996]: DEBUG nova.compute.manager [req-d75adf01-b0de-4464-aa17-46437dd872c6 req-035f7557-9fd6-40d4-95af-992630557c76 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Detach interface failed, port_id=e0dab6b7-2e30-4c0e-95c7-8d195066e5dd, reason: Instance fd4c3759-195f-43f9-ba9b-3f2c033453f0 could not be found. {{(pid=74996) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Nov 02 02:17:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-45f777c3-899d-4d7b-9014-76603cb81704 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:17:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-45f777c3-899d-4d7b-9014-76603cb81704 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:17:10 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-45f777c3-899d-4d7b-9014-76603cb81704 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:17:10 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-45f777c3-899d-4d7b-9014-76603cb81704 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:17:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-45f777c3-899d-4d7b-9014-76603cb81704 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.153s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:17:10 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-45f777c3-899d-4d7b-9014-76603cb81704 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Deleted allocations for instance fd4c3759-195f-43f9-ba9b-3f2c033453f0
Nov 02 02:17:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-45f777c3-899d-4d7b-9014-76603cb81704 tempest-AttachVolumeTestJSON-1064832613 tempest-AttachVolumeTestJSON-1064832613-project-member] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.872s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:17:10 user nova-compute[74996]: DEBUG nova.compute.manager [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Received event network-vif-plugged-e0dab6b7-2e30-4c0e-95c7-8d195066e5dd {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:17:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] Acquiring lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:17:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:17:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:17:10 user nova-compute[74996]: DEBUG nova.compute.manager [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] No waiting events found dispatching network-vif-plugged-e0dab6b7-2e30-4c0e-95c7-8d195066e5dd {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:17:10 user nova-compute[74996]: WARNING nova.compute.manager [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Received unexpected event network-vif-plugged-e0dab6b7-2e30-4c0e-95c7-8d195066e5dd for instance with vm_state deleted and task_state None.
Nov 02 02:17:10 user nova-compute[74996]: DEBUG nova.compute.manager [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Received event network-vif-plugged-e0dab6b7-2e30-4c0e-95c7-8d195066e5dd {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:17:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] Acquiring lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:17:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:17:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:17:10 user nova-compute[74996]: DEBUG nova.compute.manager [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] No waiting events found dispatching network-vif-plugged-e0dab6b7-2e30-4c0e-95c7-8d195066e5dd {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:17:10 user nova-compute[74996]: WARNING nova.compute.manager [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Received unexpected event network-vif-plugged-e0dab6b7-2e30-4c0e-95c7-8d195066e5dd for instance with vm_state deleted and task_state None.
Nov 02 02:17:10 user nova-compute[74996]: DEBUG nova.compute.manager [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Received event network-vif-plugged-e0dab6b7-2e30-4c0e-95c7-8d195066e5dd {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:17:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] Acquiring lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:17:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:17:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:17:10 user nova-compute[74996]: DEBUG nova.compute.manager [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] No waiting events found dispatching network-vif-plugged-e0dab6b7-2e30-4c0e-95c7-8d195066e5dd {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:17:10 user nova-compute[74996]: WARNING nova.compute.manager [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Received unexpected event network-vif-plugged-e0dab6b7-2e30-4c0e-95c7-8d195066e5dd for instance with vm_state deleted and task_state None.
Nov 02 02:17:10 user nova-compute[74996]: DEBUG nova.compute.manager [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Received event network-vif-unplugged-e0dab6b7-2e30-4c0e-95c7-8d195066e5dd {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:17:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] Acquiring lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:17:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:17:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:17:10 user nova-compute[74996]: DEBUG nova.compute.manager [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] No waiting events found dispatching network-vif-unplugged-e0dab6b7-2e30-4c0e-95c7-8d195066e5dd {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:17:10 user nova-compute[74996]: WARNING nova.compute.manager [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Received unexpected event network-vif-unplugged-e0dab6b7-2e30-4c0e-95c7-8d195066e5dd for instance with vm_state deleted and task_state None.
Nov 02 02:17:10 user nova-compute[74996]: DEBUG nova.compute.manager [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Received event network-vif-plugged-e0dab6b7-2e30-4c0e-95c7-8d195066e5dd {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:17:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] Acquiring lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:17:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:17:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] Lock "fd4c3759-195f-43f9-ba9b-3f2c033453f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:17:10 user nova-compute[74996]: DEBUG nova.compute.manager [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] No waiting events found dispatching network-vif-plugged-e0dab6b7-2e30-4c0e-95c7-8d195066e5dd {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:17:10 user nova-compute[74996]: WARNING nova.compute.manager [req-3dc9eb00-c5cd-4b17-affc-dcd2a4bb9b36 req-3d22bd37-819c-4f15-92e1-31ee0a49fc74 service nova] [instance: fd4c3759-195f-43f9-ba9b-3f2c033453f0] Received unexpected event network-vif-plugged-e0dab6b7-2e30-4c0e-95c7-8d195066e5dd for instance with vm_state deleted and task_state None.
Nov 02 02:17:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:17:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:17:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:17:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:17:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:17:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:17:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:17:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:17:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:17:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:17:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:17:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:17:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:17:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:49 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:17:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:50 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:17:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:17:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:17:50 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:17:50 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 02:17:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb51ec3b-0715-4c23-81d4-bd711c770f8f/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:17:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb51ec3b-0715-4c23-81d4-bd711c770f8f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:17:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb51ec3b-0715-4c23-81d4-bd711c770f8f/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:17:50 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb51ec3b-0715-4c23-81d4-bd711c770f8f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:17:51 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:17:51 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:17:51 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8805MB free_disk=24.906719207763672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 02:17:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:17:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:17:51 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance bb51ec3b-0715-4c23-81d4-bd711c770f8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:17:51 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 02:17:51 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 02:17:51 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:17:51 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:51 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:17:51 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 02:17:51 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:17:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:55 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:17:55 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 02:17:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-bb51ec3b-0715-4c23-81d4-bd711c770f8f" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:17:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-bb51ec3b-0715-4c23-81d4-bd711c770f8f" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:17:55 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 02:17:55 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Updating instance_info_cache with network_info: [{"id": "e70a1c2d-d33e-4e19-b0f4-0c18e3744156", "address": "fa:16:3e:f8:6b:4f", "network": {"id": "17d61192-0043-4d14-9430-e9428c420996", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1566782008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29da62432afe44fe8e109db1d464f8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70a1c2d-d3", "ovs_interfaceid": "e70a1c2d-d33e-4e19-b0f4-0c18e3744156", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:17:56 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-bb51ec3b-0715-4c23-81d4-bd711c770f8f" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:17:56 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 02:17:56 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:17:56 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:17:56 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:17:57 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:17:57 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 02:17:59 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:17:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:17:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:17:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:17:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:17:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:17:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:18:03 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:18:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:18:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:18:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:18:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:18:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:18:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:18:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:18:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-339002a4-d7e2-4a26-863e-44d672c1fe54 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Acquiring lock "bb51ec3b-0715-4c23-81d4-bd711c770f8f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:18:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-339002a4-d7e2-4a26-863e-44d672c1fe54 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "bb51ec3b-0715-4c23-81d4-bd711c770f8f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:18:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-339002a4-d7e2-4a26-863e-44d672c1fe54 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Acquiring lock "bb51ec3b-0715-4c23-81d4-bd711c770f8f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:18:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-339002a4-d7e2-4a26-863e-44d672c1fe54 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "bb51ec3b-0715-4c23-81d4-bd711c770f8f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:18:09 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-339002a4-d7e2-4a26-863e-44d672c1fe54 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "bb51ec3b-0715-4c23-81d4-bd711c770f8f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:18:09 user nova-compute[74996]: INFO nova.compute.manager [None req-339002a4-d7e2-4a26-863e-44d672c1fe54 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Terminating instance
Nov 02 02:18:09 user nova-compute[74996]: DEBUG nova.compute.manager [None req-339002a4-d7e2-4a26-863e-44d672c1fe54 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 02:18:10 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:18:10 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:18:10 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:18:10 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:18:10 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:18:10 user nova-compute[74996]: DEBUG nova.compute.manager [req-fba5a626-c4b4-4092-90d8-543053d953e4 req-18df1be8-f1f1-4fc2-ac8f-1392fe7ddb00 service nova] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Received event network-vif-unplugged-e70a1c2d-d33e-4e19-b0f4-0c18e3744156 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:18:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-fba5a626-c4b4-4092-90d8-543053d953e4 req-18df1be8-f1f1-4fc2-ac8f-1392fe7ddb00 service nova] Acquiring lock "bb51ec3b-0715-4c23-81d4-bd711c770f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:18:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-fba5a626-c4b4-4092-90d8-543053d953e4 req-18df1be8-f1f1-4fc2-ac8f-1392fe7ddb00 service nova] Lock "bb51ec3b-0715-4c23-81d4-bd711c770f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:18:10 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-fba5a626-c4b4-4092-90d8-543053d953e4 req-18df1be8-f1f1-4fc2-ac8f-1392fe7ddb00 service nova] Lock "bb51ec3b-0715-4c23-81d4-bd711c770f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:18:10 user nova-compute[74996]: DEBUG nova.compute.manager [req-fba5a626-c4b4-4092-90d8-543053d953e4 req-18df1be8-f1f1-4fc2-ac8f-1392fe7ddb00 service nova] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] No waiting events found dispatching network-vif-unplugged-e70a1c2d-d33e-4e19-b0f4-0c18e3744156 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:18:10 user nova-compute[74996]: DEBUG nova.compute.manager [req-fba5a626-c4b4-4092-90d8-543053d953e4 req-18df1be8-f1f1-4fc2-ac8f-1392fe7ddb00 service nova] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Received event network-vif-unplugged-e70a1c2d-d33e-4e19-b0f4-0c18e3744156 for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 02:18:10 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Instance destroyed successfully.
Nov 02 02:18:10 user nova-compute[74996]: DEBUG nova.objects.instance [None req-339002a4-d7e2-4a26-863e-44d672c1fe54 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lazy-loading 'resources' on Instance uuid bb51ec3b-0715-4c23-81d4-bd711c770f8f {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:18:10 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-339002a4-d7e2-4a26-863e-44d672c1fe54 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:16:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-605656383',display_name='tempest-VolumesActionsTest-instance-605656383',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-605656383',id=51,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T02:16:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29da62432afe44fe8e109db1d464f8fd',ramdisk_id='',reservation_id='r-llqy5s9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-489656329',owner_user_name='tempest-VolumesActionsTest-489656329-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T02:16:16Z,user_data=None,user_id='5e7254e7d8a145669904dca6622f34d1',uuid=bb51ec3b-0715-4c23-81d4-bd711c770f8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e70a1c2d-d33e-4e19-b0f4-0c18e3744156", "address": "fa:16:3e:f8:6b:4f", "network": {"id": "17d61192-0043-4d14-9430-e9428c420996", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1566782008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29da62432afe44fe8e109db1d464f8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70a1c2d-d3", "ovs_interfaceid": "e70a1c2d-d33e-4e19-b0f4-0c18e3744156", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 02:18:10 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-339002a4-d7e2-4a26-863e-44d672c1fe54 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Converting VIF {"id": "e70a1c2d-d33e-4e19-b0f4-0c18e3744156", "address": "fa:16:3e:f8:6b:4f", "network": {"id": "17d61192-0043-4d14-9430-e9428c420996", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1566782008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29da62432afe44fe8e109db1d464f8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape70a1c2d-d3", "ovs_interfaceid": "e70a1c2d-d33e-4e19-b0f4-0c18e3744156", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:18:10 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-339002a4-d7e2-4a26-863e-44d672c1fe54 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:6b:4f,bridge_name='br-int',has_traffic_filtering=True,id=e70a1c2d-d33e-4e19-b0f4-0c18e3744156,network=Network(17d61192-0043-4d14-9430-e9428c420996),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape70a1c2d-d3') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:18:10 user nova-compute[74996]: DEBUG os_vif [None req-339002a4-d7e2-4a26-863e-44d672c1fe54 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:6b:4f,bridge_name='br-int',has_traffic_filtering=True,id=e70a1c2d-d33e-4e19-b0f4-0c18e3744156,network=Network(17d61192-0043-4d14-9430-e9428c420996),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape70a1c2d-d3') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 02:18:10 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:18:10 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape70a1c2d-d3, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:18:10 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:18:10 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:18:10 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:18:10 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6f6094f-a29d-42f2-bb19-2d550b4e2676) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:18:10 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:18:10 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:18:10 user nova-compute[74996]: INFO os_vif [None req-339002a4-d7e2-4a26-863e-44d672c1fe54 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:6b:4f,bridge_name='br-int',has_traffic_filtering=True,id=e70a1c2d-d33e-4e19-b0f4-0c18e3744156,network=Network(17d61192-0043-4d14-9430-e9428c420996),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape70a1c2d-d3')
Nov 02 02:18:10 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-339002a4-d7e2-4a26-863e-44d672c1fe54 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Deleting instance files /opt/stack/data/nova/instances/bb51ec3b-0715-4c23-81d4-bd711c770f8f_del
Nov 02 02:18:10 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-339002a4-d7e2-4a26-863e-44d672c1fe54 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Deletion of /opt/stack/data/nova/instances/bb51ec3b-0715-4c23-81d4-bd711c770f8f_del complete
Nov 02 02:18:10 user nova-compute[74996]: INFO nova.compute.manager [None req-339002a4-d7e2-4a26-863e-44d672c1fe54 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 02 02:18:10 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-339002a4-d7e2-4a26-863e-44d672c1fe54 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 02:18:10 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 02:18:10 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 02:18:11 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:18:11 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Took 0.46 seconds to deallocate network for instance.
Nov 02 02:18:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-339002a4-d7e2-4a26-863e-44d672c1fe54 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:18:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-339002a4-d7e2-4a26-863e-44d672c1fe54 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:18:11 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-339002a4-d7e2-4a26-863e-44d672c1fe54 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:18:11 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-339002a4-d7e2-4a26-863e-44d672c1fe54 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:18:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-339002a4-d7e2-4a26-863e-44d672c1fe54 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:18:11 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-339002a4-d7e2-4a26-863e-44d672c1fe54 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Deleted allocations for instance bb51ec3b-0715-4c23-81d4-bd711c770f8f
Nov 02 02:18:11 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-339002a4-d7e2-4a26-863e-44d672c1fe54 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "bb51ec3b-0715-4c23-81d4-bd711c770f8f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.701s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:18:12 user nova-compute[74996]: DEBUG nova.compute.manager [req-9136677a-bbf9-4966-8db4-e7548c36c05c req-ba982bc6-7b41-4d07-b840-c9bb65b08918 service nova] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Received event network-vif-plugged-e70a1c2d-d33e-4e19-b0f4-0c18e3744156 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:18:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9136677a-bbf9-4966-8db4-e7548c36c05c req-ba982bc6-7b41-4d07-b840-c9bb65b08918 service nova] Acquiring lock "bb51ec3b-0715-4c23-81d4-bd711c770f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:18:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9136677a-bbf9-4966-8db4-e7548c36c05c req-ba982bc6-7b41-4d07-b840-c9bb65b08918 service nova] Lock "bb51ec3b-0715-4c23-81d4-bd711c770f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:18:12 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-9136677a-bbf9-4966-8db4-e7548c36c05c req-ba982bc6-7b41-4d07-b840-c9bb65b08918 service nova] Lock "bb51ec3b-0715-4c23-81d4-bd711c770f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:18:12 user nova-compute[74996]: DEBUG nova.compute.manager [req-9136677a-bbf9-4966-8db4-e7548c36c05c req-ba982bc6-7b41-4d07-b840-c9bb65b08918 service nova] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] No waiting events found dispatching network-vif-plugged-e70a1c2d-d33e-4e19-b0f4-0c18e3744156 {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:18:12 user nova-compute[74996]: WARNING nova.compute.manager [req-9136677a-bbf9-4966-8db4-e7548c36c05c req-ba982bc6-7b41-4d07-b840-c9bb65b08918 service nova] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Received unexpected event network-vif-plugged-e70a1c2d-d33e-4e19-b0f4-0c18e3744156 for instance with vm_state deleted and task_state None.
Nov 02 02:18:12 user nova-compute[74996]: DEBUG nova.compute.manager [req-9136677a-bbf9-4966-8db4-e7548c36c05c req-ba982bc6-7b41-4d07-b840-c9bb65b08918 service nova] [instance: bb51ec3b-0715-4c23-81d4-bd711c770f8f] Received event network-vif-deleted-e70a1c2d-d33e-4e19-b0f4-0c18e3744156 {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:18:15 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:18:16 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:18:20 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:18:25 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:18:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:18:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:18:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:18:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:18:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:18:30 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:18:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:18:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:18:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:18:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:18:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:18:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:18:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:18:40 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:18:45 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:18:50 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:18:50 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:18:52 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:18:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:18:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:18:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:18:52 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 02:18:52 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:18:52 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:18:52 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=9029MB free_disk=24.932186126708984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 02:18:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:18:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:18:52 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 02:18:52 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 02:18:52 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:18:52 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:18:52 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 02:18:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:18:55 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:18:55 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:18:55 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 02:18:55 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Rebuilding the list of instances to heal {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 02:18:55 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Didn't find any instances for network info cache update. {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 02:18:55 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:18:56 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:18:57 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:18:59 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:18:59 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:18:59 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 02:19:00 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:19:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Acquiring lock "2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:19:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:19:01 user nova-compute[74996]: DEBUG nova.compute.manager [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Starting instance... {{(pid=74996) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 02 02:19:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:19:01 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:19:01 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74996) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 02 02:19:01 user nova-compute[74996]: INFO nova.compute.claims [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Claim successful on node user
Nov 02 02:19:02 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:19:02 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:19:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.267s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:19:02 user nova-compute[74996]: DEBUG nova.compute.manager [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Start building networks asynchronously for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 02 02:19:02 user nova-compute[74996]: DEBUG nova.compute.manager [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Allocating IP information in the background. {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 02 02:19:02 user nova-compute[74996]: DEBUG nova.network.neutron [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] allocate_for_instance() {{(pid=74996) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 02 02:19:02 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 02 02:19:02 user nova-compute[74996]: DEBUG nova.compute.manager [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Start building block device mappings for instance. {{(pid=74996) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 02 02:19:02 user nova-compute[74996]: DEBUG nova.policy [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e7254e7d8a145669904dca6622f34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29da62432afe44fe8e109db1d464f8fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74996) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 02 02:19:02 user nova-compute[74996]: DEBUG nova.compute.manager [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Start spawning the instance on the hypervisor. {{(pid=74996) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 02 02:19:02 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Creating instance directory {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 02 02:19:02 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Creating image(s)
Nov 02 02:19:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:19:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "/opt/stack/data/nova/instances/2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:19:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "/opt/stack/data/nova/instances/2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:19:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:19:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.178s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:19:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Acquiring lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:19:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:19:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:19:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.203s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:19:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7/disk 1073741824 {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:19:02 user nova-compute[74996]: DEBUG nova.network.neutron [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Successfully created port: a8b9d3c9-b5cc-49af-957b-9cd2713066ec {{(pid=74996) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 02 02:19:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8,backing_fmt=raw /opt/stack/data/nova/instances/2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7/disk 1073741824" returned: 0 in 0.051s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:19:02 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "d1c8704bb30a7b8df6317b18f4dbf0c134a41de8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:19:02 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c8704bb30a7b8df6317b18f4dbf0c134a41de8 --force-share --output=json" returned: 0 in 0.197s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7/disk. size=1073741824 {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.virt.disk.api [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Cannot resize image /opt/stack/data/nova/instances/2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7/disk to a smaller size. {{(pid=74996) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Created local disks {{(pid=74996) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Ensure instance console log exists: /opt/stack/data/nova/instances/2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7/console.log {{(pid=74996) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.network.neutron [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Successfully updated port: a8b9d3c9-b5cc-49af-957b-9cd2713066ec {{(pid=74996) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Acquiring lock "refresh_cache-2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Acquired lock "refresh_cache-2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.network.neutron [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Building network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.compute.manager [req-31fa7d79-ebad-4381-9623-042c4b21ee17 req-910e6266-abaf-48a7-9f55-68251bd6eefb service nova] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Received event network-changed-a8b9d3c9-b5cc-49af-957b-9cd2713066ec {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.compute.manager [req-31fa7d79-ebad-4381-9623-042c4b21ee17 req-910e6266-abaf-48a7-9f55-68251bd6eefb service nova] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Refreshing instance network info cache due to event network-changed-a8b9d3c9-b5cc-49af-957b-9cd2713066ec. {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-31fa7d79-ebad-4381-9623-042c4b21ee17 req-910e6266-abaf-48a7-9f55-68251bd6eefb service nova] Acquiring lock "refresh_cache-2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.network.neutron [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Instance cache missing network info. {{(pid=74996) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.network.neutron [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Updating instance_info_cache with network_info: [{"id": "a8b9d3c9-b5cc-49af-957b-9cd2713066ec", "address": "fa:16:3e:b2:8f:60", "network": {"id": "17d61192-0043-4d14-9430-e9428c420996", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1566782008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29da62432afe44fe8e109db1d464f8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b9d3c9-b5", "ovs_interfaceid": "a8b9d3c9-b5cc-49af-957b-9cd2713066ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Releasing lock "refresh_cache-2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.compute.manager [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Instance network_info: |[{"id": "a8b9d3c9-b5cc-49af-957b-9cd2713066ec", "address": "fa:16:3e:b2:8f:60", "network": {"id": "17d61192-0043-4d14-9430-e9428c420996", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1566782008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29da62432afe44fe8e109db1d464f8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b9d3c9-b5", "ovs_interfaceid": "a8b9d3c9-b5cc-49af-957b-9cd2713066ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74996) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-31fa7d79-ebad-4381-9623-042c4b21ee17 req-910e6266-abaf-48a7-9f55-68251bd6eefb service nova] Acquired lock "refresh_cache-2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.network.neutron [req-31fa7d79-ebad-4381-9623-042c4b21ee17 req-910e6266-abaf-48a7-9f55-68251bd6eefb service nova] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Refreshing network info cache for port a8b9d3c9-b5cc-49af-957b-9cd2713066ec {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Start _get_guest_xml network_info=[{"id": "a8b9d3c9-b5cc-49af-957b-9cd2713066ec", "address": "fa:16:3e:b2:8f:60", "network": {"id": "17d61192-0043-4d14-9430-e9428c420996", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1566782008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29da62432afe44fe8e109db1d464f8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b9d3c9-b5", "ovs_interfaceid": "a8b9d3c9-b5cc-49af-957b-9cd2713066ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'boot_index': 0, 'image_id': 'f544db05-269f-4ce2-a9db-e2f89ecf2dd8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 02 02:19:03 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:19:03 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] CPU controller missing on host. {{(pid=74996) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.host [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] CPU controller found on host. {{(pid=74996) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74996) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-02T01:25:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-02T01:25:29Z,direct_url=<?>,disk_format='qcow2',id=f544db05-269f-4ce2-a9db-e2f89ecf2dd8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b7bb81c16b2f458a85ebcf2fb18f7709',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-02T01:25:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Flavor limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Image limits 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Flavor pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Image pref 0:0:0 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74996) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Got 1 possible topologies {{(pid=74996) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.virt.hardware [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74996) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1935412867',display_name='tempest-VolumesActionsTest-instance-1935412867',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1935412867',id=52,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29da62432afe44fe8e109db1d464f8fd',ramdisk_id='',reservation_id='r-qjrymseb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-489656329',owner_user_name='tempest-VolumesActionsTest-489656329-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T02:19:02Z,user_data=None,user_id='5e7254e7d8a145669904dca6622f34d1',uuid=2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8b9d3c9-b5cc-49af-957b-9cd2713066ec", "address": "fa:16:3e:b2:8f:60", "network": {"id": "17d61192-0043-4d14-9430-e9428c420996", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1566782008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29da62432afe44fe8e109db1d464f8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b9d3c9-b5", "ovs_interfaceid": "a8b9d3c9-b5cc-49af-957b-9cd2713066ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74996) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Converting VIF {"id": "a8b9d3c9-b5cc-49af-957b-9cd2713066ec", "address": "fa:16:3e:b2:8f:60", "network": {"id": "17d61192-0043-4d14-9430-e9428c420996", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1566782008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29da62432afe44fe8e109db1d464f8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b9d3c9-b5", "ovs_interfaceid": "a8b9d3c9-b5cc-49af-957b-9cd2713066ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:8f:60,bridge_name='br-int',has_traffic_filtering=True,id=a8b9d3c9-b5cc-49af-957b-9cd2713066ec,network=Network(17d61192-0043-4d14-9430-e9428c420996),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8b9d3c9-b5') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.objects.instance [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] End _get_guest_xml xml=<domain type="kvm">
Nov 02 02:19:03 user nova-compute[74996]:   <uuid>2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7</uuid>
Nov 02 02:19:03 user nova-compute[74996]:   <name>instance-00000034</name>
Nov 02 02:19:03 user nova-compute[74996]:   <memory>524288</memory>
Nov 02 02:19:03 user nova-compute[74996]:   <vcpu>1</vcpu>
Nov 02 02:19:03 user nova-compute[74996]:   <metadata>
Nov 02 02:19:03 user nova-compute[74996]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 02 02:19:03 user nova-compute[74996]:       <nova:package version="0.0.0"/>
Nov 02 02:19:03 user nova-compute[74996]:       <nova:name>tempest-VolumesActionsTest-instance-1935412867</nova:name>
Nov 02 02:19:03 user nova-compute[74996]:       <nova:creationTime>2023-11-02 02:19:03</nova:creationTime>
Nov 02 02:19:03 user nova-compute[74996]:       <nova:flavor name="m1.tiny">
Nov 02 02:19:03 user nova-compute[74996]:         <nova:memory>512</nova:memory>
Nov 02 02:19:03 user nova-compute[74996]:         <nova:disk>1</nova:disk>
Nov 02 02:19:03 user nova-compute[74996]:         <nova:swap>0</nova:swap>
Nov 02 02:19:03 user nova-compute[74996]:         <nova:ephemeral>0</nova:ephemeral>
Nov 02 02:19:03 user nova-compute[74996]:         <nova:vcpus>1</nova:vcpus>
Nov 02 02:19:03 user nova-compute[74996]:       </nova:flavor>
Nov 02 02:19:03 user nova-compute[74996]:       <nova:owner>
Nov 02 02:19:03 user nova-compute[74996]:         <nova:user uuid="5e7254e7d8a145669904dca6622f34d1">tempest-VolumesActionsTest-489656329-project-member</nova:user>
Nov 02 02:19:03 user nova-compute[74996]:         <nova:project uuid="29da62432afe44fe8e109db1d464f8fd">tempest-VolumesActionsTest-489656329</nova:project>
Nov 02 02:19:03 user nova-compute[74996]:       </nova:owner>
Nov 02 02:19:03 user nova-compute[74996]:       <nova:root type="image" uuid="f544db05-269f-4ce2-a9db-e2f89ecf2dd8"/>
Nov 02 02:19:03 user nova-compute[74996]:       <nova:ports>
Nov 02 02:19:03 user nova-compute[74996]:         <nova:port uuid="a8b9d3c9-b5cc-49af-957b-9cd2713066ec">
Nov 02 02:19:03 user nova-compute[74996]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 02 02:19:03 user nova-compute[74996]:         </nova:port>
Nov 02 02:19:03 user nova-compute[74996]:       </nova:ports>
Nov 02 02:19:03 user nova-compute[74996]:     </nova:instance>
Nov 02 02:19:03 user nova-compute[74996]:   </metadata>
Nov 02 02:19:03 user nova-compute[74996]:   <sysinfo type="smbios">
Nov 02 02:19:03 user nova-compute[74996]:     <system>
Nov 02 02:19:03 user nova-compute[74996]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 02 02:19:03 user nova-compute[74996]:       <entry name="product">OpenStack Nova</entry>
Nov 02 02:19:03 user nova-compute[74996]:       <entry name="version">0.0.0</entry>
Nov 02 02:19:03 user nova-compute[74996]:       <entry name="serial">2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7</entry>
Nov 02 02:19:03 user nova-compute[74996]:       <entry name="uuid">2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7</entry>
Nov 02 02:19:03 user nova-compute[74996]:       <entry name="family">Virtual Machine</entry>
Nov 02 02:19:03 user nova-compute[74996]:     </system>
Nov 02 02:19:03 user nova-compute[74996]:   </sysinfo>
Nov 02 02:19:03 user nova-compute[74996]:   <os>
Nov 02 02:19:03 user nova-compute[74996]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 02 02:19:03 user nova-compute[74996]:     <boot dev="hd"/>
Nov 02 02:19:03 user nova-compute[74996]:     <smbios mode="sysinfo"/>
Nov 02 02:19:03 user nova-compute[74996]:   </os>
Nov 02 02:19:03 user nova-compute[74996]:   <features>
Nov 02 02:19:03 user nova-compute[74996]:     <acpi/>
Nov 02 02:19:03 user nova-compute[74996]:     <apic/>
Nov 02 02:19:03 user nova-compute[74996]:     <vmcoreinfo/>
Nov 02 02:19:03 user nova-compute[74996]:   </features>
Nov 02 02:19:03 user nova-compute[74996]:   <clock offset="utc">
Nov 02 02:19:03 user nova-compute[74996]:     <timer name="pit" tickpolicy="delay"/>
Nov 02 02:19:03 user nova-compute[74996]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 02 02:19:03 user nova-compute[74996]:     <timer name="hpet" present="no"/>
Nov 02 02:19:03 user nova-compute[74996]:   </clock>
Nov 02 02:19:03 user nova-compute[74996]:   <cpu mode="custom" match="exact">
Nov 02 02:19:03 user nova-compute[74996]:     <model>Nehalem</model>
Nov 02 02:19:03 user nova-compute[74996]:     <topology sockets="1" cores="1" threads="1"/>
Nov 02 02:19:03 user nova-compute[74996]:   </cpu>
Nov 02 02:19:03 user nova-compute[74996]:   <devices>
Nov 02 02:19:03 user nova-compute[74996]:     <disk type="file" device="disk">
Nov 02 02:19:03 user nova-compute[74996]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 02 02:19:03 user nova-compute[74996]:       <source file="/opt/stack/data/nova/instances/2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7/disk"/>
Nov 02 02:19:03 user nova-compute[74996]:       <target dev="vda" bus="virtio"/>
Nov 02 02:19:03 user nova-compute[74996]:     </disk>
Nov 02 02:19:03 user nova-compute[74996]:     <interface type="ethernet">
Nov 02 02:19:03 user nova-compute[74996]:       <mac address="fa:16:3e:b2:8f:60"/>
Nov 02 02:19:03 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 02:19:03 user nova-compute[74996]:       <mtu size="1442"/>
Nov 02 02:19:03 user nova-compute[74996]:       <target dev="tapa8b9d3c9-b5"/>
Nov 02 02:19:03 user nova-compute[74996]:     </interface>
Nov 02 02:19:03 user nova-compute[74996]:     <serial type="pty">
Nov 02 02:19:03 user nova-compute[74996]:       <log file="/opt/stack/data/nova/instances/2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7/console.log" append="off"/>
Nov 02 02:19:03 user nova-compute[74996]:     </serial>
Nov 02 02:19:03 user nova-compute[74996]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 02 02:19:03 user nova-compute[74996]:     <video>
Nov 02 02:19:03 user nova-compute[74996]:       <model type="virtio"/>
Nov 02 02:19:03 user nova-compute[74996]:     </video>
Nov 02 02:19:03 user nova-compute[74996]:     <rng model="virtio">
Nov 02 02:19:03 user nova-compute[74996]:       <backend model="random">/dev/urandom</backend>
Nov 02 02:19:03 user nova-compute[74996]:     </rng>
Nov 02 02:19:03 user nova-compute[74996]:     <controller type="usb" index="0" model="none"/>
Nov 02 02:19:03 user nova-compute[74996]:     <memballoon model="virtio">
Nov 02 02:19:03 user nova-compute[74996]:       <stats period="10"/>
Nov 02 02:19:03 user nova-compute[74996]:     </memballoon>
Nov 02 02:19:03 user nova-compute[74996]:   </devices>
Nov 02 02:19:03 user nova-compute[74996]: </domain>
Nov 02 02:19:03 user nova-compute[74996]:  {{(pid=74996) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1935412867',display_name='tempest-VolumesActionsTest-instance-1935412867',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1935412867',id=52,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29da62432afe44fe8e109db1d464f8fd',ramdisk_id='',reservation_id='r-qjrymseb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-489656329',owner_user_name='tempest-VolumesActionsTest-489656329-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-02T02:19:02Z,user_data=None,user_id='5e7254e7d8a145669904dca6622f34d1',uuid=2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8b9d3c9-b5cc-49af-957b-9cd2713066ec", "address": "fa:16:3e:b2:8f:60", "network": {"id": "17d61192-0043-4d14-9430-e9428c420996", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1566782008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29da62432afe44fe8e109db1d464f8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b9d3c9-b5", "ovs_interfaceid": "a8b9d3c9-b5cc-49af-957b-9cd2713066ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Converting VIF {"id": "a8b9d3c9-b5cc-49af-957b-9cd2713066ec", "address": "fa:16:3e:b2:8f:60", "network": {"id": "17d61192-0043-4d14-9430-e9428c420996", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1566782008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29da62432afe44fe8e109db1d464f8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b9d3c9-b5", "ovs_interfaceid": "a8b9d3c9-b5cc-49af-957b-9cd2713066ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:8f:60,bridge_name='br-int',has_traffic_filtering=True,id=a8b9d3c9-b5cc-49af-957b-9cd2713066ec,network=Network(17d61192-0043-4d14-9430-e9428c420996),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8b9d3c9-b5') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG os_vif [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:8f:60,bridge_name='br-int',has_traffic_filtering=True,id=a8b9d3c9-b5cc-49af-957b-9cd2713066ec,network=Network(17d61192-0043-4d14-9430-e9428c420996),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8b9d3c9-b5') {{(pid=74996) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a8257cb-3853-5948-bbf3-cad23ebd35d6', '_type': 'linux-noop'}}, row=False) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8b9d3c9-b5, may_exist=True, interface_attrs={}) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8b9d3c9-b5, col_values=(('qos', UUID('09693b52-d091-4f77-b6ee-0f418a8cab22')),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8b9d3c9-b5, col_values=(('external_ids', {'iface-id': 'a8b9d3c9-b5cc-49af-957b-9cd2713066ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:8f:60', 'vm-uuid': '2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7'}),), if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:19:03 user nova-compute[74996]: INFO os_vif [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:8f:60,bridge_name='br-int',has_traffic_filtering=True,id=a8b9d3c9-b5cc-49af-957b-9cd2713066ec,network=Network(17d61192-0043-4d14-9430-e9428c420996),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8b9d3c9-b5')
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] No BDM found with device name vda, not building metadata. {{(pid=74996) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 02 02:19:03 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] No VIF found with MAC fa:16:3e:b2:8f:60, not building metadata {{(pid=74996) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 02 02:19:04 user nova-compute[74996]: DEBUG nova.network.neutron [req-31fa7d79-ebad-4381-9623-042c4b21ee17 req-910e6266-abaf-48a7-9f55-68251bd6eefb service nova] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Updated VIF entry in instance network info cache for port a8b9d3c9-b5cc-49af-957b-9cd2713066ec. {{(pid=74996) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 02 02:19:04 user nova-compute[74996]: DEBUG nova.network.neutron [req-31fa7d79-ebad-4381-9623-042c4b21ee17 req-910e6266-abaf-48a7-9f55-68251bd6eefb service nova] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Updating instance_info_cache with network_info: [{"id": "a8b9d3c9-b5cc-49af-957b-9cd2713066ec", "address": "fa:16:3e:b2:8f:60", "network": {"id": "17d61192-0043-4d14-9430-e9428c420996", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1566782008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29da62432afe44fe8e109db1d464f8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b9d3c9-b5", "ovs_interfaceid": "a8b9d3c9-b5cc-49af-957b-9cd2713066ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:19:04 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-31fa7d79-ebad-4381-9623-042c4b21ee17 req-910e6266-abaf-48a7-9f55-68251bd6eefb service nova] Releasing lock "refresh_cache-2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:19:04 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:19:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:19:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:19:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:19:05 user nova-compute[74996]: DEBUG nova.compute.manager [req-41b75682-4a88-4799-a6d7-ba7e5bbad23d req-cd10506c-a465-44fe-827b-87606434cf57 service nova] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Received event network-vif-plugged-a8b9d3c9-b5cc-49af-957b-9cd2713066ec {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:19:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-41b75682-4a88-4799-a6d7-ba7e5bbad23d req-cd10506c-a465-44fe-827b-87606434cf57 service nova] Acquiring lock "2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:19:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-41b75682-4a88-4799-a6d7-ba7e5bbad23d req-cd10506c-a465-44fe-827b-87606434cf57 service nova] Lock "2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:19:05 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-41b75682-4a88-4799-a6d7-ba7e5bbad23d req-cd10506c-a465-44fe-827b-87606434cf57 service nova] Lock "2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:19:05 user nova-compute[74996]: DEBUG nova.compute.manager [req-41b75682-4a88-4799-a6d7-ba7e5bbad23d req-cd10506c-a465-44fe-827b-87606434cf57 service nova] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] No waiting events found dispatching network-vif-plugged-a8b9d3c9-b5cc-49af-957b-9cd2713066ec {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:19:05 user nova-compute[74996]: WARNING nova.compute.manager [req-41b75682-4a88-4799-a6d7-ba7e5bbad23d req-cd10506c-a465-44fe-827b-87606434cf57 service nova] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Received unexpected event network-vif-plugged-a8b9d3c9-b5cc-49af-957b-9cd2713066ec for instance with vm_state building and task_state spawning.
Nov 02 02:19:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:19:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:19:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:19:05 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:19:07 user nova-compute[74996]: DEBUG nova.compute.manager [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Instance event wait completed in 0 seconds for  {{(pid=74996) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 02 02:19:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Guest created on hypervisor {{(pid=74996) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 02 02:19:07 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Instance spawned successfully.
Nov 02 02:19:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 02 02:19:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Found default for hw_cdrom_bus of ide {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:19:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Found default for hw_disk_bus of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:19:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Found default for hw_input_bus of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:19:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Found default for hw_pointer_model of None {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:19:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Found default for hw_video_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:19:07 user nova-compute[74996]: DEBUG nova.virt.libvirt.driver [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Found default for hw_vif_model of virtio {{(pid=74996) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 02 02:19:07 user nova-compute[74996]: INFO nova.compute.manager [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Took 5.24 seconds to spawn the instance on the hypervisor.
Nov 02 02:19:07 user nova-compute[74996]: DEBUG nova.compute.manager [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Checking state {{(pid=74996) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 02 02:19:07 user nova-compute[74996]: INFO nova.compute.manager [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Took 5.86 seconds to build instance.
Nov 02 02:19:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-8d9772f0-18f8-4ec4-a10e-e4fe0428571c tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.967s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:19:07 user nova-compute[74996]: DEBUG nova.compute.manager [req-81485e53-5ebc-4b9c-826b-231611497891 req-3796b38b-9519-4911-91d6-85349bfed5d0 service nova] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Received event network-vif-plugged-a8b9d3c9-b5cc-49af-957b-9cd2713066ec {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:19:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-81485e53-5ebc-4b9c-826b-231611497891 req-3796b38b-9519-4911-91d6-85349bfed5d0 service nova] Acquiring lock "2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:19:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-81485e53-5ebc-4b9c-826b-231611497891 req-3796b38b-9519-4911-91d6-85349bfed5d0 service nova] Lock "2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:19:07 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-81485e53-5ebc-4b9c-826b-231611497891 req-3796b38b-9519-4911-91d6-85349bfed5d0 service nova] Lock "2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:19:07 user nova-compute[74996]: DEBUG nova.compute.manager [req-81485e53-5ebc-4b9c-826b-231611497891 req-3796b38b-9519-4911-91d6-85349bfed5d0 service nova] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] No waiting events found dispatching network-vif-plugged-a8b9d3c9-b5cc-49af-957b-9cd2713066ec {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:19:07 user nova-compute[74996]: WARNING nova.compute.manager [req-81485e53-5ebc-4b9c-826b-231611497891 req-3796b38b-9519-4911-91d6-85349bfed5d0 service nova] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Received unexpected event network-vif-plugged-a8b9d3c9-b5cc-49af-957b-9cd2713066ec for instance with vm_state active and task_state None.
Nov 02 02:19:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:19:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:19:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:19:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:19:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:19:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:19:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:19:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:19:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:19:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:19:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:19:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:19:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:19:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:19:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:19:52 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:19:53 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:19:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:19:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:19:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:19:53 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 02:19:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:19:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:19:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7/disk --force-share --output=json {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 02 02:19:53 user nova-compute[74996]: DEBUG oslo_concurrency.processutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74996) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 02 02:19:54 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:19:54 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:19:54 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:19:54 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=8981MB free_disk=24.894184112548828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 02:19:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:19:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:19:54 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Instance 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74996) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 02 02:19:54 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 02:19:54 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 02:19:54 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:19:54 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:19:54 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 02:19:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:19:57 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:19:57 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 02:19:57 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Rebuilding the list of instances to heal {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 02:19:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "refresh_cache-2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 02 02:19:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquired lock "refresh_cache-2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 02 02:19:57 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Forcefully refreshing network info cache for instance {{(pid=74996) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 02 02:19:57 user nova-compute[74996]: DEBUG nova.objects.instance [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lazy-loading 'info_cache' on Instance uuid 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:19:57 user nova-compute[74996]: DEBUG nova.network.neutron [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Updating instance_info_cache with network_info: [{"id": "a8b9d3c9-b5cc-49af-957b-9cd2713066ec", "address": "fa:16:3e:b2:8f:60", "network": {"id": "17d61192-0043-4d14-9430-e9428c420996", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1566782008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29da62432afe44fe8e109db1d464f8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b9d3c9-b5", "ovs_interfaceid": "a8b9d3c9-b5cc-49af-957b-9cd2713066ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:19:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Releasing lock "refresh_cache-2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7" {{(pid=74996) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 02 02:19:57 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Updated the network info_cache for instance {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Nov 02 02:19:57 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:19:57 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:19:57 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:19:59 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:19:59 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:20:00 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:20:00 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 02:20:04 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:20:04 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:20:09 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:20:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:20:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:20:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:20:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:20:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:20:14 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:20:19 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:20:20 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:20:24 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:20:29 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:20:34 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:20:39 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:20:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:20:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:20:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:20:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:20:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:20:44 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:20:49 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:20:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6599fa55-260d-4d98-8513-17721a642f74 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Acquiring lock "2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:20:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6599fa55-260d-4d98-8513-17721a642f74 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:20:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6599fa55-260d-4d98-8513-17721a642f74 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Acquiring lock "2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:20:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6599fa55-260d-4d98-8513-17721a642f74 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:20:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6599fa55-260d-4d98-8513-17721a642f74 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:20:52 user nova-compute[74996]: INFO nova.compute.manager [None req-6599fa55-260d-4d98-8513-17721a642f74 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Terminating instance
Nov 02 02:20:52 user nova-compute[74996]: DEBUG nova.compute.manager [None req-6599fa55-260d-4d98-8513-17721a642f74 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Start destroying the instance on the hypervisor. {{(pid=74996) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 02 02:20:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:20:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:20:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:20:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:20:52 user nova-compute[74996]: DEBUG nova.compute.manager [req-24a4cf7d-2925-49bb-b204-f82af8a50307 req-df173142-578b-4d2b-92af-994f14b2e447 service nova] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Received event network-vif-unplugged-a8b9d3c9-b5cc-49af-957b-9cd2713066ec {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:20:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-24a4cf7d-2925-49bb-b204-f82af8a50307 req-df173142-578b-4d2b-92af-994f14b2e447 service nova] Acquiring lock "2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:20:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-24a4cf7d-2925-49bb-b204-f82af8a50307 req-df173142-578b-4d2b-92af-994f14b2e447 service nova] Lock "2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:20:52 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-24a4cf7d-2925-49bb-b204-f82af8a50307 req-df173142-578b-4d2b-92af-994f14b2e447 service nova] Lock "2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:20:52 user nova-compute[74996]: DEBUG nova.compute.manager [req-24a4cf7d-2925-49bb-b204-f82af8a50307 req-df173142-578b-4d2b-92af-994f14b2e447 service nova] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] No waiting events found dispatching network-vif-unplugged-a8b9d3c9-b5cc-49af-957b-9cd2713066ec {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:20:52 user nova-compute[74996]: DEBUG nova.compute.manager [req-24a4cf7d-2925-49bb-b204-f82af8a50307 req-df173142-578b-4d2b-92af-994f14b2e447 service nova] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Received event network-vif-unplugged-a8b9d3c9-b5cc-49af-957b-9cd2713066ec for instance with task_state deleting. {{(pid=74996) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Nov 02 02:20:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:20:52 user nova-compute[74996]: INFO nova.virt.libvirt.driver [-] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Instance destroyed successfully.
Nov 02 02:20:52 user nova-compute[74996]: DEBUG nova.objects.instance [None req-6599fa55-260d-4d98-8513-17721a642f74 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lazy-loading 'resources' on Instance uuid 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7 {{(pid=74996) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 02 02:20:52 user nova-compute[74996]: DEBUG nova.virt.libvirt.vif [None req-6599fa55-260d-4d98-8513-17721a642f74 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-02T02:19:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1935412867',display_name='tempest-VolumesActionsTest-instance-1935412867',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1935412867',id=52,image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-02T02:19:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29da62432afe44fe8e109db1d464f8fd',ramdisk_id='',reservation_id='r-qjrymseb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f544db05-269f-4ce2-a9db-e2f89ecf2dd8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-489656329',owner_user_name='tempest-VolumesActionsTest-489656329-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-02T02:19:08Z,user_data=None,user_id='5e7254e7d8a145669904dca6622f34d1',uuid=2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8b9d3c9-b5cc-49af-957b-9cd2713066ec", "address": "fa:16:3e:b2:8f:60", "network": {"id": "17d61192-0043-4d14-9430-e9428c420996", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1566782008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29da62432afe44fe8e109db1d464f8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b9d3c9-b5", "ovs_interfaceid": "a8b9d3c9-b5cc-49af-957b-9cd2713066ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 02 02:20:52 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-6599fa55-260d-4d98-8513-17721a642f74 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Converting VIF {"id": "a8b9d3c9-b5cc-49af-957b-9cd2713066ec", "address": "fa:16:3e:b2:8f:60", "network": {"id": "17d61192-0043-4d14-9430-e9428c420996", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1566782008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29da62432afe44fe8e109db1d464f8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b9d3c9-b5", "ovs_interfaceid": "a8b9d3c9-b5cc-49af-957b-9cd2713066ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 02 02:20:52 user nova-compute[74996]: DEBUG nova.network.os_vif_util [None req-6599fa55-260d-4d98-8513-17721a642f74 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:8f:60,bridge_name='br-int',has_traffic_filtering=True,id=a8b9d3c9-b5cc-49af-957b-9cd2713066ec,network=Network(17d61192-0043-4d14-9430-e9428c420996),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8b9d3c9-b5') {{(pid=74996) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 02 02:20:52 user nova-compute[74996]: DEBUG os_vif [None req-6599fa55-260d-4d98-8513-17721a642f74 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:8f:60,bridge_name='br-int',has_traffic_filtering=True,id=a8b9d3c9-b5cc-49af-957b-9cd2713066ec,network=Network(17d61192-0043-4d14-9430-e9428c420996),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8b9d3c9-b5') {{(pid=74996) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 02 02:20:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:20:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8b9d3c9-b5, bridge=br-int, if_exists=True) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:20:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:20:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:20:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:20:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09693b52-d091-4f77-b6ee-0f418a8cab22) {{(pid=74996) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 02 02:20:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:20:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:20:52 user nova-compute[74996]: INFO os_vif [None req-6599fa55-260d-4d98-8513-17721a642f74 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:8f:60,bridge_name='br-int',has_traffic_filtering=True,id=a8b9d3c9-b5cc-49af-957b-9cd2713066ec,network=Network(17d61192-0043-4d14-9430-e9428c420996),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8b9d3c9-b5')
Nov 02 02:20:52 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-6599fa55-260d-4d98-8513-17721a642f74 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Deleting instance files /opt/stack/data/nova/instances/2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7_del
Nov 02 02:20:52 user nova-compute[74996]: INFO nova.virt.libvirt.driver [None req-6599fa55-260d-4d98-8513-17721a642f74 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Deletion of /opt/stack/data/nova/instances/2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7_del complete
Nov 02 02:20:53 user nova-compute[74996]: INFO nova.compute.manager [None req-6599fa55-260d-4d98-8513-17721a642f74 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 02 02:20:53 user nova-compute[74996]: DEBUG oslo.service.loopingcall [None req-6599fa55-260d-4d98-8513-17721a642f74 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74996) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 02 02:20:53 user nova-compute[74996]: DEBUG nova.compute.manager [-] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Deallocating network for instance {{(pid=74996) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 02 02:20:53 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] deallocate_for_instance() {{(pid=74996) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 02 02:20:53 user nova-compute[74996]: DEBUG nova.network.neutron [-] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Updating instance_info_cache with network_info: [] {{(pid=74996) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 02 02:20:53 user nova-compute[74996]: INFO nova.compute.manager [-] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Took 0.39 seconds to deallocate network for instance.
Nov 02 02:20:53 user nova-compute[74996]: DEBUG nova.compute.manager [req-b2a2378c-f959-4ac5-a3ff-47be4e2fa327 req-ac7b78d1-005e-4b97-a20d-cdcb574e724c service nova] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Received event network-vif-deleted-a8b9d3c9-b5cc-49af-957b-9cd2713066ec {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:20:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6599fa55-260d-4d98-8513-17721a642f74 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:20:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6599fa55-260d-4d98-8513-17721a642f74 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:20:53 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-6599fa55-260d-4d98-8513-17721a642f74 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:20:53 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-6599fa55-260d-4d98-8513-17721a642f74 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:20:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6599fa55-260d-4d98-8513-17721a642f74 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:20:53 user nova-compute[74996]: INFO nova.scheduler.client.report [None req-6599fa55-260d-4d98-8513-17721a642f74 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Deleted allocations for instance 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7
Nov 02 02:20:53 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-6599fa55-260d-4d98-8513-17721a642f74 tempest-VolumesActionsTest-489656329 tempest-VolumesActionsTest-489656329-project-member] Lock "2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.537s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:20:54 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:20:54 user nova-compute[74996]: DEBUG nova.compute.manager [req-381a21a9-25b5-4b36-8074-7a5587e5b7a0 req-89285516-bd7b-4419-bf9a-a53b1a490374 service nova] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Received event network-vif-plugged-a8b9d3c9-b5cc-49af-957b-9cd2713066ec {{(pid=74996) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Nov 02 02:20:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-381a21a9-25b5-4b36-8074-7a5587e5b7a0 req-89285516-bd7b-4419-bf9a-a53b1a490374 service nova] Acquiring lock "2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:20:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-381a21a9-25b5-4b36-8074-7a5587e5b7a0 req-89285516-bd7b-4419-bf9a-a53b1a490374 service nova] Lock "2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:20:54 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [req-381a21a9-25b5-4b36-8074-7a5587e5b7a0 req-89285516-bd7b-4419-bf9a-a53b1a490374 service nova] Lock "2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:20:54 user nova-compute[74996]: DEBUG nova.compute.manager [req-381a21a9-25b5-4b36-8074-7a5587e5b7a0 req-89285516-bd7b-4419-bf9a-a53b1a490374 service nova] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] No waiting events found dispatching network-vif-plugged-a8b9d3c9-b5cc-49af-957b-9cd2713066ec {{(pid=74996) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 02 02:20:54 user nova-compute[74996]: WARNING nova.compute.manager [req-381a21a9-25b5-4b36-8074-7a5587e5b7a0 req-89285516-bd7b-4419-bf9a-a53b1a490374 service nova] [instance: 2ea39ad6-0d49-4c18-9982-e66fa7b7bbe7] Received unexpected event network-vif-plugged-a8b9d3c9-b5cc-49af-957b-9cd2713066ec for instance with vm_state deleted and task_state None.
Nov 02 02:20:55 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:20:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:20:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:20:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:20:55 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 02:20:55 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:20:55 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:20:55 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=9082MB free_disk=24.921314239501953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 02:20:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:20:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:20:55 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 02:20:55 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 02:20:55 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:20:55 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:20:55 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 02:20:55 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:20:56 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:20:56 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 02:20:56 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Rebuilding the list of instances to heal {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 02:20:56 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Didn't find any instances for network info cache update. {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 02:20:57 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:20:57 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:20:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:20:59 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:20:59 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:21:01 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:21:01 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 02:21:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:21:04 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:21:05 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:21:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:21:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:21:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:21:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:21:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:21:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:21:11 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:21:11 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Cleaning up deleted instances {{(pid=74996) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Nov 02 02:21:11 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] There are 0 instances to clean {{(pid=74996) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Nov 02 02:21:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:21:15 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:21:15 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74996) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Nov 02 02:21:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:21:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:21:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:21:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:21:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:21:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:21:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:21:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:21:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:21:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:21:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:21:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:21:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:21:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:21:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:21:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:21:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:21:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:21:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:21:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:21:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:21:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:21:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:21:55 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:21:56 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:21:56 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 02:21:56 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Rebuilding the list of instances to heal {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 02:21:56 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Didn't find any instances for network info cache update. {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 02:21:57 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:21:57 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:21:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:21:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:21:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:21:57 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 02:21:57 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:21:57 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:21:57 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=9090MB free_disk=24.920551300048828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 02:21:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:21:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:21:57 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 02:21:57 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 02:21:57 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Refreshing inventories for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 02 02:21:57 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Updating ProviderTree inventory for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 02 02:21:57 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Updating inventory in ProviderTree for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 02 02:21:57 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Refreshing aggregate associations for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259, aggregates: None {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 02 02:21:57 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Refreshing trait associations for resource provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG {{(pid=74996) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 02 02:21:57 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:21:57 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:21:57 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 02:21:57 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:21:57 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:21:58 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:22:00 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:22:01 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:22:02 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:22:03 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:22:03 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 02:22:07 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:22:07 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:22:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:22:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:22:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:22:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:22:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:22:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:22:17 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:22:20 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:22:22 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:22:27 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:22:32 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:22:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:22:35 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:22:37 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:22:42 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:22:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:22:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:22:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:22:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:22:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:22:47 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:22:52 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:22:56 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:22:56 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 02:22:56 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Rebuilding the list of instances to heal {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 02:22:56 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Didn't find any instances for network info cache update. {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 02:22:57 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:22:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:22:58 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:22:59 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:22:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:22:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:22:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:22:59 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 02:22:59 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:22:59 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:22:59 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=9080MB free_disk=24.918926239013672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 02:22:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:22:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:22:59 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 02:22:59 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 02:22:59 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:22:59 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:22:59 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 02:22:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.121s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:23:00 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:23:00 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:23:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:23:03 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:23:04 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:23:04 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 02:23:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:23:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:23:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74996) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 02 02:23:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:23:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74996) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 02 02:23:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:23:08 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:23:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:23:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:23:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:23:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:23:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:23:38 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:23:43 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:23:48 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:23:53 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:23:56 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:23:56 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Starting heal instance info cache {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Nov 02 02:23:56 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Rebuilding the list of instances to heal {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Nov 02 02:23:56 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Didn't find any instances for network info cache update. {{(pid=74996) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Nov 02 02:23:58 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:23:58 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:23:59 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:23:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:23:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:23:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:23:59 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74996) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 02 02:23:59 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:23:59 user nova-compute[74996]: WARNING nova.virt.libvirt.driver [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 02 02:23:59 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Hypervisor/Node resource view: name=user free_ram=9104MB free_disk=24.917823791503906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74996) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 02 02:23:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 02 02:23:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 02 02:23:59 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 02 02:23:59 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74996) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 02 02:23:59 user nova-compute[74996]: DEBUG nova.compute.provider_tree [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed in ProviderTree for provider: f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 {{(pid=74996) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 02 02:23:59 user nova-compute[74996]: DEBUG nova.scheduler.client.report [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Inventory has not changed for provider f50a6eca-4874-4b8c-8df6-3d5aa5ebb259 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74996) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 02 02:23:59 user nova-compute[74996]: DEBUG nova.compute.resource_tracker [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Compute_service record updated for user:user {{(pid=74996) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 02 02:23:59 user nova-compute[74996]: DEBUG oslo_concurrency.lockutils [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.350s {{(pid=74996) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 02 02:24:00 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:24:00 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:24:02 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:24:03 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:24:04 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:24:05 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:24:05 user nova-compute[74996]: DEBUG nova.compute.manager [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74996) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Nov 02 02:24:08 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:24:10 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:24:12 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:24:13 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:24:18 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 02 02:24:23 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:24:23 user nova-compute[74996]: DEBUG oslo_service.periodic_task [None req-d4baa194-9dea-4d08-8aef-4734b7150bf5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74996) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 02 02:24:28 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 02 02:24:33 user nova-compute[74996]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74996) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}